Quantcast
Channel: SCN : Unanswered Discussions - Data Services and Data Quality
Viewing all 3719 articles
Browse latest View live

BODS installed on HANA DB

$
0
0

Folks,

Greetings!

 

We are aiming to setup SAP Data Services 4.2 SP05 on HANA DB, and are seeking help regarding any technical dependencies or other 'worrying' areas which we should consider in addition to the installation / upgrade guides.

 

In our landscape, we have BODS 4.0 on MSSQL, and we are looking to upgrade plus migrate this to HANA, with IPS/job server remaining either on Windows or moving to Unix.

The BW HANA database is already setup and working, and we would be creating only a new schema for the BODS database for our use.

 

Any help or information in this regard will be greatly useful for us.

Thanks a lot for all your help and support! Looking forward to some valuable inputs on this discussion....


Lock timeout occurs while waiting TABLE_LOCK of mode EXCLUSIVE

$
0
0

Hello Experts,

 

Kindly give me your inputs to solve the below issue.

 

The below table is in HANA.

 

Function call <raise_exception_ext ( SQL submitted to database <> resulted in error <[SAP AG][LIBODBCHDB SO][HDBODBC] General

error;131 transaction rolled back by lock wait timeout: Lock timeout occurs while waiting TABLE_LOCK of mode

EXCLUSIVE(TRANSACTION_ID=432, UPDATE_TRANSACTION_ID=1021837743)>. The SQL submitted is <ALTER TABLE

"PDM_CDM"."PREPAID_SUBSCRIBER_SNAPSHOT" ENABLE PERSISTENT MERGE>.|<ALTER TABLE  "PDM_CDM"."PREPAID_SUBSCRIBER_SNAPSHOT" ENABLE PERSISTENT MERGE>|<PREPAID_SUBSCRIBER_SNAPSHOT>, 70407 ) > failed, due to error <50316>: <SQL submitted to database <> resulted in error <[SAP AG][LIBODBCHDB SO][HDBODBC] General error;131 transaction rolled back by lock wait timeout: Lock timeout occurs while waiting TABLE_LOCK of mode EXCLUSIVE(TRANSACTION_ID=432, UPDATE_TRANSACTION_ID=1021837743)>. The SQL submitted is <ALTER TABLE  "PDM_CDM"."PREPAID_SUBSCRIBER_SNAPSHOT" ENABLE PERSISTENT MERGE>.|<ALTER TABLE  "PDM_CDM"."PREPAID_SUBSCRIBER_SNAPSHOT" ENABLE PERSISTENT MERGE>|<PREPAID_SUBSCRIBER_SNAPSHOT>>.

 

Thanks in advance,

Venkat

Date variables seem to be treated in a different way during the transfer from SOAP to BODS 4.2

$
0
0

Dear,


Date variables seem to be treated in a different way during the transfer from SOAP to BODS 4.2, then in BODS 4.0. In some cases, quotes are needed and in other not. Let’s take three inputs: 2015.07.10, ‘2015.07.10’ and ‘Hello’. The results are the following ones, depending on where the job is launched from:

 

Parameter                                                   2015.07.10                                     ‘2015.07.10’                      ‘Hello’ 

Launched from Admin Cons Dev                Fails                                                Success, date correct      Success, date empty

Launched from Soap Dev                           Fails                                                Success, date correct      Success, date empty

Launched from Admin Cons Q                    Fails                                                Success, date correct     Success, date empty

Launched from Soap Q                               Fails                                                Success, date correct      Success, date empty

Launched from Admin Cons Prod               Fails                                                Success, date correct      Success, date empty

Launched from Soap Prod                          Success, date correct                     Fails                                  Fails   

 

So it seems like on Dev and Q, the parameter is interpreted the same way, while on Prod 2015.07.10 on Soap is equivalent to ‘2015.07.10’ in Bods.


DEV & QAS are BODS 4.2 & PRD is still BODS 4.0


Br

Steven

Flat File Event Trigger base Job Scheduling in BODS

$
0
0

I have to schedule a job at 9am and it could run based on file event.That means, My bods job has to check wether file has arrived or not within 10 minutes like this it has to check 6 times every 10minutes if doesn't arrive then it has send an email,if its arrive it should run.

 

Iam completely novice to bods and it would be great if any one share complete logic detailly. However, I have found script on other post

which test file is arrived or not for ten minuts, but as per my requirement it has to verify 6 times for every ten minutes. please show your insight on it.

 

Wait for a file
$FileName= 'C:\\DIR\\FlatFile_' || to_char( sysdate( ), 'YYYYMMDD' ) ||  '.csv';
print ( $FileName );

 

While ( file_exists ( $FileName ) = 0 )
Begin
print( 'Waiting for File' );
Sleep(600);
End
print ( 'File Received Successfully' );
print ( 'File Processing Started' );

Error 53003

$
0
0

Using DS 4.2, SQL server 2012 database and windows 2012

 

When run a job, has the following error:

 

Dataflow XXXX is terminated due to error <53005> (from the tracing log)

 

 

@RUN-053005, ERROR, 0, 0.000, 53474.281, 0.000, 0.000, 0:0, 0.000, 0, RUN-053005: |DATA FLOW xxxxx|EMBEDDED

DATAFLOW xxxxxx|TRANSFORM xxxxx:A NUMERIC'S MAXIMUM NUMBER OF DIGITS IS <28>. YOU ARE ATTEMPTING

TO STORE VALUE OR CONSTANT <550100000055082010041902101> 0000005, 31335=20313030343139203132204=74672043726564204>,

WHOSE <83> DIGITS EXCEED THE MAXIMUN. (FROM MONITOR LOG)

 

I didn't find any bad data and what is going on?

using delete command via script in BODS to delte files older than 'x' days

$
0
0

Hi All,

I am using a script in DS to delete/purge files from a DS job server using a command like this:

 

print (exec ( 'cmd' , 'del " '||$GV_path||' *.txt' || ' " ' ));

 

This deletes all the files which exist there with the *.txt extension.

What I really want to do is delete only those files that have a create date of more than "x" days old.

 

Does anyone know how I can parse that in the cmd using Data Serrvices?

 

thanks!!

RFC Server not available

$
0
0

Hi Experts,

 

We are trying to create a RFC connection in Management console, but we are getting RFC Server not available issue.RFCServernotavailable.JPG

Can you please help us here to resolve the issue.

 

And also why do we need to create a RFC connection if we are using SAP BW as a source?? and do we need to create a RFC connection if we use SAP Application as source(ECC) if not what type of configurations we should setup to connect ECC System.

 

Please help us here to understand the difference.

Time required for ETL process using DataServices

$
0
0

Hello to all.

 

One of our customers (that acquired BOBI 4.1 Edge) is about to start a DWH project that includes ETL processes. They are planning to use its SAP Data Services for that.

 

But for some previous planning for other related aplications, they asked us for reference information about ETL processing times shown in other installations (BODS customers) along with its tech data (source data size, CPU, RAM, network throughput, etc).

 

This customer has 3 TB of data on its Oracle DB and will be moving it to a ODS/Staging on Sybase IQ. BOBIP and BODS will be running on Linux 96GB ram, 8 cores. So would be helpful to know of similar installations and their ETLs processing times.

 

 

Thank you in advance.

 

Carlos Rojas.


BODS 3.2 to 4.2 Upgrade - Central Repository

$
0
0

Hi

 

We are just upgrading 3.2 to 4.2 and are wondering about the validity of upgrading the Central repo.

 

I have heard comments about there being problems in the area of the upgrade of joins in queries (obviously big changes in this area in 4.2 c.f. 3.2) and we would be best off scraping our existing central and starting afresh.

 

I don't really want to take this approach as there is a desire to retain our history.

 

Any comments?

 

BTW - running repoman against our existing central to perform the upgrade takes 1.5h with working set size peaking at around 6Gb!!

 

Maurice

How to convert csv column representinf GPS coordinate into ST_Point HANA column with DS

$
0
0

Hi Expert,

 

I have to import CSV file that contains GPS coordinate in Google format (ex: 41.44533 11.5555) into HANA table filling the corresponding ST_Point column.

 

As i know in the 4.2.5 release of DS should be possible to convert this by DS but i diden't find any DS functions that can help me.

 

How should it be possible?

 

Many Thanks,

 

Francesco

NVARCHAR in BODS

$
0
0

Hi All,

 

I'm trying to load the data from Oracle DB to HANA . I have my table in HANA with fields as NVARCHAR.

 

My source system is Unicode enabled system. While creating the data store to UTF-8

 

 

When i import the table from HANA into Data Services it still shows as VARCHAR.Is there anything else that i need to take care of inorder to bring the data without any issues

 

 

Thanks

CALL FUNCTION 'ADDR_VALIDATION' DESTINATION g_rfcdest

$
0
0

Hello All,

 

we are trying to setup connection between BODQ and ECC to check Address validation on some transactions. We did all the setup at both ends and now trying to execute the validation for XD02, Customer address validation. Now when I try to execute that,

while CALL FUNCTION 'ADDR_VALIDATION' DESTINATION g_rfcdest

it gives me Communication error, then I checked the RFC connection and now that is fine. Now I get the System error (sy-subrc 2)

 

Now I would like to know how / where I can find the code for that function ADDR_VALIDATION (could not find in SE37)

 

I am assuming that should exist in the target which in my case is DQ (using which we are trying to connect the Target).

 

Can anyone please let me know where to exactly check when I try to test. How can we Map this Function call to DQ server.

 

SAP has given some functions like Address cleanse, Address match PV etc. which are active in DQ server but nothing returns

 

Please guide

 

Kind Regards

Krishna

Connection to HDFS files using SAP BODS

$
0
0

Hi all,

    I have a new requirement in SAP BODS, i need to connect and create datastore for hdfs files, we implemented one hortonworks sandbox also in our environment,so now how can i connect to the hdfs files using SAP BODS.

Can any one please tell me the steps on how to create this connection.

 

 

Thanks in advance

Prasannakumar.

How to retrieve repository details?

$
0
0

Hello Experts,

 

Over a period of time, we have registered many repositories in CMC. Now that we need the following details, where can we collect all at once?

  1. Repository name
  2. Repository database host
  3. Repository database name
  4. Repository database user name
  5. Repository type

 

Collecting them from Central Management Console one by one is a real pain. Anything we can retrieve from CMS DB or anywhere else?

Unable to start CMS after BODS installation dir owner changed

$
0
0

Hi All

 

Please help me with below error. We had to recently change the ownership of BODS installation directories to service account on linux and once the changes are made we are unable to start CMS or login we get below error.

 

When I try to login CMC i get below error

Error: Server <Servername:6400> not found or server may be down (FWM 01003) null

 

and

CMS display or login is giving below error

 

Failed to log on to CMS. Reason:

err: Error:  Could not log on to CMS (STU00152)

err: Error description: The system <cmsname> can be contacted, but there is no Central Management Server running at port 6400.

 

I understand the above error is due to incorrect credentials but I am informed that I have been given correct credentials.

 

 

System Details are as below:

@(#)BOBJVERSION: 14.0.4.738 boe_cmsd release 12/06/11 linux_x64vclnxc39vm1

SAP BusinessObjects Data Services Job Server Version = 14.0.3.273


Let me know what else I should be checking or modifying to resolve the issue.


BODS performance improvement in 4.2 compared to 3.2 version

$
0
0

Hello,

 

We are migrating the jobs from 3.2 to 4.2 version SP1.

I would like to know what are the features provided in 4.2 purely with respect to performance of Batch Jobs! ( there is no Data quality here).

 

I am not looking anything related to architectural changes / new features introduced like text data processing..

So, please provide links where I can find how to tune performance in 4.2 which is not available in 3.2!

 

Thanks & Regards,

Amar.

Error while opening some Scheduler in Data Service

$
0
0

We are getting and error "[Exception Socket is closed encountered while contacting the server, so it is assumed the schedule is no longer active.] " trying to open certain schedules. The servers are running with admin privileges.  The Servers running on a Linux OS. I have gone through similar threads and none seem applicable here. Need help to debug. The same jobs are executing fine with new schedules.

"Initializing transcoder" message on data stores that aren't being used in a job

$
0
0

We have a series of jobs that use SOAP data stores to send some data out and receive a response back.  That part all works fine.

 

The problem is once you have any of these data stores in your repository, no matter what job you run you get a stream of "Initializing transcoder for datastore ABC to transcode between engine codepage and datastore codepage."

 

It's not an earth shattering issue, because everything still works.  But since some of our repositories have several dozen of these data stores in them, it does make working through job logs very, very noisy.

 

Anyone have any idea what might cause this and how to make these messages stop showing up in unrelated jobs?

Data Services and Information Steward 4.2 SP5 ugrade issues

$
0
0

Hi,

 

We recently upgraded our Data Services and Information Steward environment from 4.2 SP3 to 4.2 SP5 and as a result we have encountered a few issues.

 

Our environment details are as follows:

 

Prior to Upgrade

*****************

Product Version: IPS 4.1 SP4

Product Patches installed: None

Data Services Version: 4.2 SP3

Data Services Patches installed: None

Information Steward Version: IPS 4.2 SP3

Information Steward Patches installed: None

OS: Windows Server 2012

CMS DB: SQL Server 2012

Reporting DB:SQL Server 2012

 

After Upgrade

**************

Product Version: IPS 4.1 SP5

Product Patches installed: None

Data Services Version: 4.2 SP5

Data Services Patches installed: None

Information Steward Version: IPS 4.2 SP5

Information Steward Patches installed: None

OS: Windows Server 2012

CMS DB: SQL Server 2012

Reporting DB:SQL Server 2012

 

After the install the DS repos were upgraded as recommended.

 

ISSUE 1:

Prior to upgrade we were able to see the Data Quality Reports via the Data Services Management Console.

But now when we click on Data Quality Reports in Data Services Management Console we get this error (full error attached):



ISSUE 2:

Prior to the upgrade we were able to run Data Services jobs successfully, but now it fails. We get this error:

"Data Services Error 58306 message text does not exist in file (null). Please contact Technical Support.”


Did anyone have a similar issue? How do we fix this. Please advise as this is one of the road blocks for the go-live. Thanks


Regards,

H

Urgent:Job Server looses connectivity with shared path

$
0
0

hi Experts

 

Need your expert advice on below issue.

 

We have noticed that one of our job fails and create huge data dumps, at the same time we have all Jobs unable to read/write files on one of the shared paths. Generally restarting the Jobs server has resolved the issue.

 

Today we faced the same issue and it didnt get resolved even after restart of JS. has any one faced this issue earlier or any suggestions on this

Viewing all 3719 articles
Browse latest View live