Hi Gurus,
I am struggling with an issue in Data Services.
I have a job which uses Table Compare, then History Preserving and then a Key Generation transforms.
There is every possibility that data would get deleted from the source table.
Now, I want to delete them from the target table also.
I tried Detect deleted rows but it is not working.
Could some one please help me on this issue.
Thanks,
Raviteja.
Today I found " table comparison " is very weird , so that I don't know how could I use it well .
My etl job is very simple .
Extract data from flatfile, compare these data with one table(in fact, this table is empty) to find new and updated records ,and insert into another table finally .
I use " sorted input " in "table comparison", and I know I need order these data before " table comparison".
And I use two columns as "input primary key column" .
Below are part of my data in flatfile .
2009.01.11 00:00:00|1.3638|Y|EUR@USD@39814@Y|EUR|2009.01.01 00:00:00|USD
2009.01.11 00:00:00|10.157|Y|GBP@CNY@39814@Y|GBP|2009.01.01 00:00:00|CNY
2009.01.11 00:00:00|1.0917|Y|GBP@EUR@39814@Y|GBP|2009.01.01 00:00:00|EUR
2009.01.11 00:00:00|137.09|Y|GBP@JPY@39814@Y|GBP|2009.01.01 00:00:00|JPY
2009.01.11 00:00:00|1.489|Y|GBP@USD@39814@Y|GBP|2009.01.01 00:00:00|USD
There're 4500 records in flatfile , and 7 columns per row. And one of columns contains 3 "@" .
But this job hang . I haven't saw it end .
I replaced "@" using "#" or "%" . This job also hang.
But the weird thing is that , if I replace "@" using "(" or "!" or "-" , this job run very quick ( less than 5 seconds).
And if I reduce the rows of flatfile to 900 rows, this job also run quick.
Because of this problem, I am very sad and I have a thought to not use bods.
Could someone met the same problem ?
If I have an RFC call to SAP how can I assign the value returned to a global variable on my data services job?
I am currently planning to use DBMS_CDC_PUBLISH.PURGE_CHANGE_TABLE to purge unused data for CDC tables
I don't know how I can import and execute it inside Data Services
We are using BODS 3.2 for development. We are aware that a newer version of DS has been released quite a long time ago but due to some reasons we are still using DS 3.2.
We are facing some session creation issues. We are using Teradata and Oracle as source and extracting\updating data using some SQLs in script tasks. SQLs are targeting huge amount of data. We executed a job and checked on the servers, sessions were created on the databases. Job kept on executing for long time and was not getting completed, there was no error also. After waiting so long, I checked on Database server and found that session was lost for these SQLs on Database servers. We are able to create a successful connection using Data Stores.
Please suggest something, Why the sessions are not getting lost on the database servers?.
Thanks & Regards,
Gaurav Bansal
Hello everyone,
I have some errors to log on the local repository. please see the attach file.
In fact, the repository looks like the common repository for the test.
So I adds the "full control" right to several USER GROUPs in this repostiory via CMC.
When the user log on this repo, he met the error "login failed for user, the user not active"
We use BODS 4.1.
Thanks for your help.
Xin
Dear Experts
Please provide me the way how to call a job by a script .
I have used Export Execution Command as recommended by below links
http://scn.sap.com/docs/DOC-34648
But I am not able to locate .sh file in unix server .
This is required to call a job after completion of parent job.
Thanks
Anupam
Hi Everyone,
We've upgraded our DS 4.0 to DS 4.2 and Installed IS 4.2 on top of it.
When I try to profile data in IS, the task is failing and I'm getting the following error :
[C] 2014-03-03 13:35:07.159 [TaskUtility][main] Loading database driver oracle.jdbc.driver.OracleDriver for database engine Oracle 11.
[E] 2014-03-03 13:35:12.894 [TaskUtility][main] ORA-01017: invalid username/password; logon denied
[E] 2014-03-03 13:35:12.894 [TaskUtility][main] java.sql.SQLException: ORA-01017: invalid username/password; logon denied
How can this be resolved ? Is it related to CMS database ? What do I need to do in the DB to make sure that the CMS database is correctly setup ? Does CMS has a special user name and password or I can use the DB admin/system user ?
Please help.
Hi Everyone,
I'm facing this error when I try to login to IS and to CMC :
IS
Account Information Not Recognized: Enterprise authentication could not log you on. Please make sure your logon information is correct. (FWB 00008)
CMC
Account information not recognized: Could not reach CMS 'SS-JHQ-DSD:6400'. The CMS on machine 'SS-JHQ-DSD' was stopped due to a critical error. (FWM 20031)
How can I trace the cause of this ? I'm sure it is related to CMS, but how to resolve it ?
I'm using Oracle DB, what do I need to do here to see if CMS DB is fine ?
Regards,
Hi Experts
I am trying to run BODS Text data Processing Blueprints 4.1.1.- English, and when i am trying to run TdpBlueprintEn_Twitter, it is executing successfully but i am not getting any result..and in the execution trace list i found a line as "The server couldn't fullfill the request due to 400" is this the error stoping my request.. please suggest me what are the steps i have to follow to get the tweets.
Thanks in advance
Prasanna Kumar
Hi all
what's the best way to move from Dev to Production a new RapidMart ? My idea was to export the jobs as .atl like I always do but I'm just concerned about all new Abap programs that do not exist in Prod: How can I identify them once imported and generate/upload them all before I run the new RM ?
thanks
Hi,
We plan to run a scenario to demonstrate DS ability for real time or near real time scenario.
We identified different solutions and we are trying to choose the most appropriate :
- Oracle 11g + Sybase Replication server + Data Services
- Oracle 11g + Data services : real time jobs ( xml messages )
- Oracle 11g + Data Services : CDC scenario
I need to load data into a SAP Sybase IQ database : is there any known issue with one of the previous solution ?
The challenge is to load a set of 10 tables, for more than 5 millions rows,
Thanks for your advices,
Guillaume
Hi,
There is a custom function defined and it is called in the query transform as function call output.
Custome Function.
IF ( $PREV_NAME IS NULL )
begin
$PREV_NAME = $CURR_NAME ;
end
else
begin
$PREV_NAME = $PREV_NAME || ',' || $CURR_NAME ;
end
Return $PREV_NAME ;
Am getting the output always only $Curr_name parameter value, here Prev_name parameter is initialized NULL in work flow stage.
please advise here,why else part is not working and let me know if you need any further information.
Thanks.
Best Regards,
Edu.....
Hi All,
My requirement is to write the data to an excel file and mail to the support team. Is it possible to create the excel file via ODBC? I know that DS won't support excel target directly. Please help.
Thanks,
We have a job which executes many workflows in parallel. This works as expected.
Each of these workflows calls a workflow, say WFscript, which executes a script.
That was the only way of making the script re-usable.
Now, when executing the jobs, we see that all instances of WFscript start simultaneously. That is still as expected.
However, the instances of the script don't run simultaneously, but one at a time.
It is as if the instances of the script are aware of each other.
First, one instance of the script in one instance of WFscript runs, then the next instance of the script in the next instance of WFscript runs. All script instances one at a time.
It doesn't matter which logic the script contains.
We couldn't think of any reason why the instances of the script would wait for each other, or even be aware of each other.
According to SAP Support, there is no documentation on which instances of objects will or will not execute simultaneously.
So, we're interested in any experiences with simultaneous execution of script instances (or any other objects). Which objects should be able to have instances of them executed simultaneously?
Hello Everyone,
Is it possible to to upgrade from a secure central repository to an non secure central repository?
When I try to upgrade the SECURE central repository to NON SECURE in the Data Service Repository Manager.
I met the error message below:
It is not allowed to upgrade from a secure central repository to an non secure central repository. (BODI-300081)
Thanks for your help
Xin
Hi.
I'm receiving this error when I try to login to IS. User is fine, however I noticed in CMC that no repository is assigned in IS application and it is empty. How to reconfigure the IS repository ?
The service Information Steward Application Service was not installed on at least one computer in the SAP Business Objects Business Intelligence platform system. (COR-10863)
Regards,
Hi Experts,
I am getting a strange warning like the one i mentioned below.
[Query:Q_Format_Row]
The data type conversion will be used to convert from type <decimal(3,0)> of mapping expression <to_decimal_ext( Q_Check_Key_Translations.RESIDENT_STATE_DST,'.','',3,0)> to type <decimal(3,0)> of target column <RESIDENT_STATE_DST>. (BODI-1110410)
Here the target column is of data type Decimal(3,0) and the source is varchar(30). I tried both cast function and to_decimal_ext. But I am getting same warning. Please help me out
Thanks & Regards
Alex Oommen
I am using smtp_to in a script to email users once a job completes. The email gets sent if I run the job out of the Data Services Designer but if I schedule the job to run using Data Services Management Console the email doesn't get sent. I am using Data Services version 4.2 SP1.
Any help would be greatly appreciated.
Thank you!
Folks,
I'm having some issues using the DSConnectionManager not showing the tcACCESS connection info.
1) When I add my drivers and source to odbc.ini and odbcinst.ini in the datadirect/odbc directory I can't seem to "see" them to select using DSConnectionManager.
My linux odbc manager shows:
> odbcinst -j unixODBC 2.2.14
DRIVERS............: /etc/odbcinst.ini
SYSTEM DATA SOURCES: /etc/odbc.ini
FILE DATA SOURCES..: /etc/ODBCDataSources
USER DATA SOURCES..: /app/bods/sapbo/dataservices/DataDirect/odbc/odbc.ini
SQLULEN Size.......: 8
SQLLEN Size........: 8
SQLSETPOSIROW Size.: 8
2) It seem that this should show my /app/bods/sapbo/dataservices/DataDirect/odbc/odbcinst.ini var somewhere above.
> echo $ODBCINI /app/bods/sapbo/dataservices/DataDirect/odbc/odbc.ini
> echo $ODBCINST /app/bods/sapbo/dataservices/DataDirect/odbc/odbcinst.ini
When I look at what is installed I get this:
> odbcinst -s -q
[ODBC]
[tcACCESS]
[DB2 Wire Protocol]
[Informix Wire Protocol]
[Oracle Wire Protocol]
[Sybase Wire Protocol]
[Teradata] [SQL Server Wire Protocol]
[MySQL Wire Protocol]
[PostgreSQL Wire Protocol]
[Greenplum Wire Protocol]
[Salesforce]
[HANA_DI5]
[HANA_DI3]
3) It seems that I should have "tcACCESS" shown in the DSConnectionManager since I see it above
Also to note that when I try to run in my odbcinst file like below I get an error message
> odbcinst -i -d -f odbcinst.ini
odbcinst: SQLInstallDriverEx failed with Invalid install path.
When I look at the drivers installed it only shows:
> odbcinst -d -q
[PostgreSQL]
[MySQL]
To complicate matters the admin manual talks about setting env vars to odbc.inst
Also it mentions ds_odbc.ini and all that's in there are samples so I have no idea how that plays into this.
I have used the tcACCESS driver usinig isql and it works!!!! All the libs are installed, so I'm almost there.
Hope someone can straighten me up here.
Mike
