Hi,
We are scheduling BODS jobs from SAP CPS scheduling by Redwood.
SAP CPS connects to BODS via webservices.
Our BODS system has two CMS in separate Windows Servers to balance the loads.
We have created a virtual URL, which points to node 1, and will switch to node, only when node 1 fails.
SAP CPS connects to Data Services using the virtual URL.
Now, we have sporadic failures of BODS jobs in SAP CPS. There are two cases:
- The job doesn't even start in BODS, but is is marked as error in SAP CPS based on the BODS reply
- The job starts in BODS system, but after sometime, the job is marked as error in SAP CPS based on the reply from BODS.
In both cases, the error log on SAP CPS is as below:
java.io.IOException: Failed to send request:
com.redwood.scheduler.soap.client.impl.SOAPRequestImpl@37e6aa2b
org.xml.sax.SAXParseException: The reference to entity "ua" must end with the ';' delimiter.
ava.io.IOException: Failed to send request:
com.redwood.scheduler.soap.client.impl.SOAPRequestImpl@37e6aa2b
at com.redwood.scheduler.connector.sap.bobj.dataservices.connection.impl.DataServicesConnectionImpl.callDataServices(DataServicesConnectionImpl.java:450)
at com.redwood.scheduler.connector.sap.bobj.dataservices.connection.impl.DataServicesConnectionImpl.getJobStatus(DataServicesConnectionImpl.java:258)
at com.redwood.scheduler.connector.sap.bobj.jobs.impl.DataServicesJobRun.execute(DataServicesJobRun.java:170)
at com.redwood.scheduler.connector.sap.bobj.service.BObjJobWorker.doWork(BObjJobWorker.java:79)
at com.redwood.scheduler.infrastructure.workqueue.Worker.run(Worker.java:76)
at java.lang.Thread.run(Thread.java:761)
Caused by: org.xml.sax.SAXParseException: The reference to entity "ua" must end with the ';' delimiter.
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1234)
at com.redwood.scheduler.soap.client.impl.SOAPRequestImpl.parseResponseXML(SOAPRequestImpl.java:619)
at com.redwood.scheduler.soap.client.impl.SOAPRequestImpl.handleSOAPResponse(SOAPRequestImpl.java:606)
at com.redwood.scheduler.soap.client.impl.SOAPRequestImpl.send(SOAPRequestImpl.java:361)
at com.redwood.scheduler.connector.sap.bobj.dataservices.connection.impl.DataServicesConnectionImpl.callDataServices(DataServicesConnectionImpl.java:446)
- Not all the jobs fails, most of them are successful.
- Its not the same job that fails everytime, its random.
- The time of occurrence is also random and doesn't follow a pattern.
In WebAdmin log, we see below;
07/08/2015 11:00:01 [ INFO ] Reply sent to client: <?xml version='1.0' encoding='utf-8'?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"><soapenv:Body> <localtypes:BatchJobResponse xmlns:localtypes="http://www.businessobjects.com/DataServices/ServerX.xsd">Unable to get security session using id 3&ua=AWmaEx4Z.NVPpAEthuTGAjc,8P&ub=AdYHmx6bovtHpYPw0P1K61A,8P&S5,88&5U=1118732JVDWkeOGJrkqtt9nwn6ufqJ1118731JTXlbWnISGnhbnfQlinj8ad,8P&63=secEnterprise,8P&2r=IRVWP64PAT01:6400,8P&3k=@IRVWP64PAT01.corp.ad.broadcom.com:6400,8P&1,8P&W={},?z&4E=1118731JTXlbWnISGnhbnfQlinj8ad,8P&Tn={3&.1={3&2=13545,03&O=FavoritesFolder,0P},2z&.2={3&2=13546,03&O=PersonalCategory,0P},2z&.3={3&2=13547,03&O=Inbox,0P},2z&U=3,03},?z&4F=13544,8P&Tm=36500,83&uy=-21,8L&35=RFC_CPS,8P&ux=Afz_wvFayylHhMZIc3SLW.8,8P&pa,8P&zA,83 </localtypes:BatchJobResponse></soapenv:Body></soapenv:Envelope>
We have an incident with SAP for the last 4 months with no root cause or solution in sight. At the time of writing this incident SAP Dev team is looking into the BODS system.
I have posted this SAP Data services space because, this issue has been analyzed by Redwood support and the verdict is that problem is on the Data services side.
Please let me know if anyone else have faced a similar issue or if you need more information to diagnose the error.
Thanks
Nanda