Hello Experts,
One of our Customised Application was working fine when it was pointed to a Old HPUX box, latter a new clone was created on RHEL supported version. Our CS & Webtop are on 67SP1.
Now after the Webtop is pointed to the new CS, none of the WFs are running and all the Tasks are moving to 'Future' state automatically.
Have taken the below steps:
1. Restarted Application Server along with Cache clean
2. Restarted Docbase, JMS along with verification of Agent Exec status, which is running
3. The New CS is having other repositories, where they are not facing any issues with JMS or WFs
4. No error message on Application Server logs( i.e. Tomcat), JMS Logs or Content Server logs.
5. Even running the WFs with Superuser account doesn't help
Carried out a DFC trace and found the below exception only for the below DQL related to Workflow with a BAD ID. Have highlighted in RED
Please let me know, what should be the next action steps to fix it.
....com.documentum.fc.client.impl.session.Session@1722ed5.getDocbaseApi ==> com.documentum.fc.client.impl.docbase.DocbaseApi@15434b9
2013-12-20 10:30:13.526 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [RPC_ENTER] ....RPC: applyForCollection("EXEC",null,DynamicallyTypedData@151834b[readOnly=false, autoFill=true, fetchTimestamp=0, values=[QUERY=select p.r_act_name, p.r_act_def_id, a.a_status from dm_process p, dm_activity a where p.r_object_id='4b01a7aa8002133b' and any p.r_act_type=4 and a.r_object_id=p.r_act_def_id and a.exec_subtype=3 enable (row_based), FOR_UPDATE=F, BATCH_HINT=50, BOF_DQL=T, FLUSH_BATCH=-1]],50,true,true)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [RPC_EXIT] ....RPC: applyForCollection ==> TypedDataIterator{collectionId=1, open=true, maybeMore=false}
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ...com.documentum.fc.client.impl.session.Session@1722ed5.query ==> com.documentum.fc.client.impl.typeddata.ITypedDataIterator@82cd4c
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ..com.documentum.fc.client.impl.session.SessionHandle@18f57a7.query ==> com.documentum.fc.client.impl.typeddata.ITypedDataIterator@82cd4c
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ..com.documentum.fc.client.impl.collection.TypedDataCollection.newInstance(com.documentum.fc.client.impl.connection.docbase.DocbaseConnection$IteratorSynchronizer@82cd4c,com.documentum.fc.client.impl.session.StrongSessionHandle@18f57a7)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ...com.documentum.fc.client.impl.collection.TypedDataCollection.getTypedData(com.documentum.fc.client.impl.connection.docbase.DocbaseConnection$IteratorSynchronizer@82cd4c)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ...com.documentum.fc.client.impl.collection.TypedDataCollection.getTypedData ==> TypedData@1745dc5[type=QR, readOnly=false, autoFill=false, fetchTimestamp=0, values=[r_act_name=, r_act_def_id=, a_status=]]
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ...com.documentum.fc.common.DfObject@b83248.<init>()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ...com.documentum.fc.common.DfObject@b83248.<init> ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ...com.documentum.fc.client.DfTypedObject@b83248.<init>(TypedData@1745dc5[type=QR, readOnly=false, autoFill=false, fetchTimestamp=0, values=[r_act_name=, r_act_def_id=, a_status=]],com.documentum.fc.client.impl.session.StrongSessionHandle@18f57a7)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ....com.documentum.fc.client.DfTypedObject@b83248.initData(TypedData@1745dc5[type=QR, readOnly=false, autoFill=false, fetchTimestamp=0, values=[r_act_name=, r_act_def_id=, a_status=]])
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ....com.documentum.fc.client.DfTypedObject@b83248.initData ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ....com.documentum.fc.client.DfTypedObject@b83248.setObjectSession(com.documentum.fc.client.impl.session.StrongSessionHandle@18f57a7)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] .....com.documentum.fc.client.impl.session.SessionHandle@18f57a7.getDynamicHandle()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ......com.documentum.fc.client.impl.session.Session@1722ed5.getDynamicHandle()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] .......com.documentum.fc.client.impl.session.SessionHandle@ed3c51.<init>()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] .......com.documentum.fc.client.impl.session.SessionHandle@ed3c51.<init> ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] .......com.documentum.fc.client.impl.session.DynamicSessionHandle@ed3c51.<init>(com.documentum.fc.client.impl.session.Session@1722ed5)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ........com.documentum.fc.client.impl.session.Session@1722ed5.getSessionManager()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ........com.documentum.fc.client.impl.session.Session@1722ed5.getSessionManager ==> com.documentum.fc.client.IDfSessionManager@bfd4f6
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ........com.documentum.fc.client.impl.session.Session@1722ed5.getDocbaseName()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] .........com.documentum.fc.client.impl.session.Session@1722ed5.getDocbaseSpec()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] .........com.documentum.fc.client.impl.session.Session@1722ed5.getDocbaseSpec ==> DocbaseSpec{OCDDocs.OCDDocs@itsusral00221}
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ........com.documentum.fc.client.impl.session.Session@1722ed5.getDocbaseName ==> "OCDDocs"
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ........com.documentum.fc.client.impl.session.DynamicSessionHandle@ed3c51.setCurrentSession(com.documentum.fc.client.impl.session.Session@1722ed5)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] .........com.documentum.fc.client.impl.session.Session@1722ed5.getWeakHandle()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] .........com.documentum.fc.client.impl.session.Session@1722ed5.getWeakHandle ==> com.documentum.fc.client.impl.session.ISession@164b8cc
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ........com.documentum.fc.client.impl.session.DynamicSessionHandle@ed3c51.setCurrentSession ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] .......com.documentum.fc.client.impl.session.DynamicSessionHandle@ed3c51.<init> ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ......com.documentum.fc.client.impl.session.Session@1722ed5.getDynamicHandle ==> com.documentum.fc.client.impl.session.ISession@ed3c51
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] .....com.documentum.fc.client.impl.session.SessionHandle@18f57a7.getDynamicHandle ==> com.documentum.fc.client.impl.session.ISession@ed3c51
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ....com.documentum.fc.client.DfTypedObject@b83248.setObjectSession ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ....com.documentum.fc.client.DfTypedObject@b83248.setOriginalSession(com.documentum.fc.client.impl.session.StrongSessionHandle@18f57a7)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] .....com.documentum.fc.client.impl.session.SessionHandle@18f57a7.getDynamicHandle()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ......com.documentum.fc.client.impl.session.Session@1722ed5.getDynamicHandle()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ......com.documentum.fc.client.impl.session.Session@1722ed5.getDynamicHandle ==> com.documentum.fc.client.impl.session.ISession@ed3c51
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] .....com.documentum.fc.client.impl.session.SessionHandle@18f57a7.getDynamicHandle ==> com.documentum.fc.client.impl.session.ISession@ed3c51
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ....com.documentum.fc.client.DfTypedObject@b83248.setOriginalSession ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ...com.documentum.fc.client.DfTypedObject@b83248.<init> ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ...com.documentum.fc.client.impl.collection.TypedDataCollection@b83248.<init>(com.documentum.fc.client.impl.connection.docbase.DocbaseConnection$IteratorSynchronizer@82cd4c,com.documentum.fc.client.impl.session.StrongSessionHandle@18f57a7)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ...com.documentum.fc.client.impl.collection.TypedDataCollection@b83248.<init> ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ...com.documentum.fc.client.impl.collection.CollectionHandle@1131359.<init>(com.documentum.fc.client.impl.collection.TypedDataCollection@b83248)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ...com.documentum.fc.client.impl.collection.CollectionHandle@1131359.<init> ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ...com.documentum.fc.client.impl.session.SessionHandle@18f57a7.setLastCollection(com.documentum.fc.client.impl.collection.CollectionHandle@1131359)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ....com.documentum.fc.client.impl.session.Session@1722ed5.setLastCollection(com.documentum.fc.client.impl.collection.CollectionHandle@1131359)
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ....com.documentum.fc.client.impl.session.Session@1722ed5.setLastCollection ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ...com.documentum.fc.client.impl.session.SessionHandle@18f57a7.setLastCollection ==> <void>
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ..com.documentum.fc.client.impl.collection.TypedDataCollection.newInstance ==> com.documentum.fc.client.IDfCollection@1131359
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] .com.documentum.fc.client.DfQuery@1170077.runQuery ==> com.documentum.fc.client.IDfCollection@1131359
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] com.documentum.fc.client.DfQuery@1170077.execute ==> com.documentum.fc.client.IDfCollection@1131359
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] com.documentum.fc.client.impl.collection.CollectionHandle@1131359.next()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] .com.documentum.fc.client.impl.collection.TypedDataCollection@b83248.next()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] .com.documentum.fc.client.impl.collection.TypedDataCollection@b83248.next ==> false
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] com.documentum.fc.client.impl.collection.CollectionHandle@1131359.next ==> false
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] com.documentum.fc.client.impl.session.SessionHandle@18f57a7.getObject(DfId{0000000000000000})
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] .com.documentum.fc.client.impl.session.Session@1722ed5.getObject(DfId{0000000000000000})
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ..com.documentum.fc.client.DfGetObjectOptions@15b3baf.<init>()
2013-12-20 10:30:13.557 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ..com.documentum.fc.client.DfGetObjectOptions@15b3baf.<init> ==> <void>
2013-12-20 10:30:13.573 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ..com.documentum.fc.client.impl.session.Session@1722ed5.getObjectManager(DfId{0000000000000000})
2013-12-20 10:30:13.573 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ...com.documentum.fc.common.DfUtil.formatString("Bad ID given: {0}",java.lang.Object[1]@ab9a5a)
2013-12-20 10:30:13.573 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [EXIT] ...com.documentum.fc.common.DfUtil.formatString ==> "Bad ID given: 0000000000000000"
2013-12-20 10:30:13.573 <ocdsscm|s2(18.1)|SM@12571894> [Timer-23] [ENTER] ...com.documentum.fc.common.impl.ExceptionCompatability.mapMessageIdToErrorCode("DM_API_E_BADID")