Performance issues while checking in.

Hello,

We have a project where we are migrating the documents stored in a open source tool Contineo to Documentum (6.5). We have multiple versions (mostly 2 versions for each document) of a document and we are replicating the structure in documentum by first storing the oldest version of the document and then checking it out and then checking in the next version.

However I am observing that the checking in of a 5kb-10kb files it's taking close to 5 mins. However storing of a document and checking out is quite fast.

The code to checkin code is simple similar to

Code:

public static void doCheckin( String strPath, IDfSession session ) throws DfException {
IDfClientX clientx = new DfClientX();
IDfCheckinOperation operation = clientx.getCheckinOperation();
IDfSysObject sysObj = (IDfSysObject) session.getObjectByPath( strPath );
if( sysObj == null ) {
System.out.println("Object " + strPath + " can not be found.");
return;
}
if (sysObj.isCheckedOut() == false) {
System.out.println("Object " + strPath + " is not checked out.");
return;
}
IDfCheckinNode node;
if( sysObj.isVirtualDocument() ) {
IDfVirtualDocument vDoc = sysObj.asVirtualDocument( "CURRENT", false );
node = (IDfCheckinNode)operation.add(vDoc);
} else {
node = (IDfCheckinNode)operation.add(sysObj);
}
//Other options for setCheckinVersion: VERSION_NOT_SET, NEXT_MAJOR,
// NEXT_MINOR, BRANCH_VERSION
operation.setCheckinVersion(IDfCheckinOperation.SAME_VERSION);
//see sample: Operations- Execute and Check Errors
executeOperation( operation );
System.out.println("Old object id: " + node.getObjectId().toString() );
System.out.println("New object id: " + node.getNewObjectId().toString() );
}

The thread stack I am observing which is there for a long time is

Code:

Name: Migration Task - 3
State: RUNNABLE
Total blocked: 989  Total waited: 0

Stack trace: 
sun.nio.ch.SocketDispatcher.read0(Native Method)
sun.nio.ch.SocketDispatcher.read(Unknown Source)
sun.nio.ch.IOUtil.readIntoNativeBuffer(Unknown Source)
sun.nio.ch.IOUtil.read(Unknown Source)
sun.nio.ch.SocketChannelImpl.read(Unknown Source)
   - locked java.lang.Object@11ec8dd
com.documentum.fc.impl.util.io.MessageChannel.readSocket(MessageChannel.java:123)
com.documentum.fc.impl.util.io.MessageChannel.readLength(MessageChannel.java:100)
com.documentum.fc.impl.util.io.MessageChannel.getIncomingMessageLength(MessageChannel.java:92)
com.documentum.fc.impl.util.io.MessageChannel.read(MessageChannel.java:77)
   - locked com.documentum.fc.impl.util.io.MessageChannel@153d56
com.documentum.fc.client.impl.connection.netwise.AbstractNetwiseRpcClient.receiveMessage(AbstractNetwiseRpcClient.java:167)
com.documentum.fc.client.impl.connection.docbase.netwise.NetwiseDocbaseRpcClient.applyForCollection(NetwiseDocbaseRpcClient.java:369)
   - locked com.documentum.fc.client.impl.connection.docbase.netwise.NetwiseDocbaseRpcClient@6de053
com.documentum.fc.client.impl.connection.docbase.DocbaseConnection$3.evaluate(DocbaseConnection.java:1129)
   - locked com.documentum.fc.client.impl.connection.docbase.DocbaseConnection@3aa791
com.documentum.fc.client.impl.connection.docbase.DocbaseConnection.evaluateRpc(DocbaseConnection.java:1000)
   - locked com.documentum.fc.client.impl.connection.docbase.DocbaseConnection@3aa791
com.documentum.fc.client.impl.connection.docbase.DocbaseConnection.applyForCollection(DocbaseConnection.java:1117)
com.documentum.fc.client.impl.docbase.DocbaseApi.exec(DocbaseApi.java:82)
com.documentum.fc.client.impl.session.Session.query(Session.java:3247)
com.documentum.fc.client.DfQuery.runQuery(DfQuery.java:161)
com.documentum.fc.client.DfQuery.execute(DfQuery.java:205)
com.documentum.fc.client.impl.objectmanager.PersistentObjectManager.getObjectsByQuery(PersistentObjectManager.java:143)
com.documentum.fc.client.impl.session.Session.getObjectsByQuery(Session.java:1115)
com.documentum.fc.client.impl.session.SessionHandle.getObjectsByQuery(SessionHandle.java:800)
com.documentum.operations.impl.config.ConfigManager.getLastModifiedTimeStamp(ConfigManager.java:404)
com.documentum.operations.impl.config.ConfigManager.getConfigService(ConfigManager.java:502)
com.documentum.operations.impl.config.ConfigManager.lookupOperation(ConfigManager.java:105)
com.documentum.operations.DfOperation.getDefinition(DfOperation.java:84)
com.documentum.operations.impl.OperationNodeTreeBuilder.populate(OperationNodeTreeBuilder.java:574)
com.documentum.operations.impl.OperationNodeTreeBuilder.add(OperationNodeTreeBuilder.java:65)
com.documentum.operations.DfOperation.add(DfOperation.java:257)
com.arisglobal.docmig.dms.documentum.DocumentumServiceImpl.checkinDocument(DocumentumServiceImpl.java:438)
com.arisglobal.docmig.util.DocumentumHelper.storeAllDocumentVersions(DocumentumHelper.java:32)
com.arisglobal.docmig.ContineoToDocumentumMigrationHelper.migrateDocs(ContineoToDocumentumMigrationHelper.java:81)
com.arisglobal.docmig.ContineoToDocumentumMigrationHelper.migrateNewRI(ContineoToDocumentumMigrationHelper.java:64)
com.arisglobal.docmig.MigrationTask.migrateNewRI(MigrationTask.java:84)
com.arisglobal.docmig.MigrationTask.migrate(MigrationTask.java:60)
com.arisglobal.docmig.MigrationTask.run(MigrationTask.java:31)
java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
java.util.concurrent.FutureTask.run(Unknown Source)
org.springframework.core.task.SimpleAsyncTaskExecutor$ConcurrencyThrottlingRunnable.run(SimpleAsyncTaskExecutor.java:229)
java.lang.Thread.run(Unknown Source)

Please pass on any pointers you may have and I would appreciate any help in this regard.

Thanks,
Shashi

Find more posts tagged with

Note:

If there are Accepted Answers, those will be shown by default. You can switch to 'All Replies' by selecting the tab below.

Accepted answers

DCTM_Guru

Are you using this checkin operation to check in one document at a time? If so, there is some overhead of using this operation for checking in single file. You can use the old checkinEx() method of the object if you are checking out/checking in one document at a time.

All comments

DCTM_Guru

Are you running this as server method or via DFC app? Also, does this occur with just a couple of documents? Or does the process slow down over time as you checkin more and more documents?

XdctmX

Where is the documents stored? In a local PC or in the server itself?

Shashikant.Kale

Hi Johnny,

Are you running this as server method or via DFC app?

I am using DFC API for checkin in the document. I observe that the following line of code takes the whole time of 2-5 mins for execution.

IDfCheckinNode node = (IDfCheckinNode) checkinOperation.add(checkinObject);

Also, does this occur with just a couple of documents?  Or does the  process slow down over time as you checkin more and more documents?

I have observed that this is not consistent. I observe as I start the migration the time taken is close to 5 mins. It continues to remain the same. After some time I also observed that this reduces to 2 mins and again it increases to 5 mins. Hence not able to determine the pattern of this issue. However I have found that using the desktop client installed on a remote machine I am able to checkin faster. I feel there is something going wrong while using DFC APIs for checkin.

Please let me know of any pointers I should work towards.

Thanks,
Shashi

Shashikant.Kale

Hi Rijo,

The documents are stored in the server where documentum is installed. We are using Oracle database as backend database for the documentum. However even before saving the document I am seeing the call is stuck at following line for close to 2-5 mins.

IDfCheckinNode node = (IDfCheckinNode) checkinOperation.add(checkinObject);

Please pass any pointers you may have.

Regards,

Shashi

DCTM_Guru

Shashikant.Kale

Thanks Johnny!

Are you using this checkin operation to check in one document at a time?

Yes, I am using checkin operation to checkin one document at a time. Is there a way I can check in multiple versions at a time? Moreover since this a document migration project, I have thousands of documents with almost 2 versions of each one of them to be checked in. Do you feel I can do it in a better way? Currently I have multiple threads and each one of them takes a document along with all it's versions, stores the base version and then checks out and then checks in the next version.

So I have close to 20 threads

Each Thread ->

Takes a document and all it's versions -> Saves base version in documentum -> check out document -> check in next version -> check out document-----------------------> check in next version

You can use the old checkinEx() method of the object if you are checking out/checking in one document at a time.

I will try this and write back about the results.

Thanks much for your help,

Shashi

Shashikant.Kale

Hi Johnny,

Trying out checkinEx method has solved the issue. Thanks much for your help. Truely appriciate.

Regards,

Shashi