How to bulk export [around 4K documents] in to external system from Docbase

Hello Everyone,

I am trying to export few [3K] documents to my local system, so I am using getfile API command to do the same, but below are my challenges, so can you please help me on resolving below issues. Thanks.

Document is exporting, however the same document name should be copy to local system. Document names are dynaminc, so we can't hard code.
I want complete document, not for single pages, since getfile command is expecting parameter as page number.
Same file format should be copy to local system, I tried with parameter as PDF, but it’s throwing below error.

DM_SYSOBJECT_E_CANT_READ_CONTENT]error: "Cannot access content for (re_loc_non_reviewable_doc_0902341380043ab7) sysobject"

[DM_SYSOBJECT_E_CANT_GET_CONTENT]error: "Cannot get pdf; format for 0 content of re_loc_non_reviewable_doc_0902341380043ab7 sysobject."

[DM_XFRM_E_NO_FMT_AVAIL]error: "Unable to find a rendition for re_loc_non_reviewable_doc_0902341380043ab7 with format pdf; on page 0"

Help would greatly appreciate.

Best Regards,

Jeenath Reddy.

Find more posts tagged with

Comments

Haroon_A

Are you using API for that? I'd suggest write a small DFC program, using IDfExportOperation.

DCTM_Guru

Please post your api code.

jeenathreddy.gade

Thanks Johnny & Ahmad for response.

@Ahmad, Yup, I am using API, since I don’t have Documentum IDE setup on my laptop. This is ad hoc requirement, so I have to provide the solution asap.

@Johnny, I tried multiple options, but no luck.

API> getfile,c,0902341380044359, C:\JeenathReddy\RECM\Dump\re_loc_reviewable_doc_0902341380044359.pdf, pdf;

...

[DM_SYSOBJECT_E_CANT_READ_CONTENT]error: "Cannot access content for (re_loc_reviewable_doc_0902341380044359) sysobject"

[DM_SYSOBJECT_E_CANT_GET_CONTENT]error: "Cannot get pdf; format for 0 content of re_loc_reviewable_doc_0902341380044359 sysobject."

[DM_XFRM_E_NO_FMT_AVAIL]error: "Unable to find a rendition for re_loc_reviewable_doc_0902341380044359 with format pdf; on page 0"

API> getfile,c,0902341380044359, C:\JeenathReddy\RECM\Dump\re_loc_reviewable_doc_0902341380044359.pdf, NULL;

...

[DM_SYSOBJECT_E_CANT_READ_CONTENT]error: "Cannot access content for (re_loc_reviewable_doc_0902341380044359) sysobject"

[DM_SYSOBJECT_E_CANT_GET_CONTENT]error: "Cannot get NULL; format for 0 content of re_loc_reviewable_doc_0902341380044359 sysobject."

[DM_XFRM_E_NO_FMT_AVAIL]error: "Unable to find a rendition for re_loc_reviewable_doc_0902341380044359 with format NULL; on page 0"

API> getfile,c,090234138004e980, C:\JeenathReddy\RECM\Dump\re_loc_reviewable_doc_090234138004e980.pdf;

...

C:\JeenathReddy\RECM\Dump\re_loc_reviewable_doc_090234138004e980.pdf;

This is working fine, however it’s asking the tool [S.W] to select while opening the file/document.

DCTM_Guru

What to are you using to run API? If you run this via IAPI on Content Server, you should be fine.

jeenathreddy.gade

@johnny-I am using Samson tool to execute IAPI commands and moreover I don’t have access to content server box.

jeenathreddy.gade

@Ahmad, Please do you have sample code using IDfExportOperation. If so, please past here. So that I can try this option.

DCTM_Guru

Maybe the select is a function of Samson (not API). Have you tried your api with Repoint?

Haroon_A

getfile API works fine with RepoInt

you can take a look at this thread (or simply do a search on IDfExportOperation) for the samples.

https://community.emc.com/message/149404

sanjeev6282

Hey Jeenath,

Best way to accomplish the task is to write a small DFC code.

Something like below should come handy for you:

The below code takes 2 arguments, so that it exports the file and place it in the same folder hierarchy as it is in the repository.

Hope this helps:

public void ExportData(String ObjId, String objPath)

{

// String destDir="";

try

{

IDfClientX clientx = new DfClientX();

IDfSysObject sysObj = (IDfSysObject) sess.getObject(new DfId(ObjId));

if( sysObj == null )

{

System.out.println("Object " + ObjId + " not found.");

return;

}

else

{

System.out.println("Object " + ObjId + " has been found.");

}

try

{

IDfExportOperation operation = clientx.getExportOperation();

if(new File(destDir+ objPath).exists())

{

//do nothing

}

else

{

new File(destDir+ objPath).mkdirs();

}

operation.setDestinationDirectory(destDir+ objPath);

System.out.println("destDir name is " + destDir+ objPath);

IDfExportNode node = (IDfExportNode)operation.add( sysObj );

operation.execute();

fileCnt=fileCnt+1;

System.out.println( "exported file: " + node.getObjectId().toString());

DfLogger.info(ExportDRMObj.class, "Exported File: {0}", new String[] {node.getObjectId().toString()},null);

}

catch(DfException dfe)

{

DfLogger.debug(ExtractDRMData.class, "Exception Encountered Document Export Operation: ", null, dfe);

System.out.println("Exception encountered during Document export: "+dfe);

}

catch(DfException dfe)

{

}

jeenathreddy.gade

@Johnny-No, I am having issues with Repoint and I am not able to use Repoint, since it’s throwing "No DocBrokers are configured" error. I have dmcl.ini & dmcl.dll files on C:\Windows folder.

[FYI…..I don’t have any DCTM software on my laptop and I don’t have admin rights on my laptop. Even I posted separate thread for this issue, but no one responded.]

DCTM_Guru

Repoint uses dfc.properties to connect to appropriate CS. What version of CS are you using?

jeenathreddy.gade

We are using 6.5 [CS] version. Where and how dfc.properties file should be configured in client machine for repoint?

DCTM_Guru

6.5 does not use dmcl.ini, which explains why your changes is not taking affect. Should be in c:\Documentum\config.

jeenathreddy.gade

I have dfc.propertes file, but where should I keep that file in my local system, since I don’t have any installed DCTM software’s on my local system? Thanks.

DCTM_Guru

Search the forums on how to package DFC with your application. You will need dfc.jar at the very least as well as dfc.properties.

ArunSelvaraj

Hi Jeenath,

Put dfc.properties file inside the Config folder of Repoint Root Folder

For Eg:

\Softwares\Repoint\Config\dfc.properties

--Arun

ArunSelvaraj

Hi Jeenath

The following method would be helpful for you

Call the following method by passing idf session,export location,doc id's separated by commas

public void extractDocument(IDfSession session,String exportLoc,String objid) {                    String listOfId[] = objid.split(",");                    System.out.println("\nNumber of documents to be exported = "                                        + listOfId.length);                    int exp = 0;                    int expF = 0;                    try {                    IDfClientX clientx = new DfClientX();                    IDfExportOperation exportOperation = clientx.getExportOperation();                    exportOperation.setDestinationDirectory(exportLoc);                    IDfExportNode node = null;                                for (int i = 0; i < listOfId.length; i++) {                                        System.out.println("\nId = " + listOfId[i]);                                        IDfId id = new DfId(listOfId[i]);                                        IDfSysObject exportObject = (IDfSysObject) session.getObjectByQualification("dm_sysobject where r_object_id='"+id.getId()+"'");                                        if (exportObject != null) {                                                  System.out.println("Name = " + exportObject.getObjectName());                                                  exportObject.setObjectName(id.getId()+"_"+exportObject.getObjectName());                                                   node= (IDfExportNode) exportOperation.add(exportObject);                                                  //System.out.println("Format = "+ exportObject.getString("a_content_type"));                                                  node.setFormat(exportObject.getString("a_content_type"));                                                  // System.out.println("Node object : "+node.getObjectId());                                                  if (!exportOperation.execute()) {                                                              expF++;                                                            System.out.println("Export Operation failed! for Doc Id ='"+id+"' \n");                                                  } else {                                                            exp++;                                                            System.out.println("'"+id+ "' Exported in "+exportLoc);                                                  }                                        }else{                                                  expF++;                                                  System.out.println("Could not found Document in Docbase! for Doc Id ='"+id+"' \n");                                        }                              }                    } catch (DfException dfe) {                              dfe.printStackTrace();                    }                    System.out.println("Total Files Exported                    :" + exp);                    System.out.println("Total Files Not Exported          :" + expF);          }

-Arun

jeenathreddy.gade

Hello Arun,

I copied dfc.properties file to configuration folder under repoint root folder, however still it’s throwing same error. Do I need to setup any config files and what are the pre-requisites for standalone repoint [without eclipse]?

Please help me on this issue. Thanks.

aflowers001

dfc.properties, and DFC itself, are actually embedded within the RePoint jar file. there is a menu option in repoint to update with dfc.properties etc.

this is via the menu RePoint->Update DFC Configuration

Once this is done Repoint will know of your dfc.properties and your DFC classes

vincentklock

Samson is very quick and straightforward to do this, however as it is quite "old fashioned" you have to take extra-care writing your API script:

the management of FS path with spaces is poor and may lead to strange results. To avoid any surprise use very simple filesystem path (like "C:\Temp\export")
there is no trailing character in the API scripts. I think it applies to server-side iapi scripts, too
your API must be properly formatted, i.e. with no additional spaces or whatever. From your example you better write:

Jeenath Reddy a écrit:API> getfile,c,0902341380044359,C:\JeenathReddy\RECM\Dump\re_loc_reviewable_doc_0902341380044359.pdf,pdf...(removed the white spaces)

some of your formats are strange (e.g. 'NULL'), you shall make sure in your script that the format exists and that the content is available for your document

With that in mind you don't have to bother with dfc.properties, dfc code, repoint or any "heavy" tool.

Aarvi

Hi Johnny,

I am also exporting the document using DFC. I have a utility e which exports the documents to the Local FS.

Its working pretty good. But since the Export Operation has a limitation that only one object types at a time can be exported. So here is a problem coz when I try to export the document of custom object type, exportOprtation.execute() returns false. And the document is not exported. Can you help me how can I fix this.

shree.thota

Copy ur dfc.properties file in c:/Documentum/config repoint will take from here and display docbases

msroth

I wrote a fairly versatile exporter a little while ago that might address your situation. You can find it here http://msroth.wordpress.com/2013/05/28/documentum-bulk-export-tool/ if you are interested.