Error while creating folders from Oscript

Hi,

I have a requirement to create folders in CS 16.2, I have to create around 900 folders and each folder contains around 40 subfolders at different levels.

I am using LLNode.NodeCreate(<node>, <parent>) to create each folder in my RequestHandler.

When I run this request handler, folder creation starting and able to create some folders but after some time its giving error saying "Could not create new Folder."

When I re run the request handler it is able to creat some more folders and then getting the same error. Every time I am getting this error intermittently.

I am running request handler as "Admin" user and the parent folder has all required permissions.

Any thoughts?

Thanks,

Anjaneyulu M.

Find more posts tagged with

Comments

David Templeton

can you post the connect log

From: eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com>
Sent: Friday, August 4, 2017 12:09:59 PM
To: eLink Recipient
Subject: Error while creating folders from Oscript

Error while creating folders from Oscript

Posted by Moglicherla, Anjaneyulu On 08/04/2017 12:04 PM

Hi,I have a requirement to create folders in CS 16.2, I have to create around 900 folders and each folder contains around 40 subfolders at different levels. I am using LLNode.NodeCreate(<node>, <parent>) to create each folder in my RequestHandler.When I run this request handler, folder creation starting and able to create some folders but after some time its giving error saying "Could not create new Folder."When I re run the request handler it is able to creat some more folders and then getting the same error. Every time I am getting this error intermittently.I am running request handler as "Admin" user and the parent folder has all required permissions.Any thoughts?Thanks,Anjaneyulu M.

[To post a comment, use the normal reply function]
Forum:	Content Server Development Forum
Content Server:	Knowledge Center CS16

Anjaneyulu_Moglicherla

Hi,

When I debug the LLIAPI.NodeCreate is getting status error as "Could not create path" from DAPI.CreateNode.

Attached the connect logs.

Thanks,

Anjaneyulu.

connect_logs.zip

David Templeton

Give this a try and see if it helps. I created a script to find the EWS, create a root folder and in there create N ( 250 in my test ) number of folders, then inside there M folders ( in my case 50 ) and then as a last test X documents ( in my case 10 ).

to run this script make sure there is a zerobyte file here

String fileName= "e:\\temp\\zero.txt"

or change the location :-)

David

From: eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com>
Sent: Saturday, August 5, 2017 9:49:27 AM
To: eLink Recipient
Subject: Re Error while creating folders from Oscript

Re Error while creating folders from Oscript

Posted by Moglicherla, Anjaneyulu On 08/05/2017 09:46 AM

Hi,When I debug the LLIAPI.NodeCreate is getting status error as "Could not create path" from DAPI.CreateNode. Attached the connect logs.Thanks,Anjaneyulu.

Attachment Links:

connect_logs.zip (192 KB)

[To post a comment, use the normal reply function]
Topic:	Error while creating folders from Oscript
Forum:	Content Server Development Forum
Content Server:	Knowledge Center CS16

GetFolderand10Kfiles.e

Anjaneyulu_Moglicherla

Hi David,

Thanks for the script, I have ran it on customer dev enviroment (On which issue is occuring). Seems issue persists with this script as well.

After running this script, only 98 first level folders got created and the number of second level folders are varying folder to folder. Some folders(out of 98) has complete 50 second level folders created and some has less than 50. Please find below console log which contains the actual error while creating a folder. Also note that the environment is upgraded from CS 10 to 16.2

15:29:27,959 INFO A<1,?,'apiError'='Could not create path.','errMsg'='Could not create a new Folder.','inheritNode'=?,'node'=U<DAPINode(-72)=000000002E4F6CB0 Name='Second Level Folder 39 - Tue Aug 08 15_29_27 2017' SubType=0 DataID=N ParentID=? >,'ok'=false>

15:29:27,999 INFO OTSAPLINK:InsideDbUpgrade=false

15:29:28,025 INFO Skipping business object type configuration Quality Notification because usage for list of associated business objects is switched off [otsapxecm-OtsaplinkRoot-AutoCreateBusinessReference:AutomaticBusinessReferences:OtsaplinkRoot]

15:29:28,042 INFO -72

15:29:28,064 INFO +++++++++++++++++++++++++++++++++++++++++++++++ New Parent: Second Level Folder 40 - Tue Aug 08 15_29_27 2017

15:29:28,064 INFO +++++++++++++++++++++++++++++++++++++++++++++++ DataID: 326423

15:29:28,064 INFO +++++++++++++++++++++++++++++++++++++++++++++++ time taken: 0

15:29:28,107 INFO OTSAPLINK:InsideDbUpgrade=false

15:29:28,133 INFO Skipping business object type configuration Quality Notification because usage for list of associated business objects is switched off [otsapxecm-OtsaplinkRoot-AutoCreateBusinessReference:AutomaticBusinessReferences:OtsaplinkRoot]

15:29:28,150 INFO -72

15:29:28,172 INFO +++++++++++++++++++++++++++++++++++++++++++++++ New Parent: Second Level Folder 41 - Tue Aug 08 15_29_28 2017

15:29:28,172 INFO +++++++++++++++++++++++++++++++++++++++++++++++ DataID: 326425

15:29:28,172 INFO +++++++++++++++++++++++++++++++++++++++++++++++ time taken: 0

John Simon

DT,

Thanks for posting. I was unaware of the SimpleLLNodeSubsystem, nice to learn something new! Added in CS16?

Cheers...

David Templeton

John,

nope, been there since cs10u12

David

From: eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com>
Sent: Tuesday, August 8, 2017 8:28:37 AM
To: eLink Recipient
Subject: Re Re Error while creating folders from Oscript 2

Re Re Error while creating folders from Oscript 2

Posted by Simon, John On 08/08/2017 08:23 AM

DT,Thanks for posting. I was unaware of the SimpleLLNodeSubsystem, nice to learn something new! Added in CS16?Cheers...

[To post a comment, use the normal reply function]
Topic:	Error while creating folders from Oscript
Forum:	Content Server Development Forum
Content Server:	Knowledge Center CS16

David Templeton

silly question, how long is the name being used for the object?

From: eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com>
Sent: Tuesday, August 8, 2017 6:32:18 AM
To: eLink Recipient
Subject: Re Re Error while creating folders from Oscript

Re Re Error while creating folders from Oscript

Posted by Moglicherla, Anjaneyulu On 08/08/2017 06:28 AM

Hi David,Thanks for the script, I have ran it on customer dev enviroment (On which issue is occuring). Seems issue persists with this script as well.After running this script, only 98 first level folders got created and the number of second level folders are varying folder to folder. Some folders(out of 98) has complete 50 second level folders created and some has less than 50. Please find below console log which contains the actual error while creating a folder. Also note that the environment is upgraded from CS 10 to 16.215:29:27,959 INFO A<1,?,'apiError'='Could not create path.','errMsg'='Could not create a new Folder.','inheritNode'=?,'node'=U<DAPINode(-72)=000000002E4F6CB0 Name='Second Level Folder 39 - Tue Aug 08 15_29_27 2017' SubType=0 DataID=N ParentID=? >,'ok'=false>

15:29:27,999 INFO OTSAPLINK:InsideDbUpgrade=false

15:29:28,042 INFO -72

15:29:28,064 INFO +++++++++++++++++++++++++++++++++++++++++++++++ New Parent:Second Level Folder 40 - Tue Aug 08 15_29_27 2017

15:29:28,064 INFO +++++++++++++++++++++++++++++++++++++++++++++++ DataID: 326423

15:29:28,064 INFO +++++++++++++++++++++++++++++++++++++++++++++++ time taken: 0

15:29:28,107 INFO OTSAPLINK:InsideDbUpgrade=false

15:29:28,150 INFO -72

15:29:28,172 INFO +++++++++++++++++++++++++++++++++++++++++++++++ New Parent:Second Level Folder 41 - Tue Aug 08 15_29_28 2017

15:29:28,172 INFO +++++++++++++++++++++++++++++++++++++++++++++++ DataID: 326425

15:29:28,172 INFO +++++++++++++++++++++++++++++++++++++++++++++++ time taken: 0

[To post a comment, use the normal reply function]
Topic:	Error while creating folders from Oscript
Forum:	Content Server Development Forum
Content Server:	Knowledge Center CS16

Anjaneyulu_Moglicherla

It's less than 250 characters David, sometimes I was facing issue in creating a folder named "Russia" as well.

FYI, I have run a web report which creates 2000 folders on the same instance, then also I got the same issue and skipped creating around 20 folders at the end. In transport case also got the same intermittently (Could not create new ****).

-Anjaneyulu

David Templeton

ok, the connect logs you sent earlier contained nothing, in fact except for one file they were 0 byte in length. Could you send along a new set based on this script?

From: eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com>
Sent: Tuesday, August 8, 2017 10:03:35 AM
To: eLink Recipient
Subject: Re Re Re Error while creating folders from Oscript

Re Re Re Error while creating folders from Oscript

Posted by Moglicherla, Anjaneyulu On 08/08/2017 09:57 AM

It's less than 250 characters David, sometimes I was facing issue in creating a folder named "Russia" as well.FYI, I have run a web report which creates 2000 folders on the same instance, then also I got the same issue and skipped creating around 20 folders at the end. In transport case also got the same intermittently (Could not create new ****).-Anjaneyulu

[To post a comment, use the normal reply function]
Topic:	Error while creating folders from Oscript
Forum:	Content Server Development Forum
Content Server:	Knowledge Center CS16

Anjaneyulu_Moglicherla

PFA connect log.

connectlog.zip

Appu Nair

Interesting I see this,

08/08/2017 15:14:26 INFO [18446744042532186341] 0001328871: KSqlCursor::Open(201f,'SELECT sp_CreateSimpleObject( :A1, :A2, :A3, :A4, :A5, :A6, :A7, :A8, :A9, :A10, :A11, :A12, :A13, :A14 ) FROM DUAL') -->'SUCCESS'

08/08/2017 15:14:26 INFO [18446744042532186369] 0001328872: KSqlCursor::Prepare() --> 'SUCCESS'

08/08/2017 15:14:26 INFO [18446744042532186419] 0001328873: KSqlCursor::Bind(14,{311196,-2000,0,'Second Level Folder 18 - Tue Aug 08 15_14_26 2017',311127,1000,'en',D/2017/8/8:15:14:26,1001,'en,pt_BR,es_AR',?,?,?,?}) --> 'SUCCESS'

08/08/2017 15:14:26 ERROR [18446744042532191025] 0001328874: Oracle error: (20001) --> ORA-20001: Error - rolling back: ORA-00926: missing VALUES keyword

ORA-06512: at "DCS.SP_CREATESIMPLEOBJECT", line 260

08/08/2017 15:14:26 ERROR [18446744042532191096] 0001328875: KSqlCursor::Execute({'SP_CREATESIMPLEOBJECT(:A1,:A2,:A3,:A4,:A5,:A6,:A7,:A8,:A9,:A10,:A11,:A12,:A13,:A14)'}) --> 'Could not execute cursor.'

08/08/2017 15:14:26 INFO [18446744042532191115] 0001328876: KSqlCursor::Close() --> 'SUCCESS'

08/08/2017 15:14:26 ERROR [18446744042532191167] 0001328877: KSql::Execute(...) --> 'Error executing an Sql statement.',0 records,[sec: 0 msec: 5]

08/08/2017 15:14:26 ERROR [18446744042532191209] 0001328878: KSql::EndTransaction('Error executing an Sql statement.',FALSE) --> 1

08/08/2017 15:14:26 INFO [18446744042532191244] 0001328879: KConnect::EndTransaction --> DiffStart[sec: 0 msec: 5], DiffLast[sec: 0 msec: 5]

None of that is conducive to rapid fire creation if you have the thread0.out it may shed more light.Again David will have the better answer.

do you know if this dataid got created?

Bind(14,{311196,-2000,0,'Second Level Folder 18 - Tue Aug 08 15_14_26 2017',311127,1000,'en',D/2017/8/8:15:14:26,1001,'en,pt_BR,es_AR',?,?,?,?})

that would probably tell if it was an ignorable or not thing.

there are 1284 same oracle errors are you short by 1284 objects using that script another way to look at it...

also the logs reveals an archive server but that would probably only affect versionable objects...

just a thought

Appu Nair
Principal Architect | Alitek

From: eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com>
Sent: Wednesday, August 9, 2017 2:20 AM
To: eLink Recipient
Subject: Re Re Re Re Error while creating folders from Oscript

[Attachments exceeded pre-set size limits. Use the links provided to access]

Re Re Re Re Error while creating folders from Oscript

Posted by Moglicherla, Anjaneyulu On 08/09/2017 03:18 AM

PFA connect log.

Attachment Links:

connectlog.zip (37 MB)

[To post a comment, use the normal reply function]
Topic:	Error while creating folders from Oscript
Forum:	Content Server Development Forum
Content Server:	Knowledge Center CS16

Confidentiality Note: This message contains information, which may be privileged or confidential, or exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee responsible for delivering the message to the intended recipient, you are hereby NOTIFIED that any dissemination, distribution, retention, archiving, or copying of this communication is strictly prohibited. If you receive this message in error, please notify sender immediately.

Anjaneyulu_Moglicherla

That folder(311196) was not created Appu.

-Anjaneyulu

Anjaneyulu_Moglicherla

Hi guys,

Tha cause of this issue was due to wrong KID. Updating the KID with max dataid of DTreeCore, fixed this issue.

Thanks

appuGmail

Are you saying you had a corrupted condition of KID and advised by OT by a direct DB Update? or are you saying that large objects ingestion causes KID to go corrupt and you end up having to stop every now and then?

In an Oracle xECM instance capable of creating extreme large amounts even in 971 binaries I have not seen the node allocation going wrong perhaps our loading was not multi threaded.

I am not convinced that OT would want people playing with tables unless they actually blessed it

Some very infrequent times that OT has asked to do direct db updates

1)Child Count erroneous

2)missing providerdata, versiondata etc what you hear as DB5/DB6 procedures.

3)duplicate dataids cause unknown will break during upgrades

4)Poor cloning techniques resulting in corrupted admin server entries usually happen when new administrators clone systems without understanding the firewalling aspects.

5)People incorrectly not using API's blindly doing things(removing delete users from KUAF rather forcibly

and things of that nature mucking up LLAttrblobData, LLAttrdata etc.)

It would be good if David Templeton or Kyle Swidrowich or someone like you guys, could say what was the reason for the KID update in this case...

..... appnair appunair( Livelink Rocks )

Well, if I called the wrongnumber, why did you answer the phone?
James Thurber, New Yorker cartoon caption, June 5, 1937

On Tue, Aug 22, 2017 at 7:52 AM, eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com> wrote:

Re Re Re Error while creating folders from Oscript 2 Posted byMoglicherla, AnjaneyuluOn 08/22/2017 08:44 AM

Hi guys,Tha cause of this issue was due to wrong KID. Updating the KID with max dataid of DTreeCore, fixed this issue.Thanks
[To post a comment, use the normal reply function]
Topic: Error while creating folders from Oscript
Forum: Content Server Development Forum
Content Server: Knowledge Center CS16

Patrick Pidduck

This won’t solve the problem, but I can’t help making an observation. We do try and identify and address these problems where we can, using this type of input to make Content Server better. For instance, numbers 1, 3 and 4 on this list: the latest versions of Content Server have built in utilities to fix invalid Child Counts and help to deal with duplicate data ids, and prevents badly cloned admin servers from interfering with other systems.

Patrick

From: eLink Entry: Content Server Development Forum [mailto:development@elinkkc.opentext.com]
Sent: Wednesday, August 23, 2017 6:40 PM
To: eLink Recipient <devnull@elinkkc.opentext.com>
Subject: [EXTERNAL] - Re Re Re Re Error while creating folders from Oscript 2

[EXTERNAL] - Re Re Re Re Error while creating folders from Oscript 2

Posted by Nair, Krishnankutty On 08/23/2017 06:39 PM

In an Oracle xECM instance capable of creating extreme large amounts even in 971 binaries I have not seen the node allocation going wrong perhaps our loading was not multi threaded.

I am not convinced that OT would want people playing with tables unless they actually blessed it

Some very infrequent times that OT has asked to do direct db updates

1)Child Count erroneous

2)missing providerdata, versiondata etc what you hear as DB5/DB6 procedures.

3)duplicate dataids cause unknown will break during upgrades

4)Poor cloning techniques resulting in corrupted admin server entries usually happen when new administrators clone systems without understanding the firewalling aspects.

5)People incorrectly not using API's blindly doing things(removing delete users from KUAF rather forcibly and things of that nature mucking up LLAttrblobData, LLAttrdata etc.)

It would be good if David Templeton or Kyle Swidrowich or someone like you guys, could say what was the reason for the KID update in this case...

..... appnair appunair( Livelink Rocks )

Well, if I called the wrong number, why did you answer the phone?
James Thurber, New Yorker cartoon caption, June 5, 1937

On Tue, Aug 22, 2017 at 7:52 AM, eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com> wrote:

Re Re Re Error while creating folders from Oscript 2

Posted by Moglicherla, Anjaneyulu On 08/22/2017 08:44 AM

Hi guys,
Tha cause of this issue was due to wrong KID. Updating the KID with max dataid of DTreeCore, fixed this issue.
Thanks

[To post a comment, use the normal reply function]
Topic:
Error while creating folders from Oscript
Forum:
Content Server Development Forum
Content Server:
Knowledge Center CS16

[To post a comment, use the normal reply function]
Topic:	Error while creating folders from Oscript
Forum:	Content Server Development Forum
Content Server:	Knowledge Center CS16

David Templeton

Appu et al

Child Count erroneous
missing providerdata, versiondata etc what you hear as DB5/DB6 procedures.
duplicate dataids cause unknown will break during upgrades
Poor cloning techniques resulting in corrupted admin server entries usually happen when new administrators clone systems without understanding the firewalling aspects.
People incorrectly not using API's blindly doing things(removing delete users from KUAF rather forcibly and things of that nature mucking up LLAttrblobData, LLAttrdata etc.

As Patrick pointed out 1, 3 & 4 have now repair tools. But what is interesting is how some of these come about

Some code adds/removes children to a container and turns off the parent count update but doesn't call out to correct it is usually the case I have seen
dunno, bad transactional handling?!?!?!?
CS would issue id's to threads and there was behaviour where an operation would rollback the ids and another thread would be given the same set of id's. But yes as Patrick highlight there are some instances still lingering. And the original issue was fixed
ok :-) and a tool now
This one personally drives me nuts :-) Code that goes against the schema directly assuming some kind of magical contract of the state and behaviour then complain when we need to make changes for some reason. To make it about as official as it gets, we will change schema, we will provide an upgrade path to the new schema. If there is an API we will endevour to not break that contract, we can enhance and extend. If we feel a certain API call is to be depricated then it will provide an echo statement in the thread log that will hopefully provides guidance. If there is no public API, then it is not intended to be accessed from the business logic. I recall a solution accessing/updating the KIni directly and wondered why the values were not being used correctly. The best one is the adding of indexes to LLAttrData.... yeap, no chance of anything going wrong there <sarcasm>.

David

appuGmail

@DT thanks a lot the original poster closed the solution saying KID had to be tampered with ? why? any reasons....

I was merely saying that many things happen in livelink not entirely due to bad code,sometimes foolish approaches

by people.Although one cannot say that programmers don't make mistakes.

It is OK if the case has been resolved as a special case,I just didn't want somebody reading the forum

to think that at the drop of a har update Kid...

1 I have seen I think it was the volume concept that gets everyone,like the old recycle bin owner what not and then all **** breaks lose on permissions etc when you restore.Perhaps the new implementation is better the soft delete doesn't physically move.
2 Is that because there isn't a way to check the file integrity after a upload because it may cause the user or process to wait that much longer?
5 Now that you guys bought Documentum ask their DQL engine what it does not sure if it is similar to WR but more like a validated SQL that does not ruin the ref integrity.Not sure but I think it may have been easier in the DCTM world as it is very OOPish..

BTW I don't know a lot of things you guys talk about but just trying to be a fly in the wall.Keep the good info coming.

..... appnair appunair( Livelink Rocks )

Well, if I called the wrongnumber, why did you answer the phone?
James Thurber, New Yorker cartoon caption, June 5, 1937

On Thu, Aug 24, 2017 at 1:33 PM, eLink Entry: Content Server Development Forum <development@elinkkc.opentext.com> wrote:

RE [EXTERNAL] - Re Re Re Re Error while creating folders from Oscript 2 Posted byTempleton, DavidOn 08/24/2017 02:31 PM

Appu et al Child Count erroneous missing providerdata, versiondata etc what you hear as DB5/DB6 procedures. duplicate dataids cause unknown will break during upgrades Poor cloning techniques resulting in corrupted admin server entries usually happen when new administrators clone systems without understanding the firewalling aspects. People incorrectly not using API's blindly doing things(removing delete users from KUAF rather forcibly and things of that nature mucking up LLAttrblobData, LLAttrdata etc.As Patrick pointed out 1, 3 & 4 have now repair tools. But what is interesting is how some of these come about Some code adds/removes children to a container and turns off the parent count update but doesn't call out to correct it is usually the case I have seen dunno, bad transactional handling?!?!?!? CS would issue id's to threads and there was behaviour where an operation would rollback the ids and another thread would be given the same set of id's. But yes as Patrick highlight there are some instances still lingering. And the original issue was fixed ok :-) and a tool now This one personally drives me nuts :-) Code that goes against the schema directly assuming some kind of magical contract of the state and behaviour then complain when we need to make changes for some reason. To make it about as official as it gets, we will change schema, we will provide an upgrade path to the new schema. If there is an API we will endevour to not break that contract, we can enhance and extend. If we feel a certain API call is to be depricated then it will provide an echo statement in the thread log that will hopefully provides guidance. If there is no public API, then it is not intended to be accessed from the business logic. I recall a solution accessing/updating the KIni directly and wondered why the values were not being used correctly. The best one is the adding of indexes to LLAttrData.... yeap, no chance of anything going wrong there <sarcasm>. David
[To post a comment, use the normal reply function]
Topic: Error while creating folders from Oscript
Forum: Content Server Development Forum
Content Server: Knowledge Center CS16