Deployments failing.

We have been having problems recently with deployments failing. There's no rhyme or reason. We deploy across 4 server and all have to complete to be successful. We tried turning off the transactions and it still failed. Eventually the deployment worked. We have had deployments of one file fail as well as large ones. All 4 servers have failed at one point or another. Sometimes its one server that fails or as many as 3 with any single deployment attempt.

We are on the latest versions of the software.

Here's the log file entry from one of the failures:

ENG: 2005-06-22 16:47:22 CDT GMT-05:00 Value of fIsOdddLeg is false
ENG: 2005-06-22 16:47:22 CDT GMT-05:00 Value of odddFlag is false
LIB: 2005-06-22 16:47:22 ERROR: Could not send phase start message.
LIB: 2005-06-22 16:47:22 Receiver-ERROR: E.
LIB: 2005-06-22 16:47:22 ERROR: Failed to deploy local_directory[.] of area[Y:\default\main\internet_asp_branch\capitalmarkets_site\EDITION\061605-1143]
LIB: 2005-06-22 16:47:22 ERROR: Failed 1 of 1 local_directories
ENG: 2005-06-22 16:47:22 CDT GMT-05:00 Thread-94 After COMMIT, res=-1
ENG: 2005-06-22 16:47:22 CDT GMT-05:00 Thread-94 exiting commit
ENG: 2005-06-22 16:47:22 CDT GMT-05:00 Thread-94 entering awaiting-rollback
ENG: 2005-06-22 16:47:27 CDT GMT-05:00 Thread-94 still waiting for 3
ENG: 2005-06-22 16:47:27 CDT GMT-05:00 Result after commit -1
ENG: 2005-06-22 16:47:27 CDT GMT-05:00 Thread-94 exiting awaiting-rollback
ENG: 2005-06-22 16:47:27 CDT GMT-05:00 Thread-94 entering rollback
LIB: 2005-06-22 16:47:27 ERROR: Could not send phase start message.
LIB: 2005-06-22 16:47:28 Receiver-ERROR: E.
LIB: 2005-06-22 16:47:28 ERROR: Failed to deploy local_directory[.] of area[Y:\default\main\internet_asp_branch\capitalmarkets_site\EDITION\061605-1143]
LIB: 2005-06-22 16:47:28 ERROR: Failed 1 of 1 local_directories
ENG: 2005-06-22 16:47:28 CDT GMT-05:00 Thread-94 After ROLLBACK, res=-1
ENG: 2005-06-22 16:47:28 CDT GMT-05:00 Thread-94 exiting rollback
ENG: 2005-06-22 16:47:28 CDT GMT-05:00 Thread-94 entering awaiting-cleanup
ENG: 2005-06-22 16:47:29 CDT GMT-05:00 Thread-94 still waiting for 3
ENG: 2005-06-22 16:47:29 CDT GMT-05:00 Thread-94 exiting awaiting-cleanup
ENG: 2005-06-22 16:47:29 CDT GMT-05:00 Thread-94 entering cleanup

Any idea what I should be looking into?

Thx

Edited by tgerber on 06/23/05 05:55 AM (server time).

Find more posts tagged with

Comments

Migrateduser

The line LIB: 2005-06-22 16:47:22 Receiver-ERROR: E. looks strange to me because of the bolded part. Many times it spits out garbage after ERROR: (nice and informative logging, eh?) but I haven't seen "ERROR: E" before. I wonder if it was trying to spit out the word ERROR right after ERROR:, which is commonly how slightly more intelligible error messages start.

What about your receiver logs? Are they showing anything strange or even anything at all? I wonder if it can't send the phase start message because of network conditions in your environment?

Dave

Current Environments:
(1) TS 6.5 on W2K3
(2) TS 6.1 SP1 on W2K3
(3) Vignette V7 Portal on Solaris 9

tgerber

The receiver logs seem to indicate a communication issue.

Entry from one receiver:
LIB: (3) id=m14 2005-06-22 15:53:46 -- Processing file(d:\inetpub\wwwroot\firstnational\fnb\personal\cardproducts\creditcards\rewards\rewards_advantage_cat.pdf)
LIB: (3) id=m14 2005-06-22 15:53:46 file created[d:\inetpub\wwwroot\firstnational\fnb\personal\cardproducts\creditcards\rewards\rewards_advantage_cat.pdf.iwtmp]
LIB: 2005-06-22 15:55:25 ERROR: Failed transferring contents of (.\fnb\personal\cardproducts\creditcards\rewards\rewards_advantage_cat.pdf)
LIB: 2005-06-22 15:55:25 ERROR: Could not get file data(.\fnb\personal\cardproducts\creditcards\rewards\rewards_advantage_cat.pdf) from socket.
LIB: (3) id=m14 2005-06-22 15:55:25 directive[reason missing-in-dest]
LIB: (3) id=m14 2005-06-22 15:55:25 directive[get .\fnb\personal\cardproducts\creditcards\rewards\rewardsadvantage.swf]
LIB: 2005-06-22 15:55:25 ERROR: Could not read attr size from socket.LIB: 2005-06-22 15:55:25 ERROR: Failed attribute transfer for (.\fnb\personal\cardproducts\creditcards\rewards\rewardsadvantage.swf).
LIB: 2005-06-22 15:55:25 ERROR: Could not send "reason missing-in-dest FAILED" to socket.
LIB: 2005-06-22 15:55:25 ERROR: Socket error - could not write deploy error message.
LIB: 2005-06-22 15:55:25 ERROR: DoCopying() failed, check target log.
LIB: 2005-06-22 15:55:25 ERROR: Failed deploying local_directory[0] () to ()
LIB: 2005-06-22 15:55:25 ERROR: Failed 1 of 1 local_directories
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 After PRECOMMIT res=-1
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 exiting dotask
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 entering awaiting-rollback
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 Got task failed in precommit
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 exiting awaiting-rollback
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 entering rollback
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 ROLLBACK is not applicable for non transactional deployment
LIB: id=m14 2005-06-22 15:55:25 FailedCommit 0.
LIB: 2005-06-22 15:55:25 ERROR: Could not read rollback start state.
LIB: 2005-06-22 15:55:25 ERROR: Unable to do hand shake with the sender
LIB: id=m14 2005-06-22 15:55:25
Directories deployed : 1 Files deployed : 44 Links deployed : 0
Directories failed : 0 Files failed : 2 Links failed : 0
Directories deleted : 0 Files deleted : 12 Links deleted : 0
LIB: 2005-06-22 15:55:25 Socket error sending 'log' directive
LIB: 2005-06-22 15:55:25 ERROR: Could not write rollback complete.
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 exiting rollback
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 entering awaiting-cleanup
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 exiting awaiting-cleanup
ENG: 2005-06-22 15:55:25 CDT GMT-05:00 Thread-73 entering cleanup
LIB: id=m14 2005-06-22 15:55:25 FailedCommit 0.
LIB: id=m14 2005-06-22 15:55:25 File Content transferred: 978043 bytes
LIB: 2005-06-22 15:55:25 ERROR: Could not write content size to client.
LIB: 2005-06-22 15:55:25 ERROR: Could not write status to client.

Same receiver earlier failure:
LIB: 2005-06-22 15:47:10 ERROR: Failed transferring contents of (.\fnb\personal\cardproducts\creditcards\rewards\rew_adv_cat.swf)
LIB: 2005-06-22 15:47:10 ERROR: Could not get file data(.\fnb\personal\cardproducts\creditcards\rewards\rew_adv_cat.swf) from socket.
LIB: 2005-06-22 15:47:10 ERROR: DoCopying() failed, check target log.
LIB: 2005-06-22 15:47:10 ERROR: Failed deploying local_directory[0] () to ()
LIB: 2005-06-22 15:47:10 ERROR: Failed 1 of 1 local_directories
ENG: 2005-06-22 15:47:10 CDT GMT-05:00 Thread-69 After PRECOMMIT res=-1
ENG: 2005-06-22 15:47:10 CDT GMT-05:00 Thread-69 exiting dotask
ENG: 2005-06-22 15:47:10 CDT GMT-05:00 Thread-69 entering awaiting-rollback
ENG: 2005-06-22 15:47:10 CDT GMT-05:00 Thread-69 Got task failed in precommit
ENG: 2005-06-22 15:47:10 CDT GMT-05:00 Thread-69 still waiting for 0
ENG: 2005-06-22 15:47:10 CDT GMT-05:00 Thread-69 exiting awaiting-rollback
ENG: 2005-06-22 15:47:10 CDT GMT-05:00 Thread-69 entering rollback
ENG: 2005-06-22 15:47:10 CDT GMT-05:00 Thread-69 failedCommit=false shouldWait=true
LIB: id=m12 2005-06-22 15:47:10 FailedCommit 0.
LIB: 2005-06-22 15:47:10 ERROR: Could not read rollback start state.
LIB: 2005-06-22 15:47:10 ERROR: Unable to do hand shake with the sender

Entry from another receiver:

LIB: 2005-06-22 15:57:23 ERROR: Failed transferring contents of (.\fnb\b_help\faq.inc)
LIB: 2005-06-22 15:57:23 ERROR: Could not get file data(.\fnb\b_help\faq.inc) from socket.
LIB: (3) id=m14 2005-06-22 15:57:23 directive[reason src-is-newer]
LIB: (3) id=m14 2005-06-22 15:57:23 directive[get .\fnb\business\images\articles_title.gif]
LIB: 2005-06-22 15:57:23 ERROR: Could not read attr size from socket.LIB: 2005-06-22 15:57:23 ERROR: Failed attribute transfer for (.\fnb\business\images\articles_title.gif).
LIB: 2005-06-22 15:57:23 ERROR: Could not send "reason missing-in-dest FAILED" to socket.
LIB: 2005-06-22 15:57:23 ERROR: Socket error - could not write deploy error message.
LIB: 2005-06-22 15:57:23 ERROR: DoCopying() failed, check target log.
LIB: 2005-06-22 15:57:23 ERROR: Failed deploying local_directory[0] () to ()
LIB: 2005-06-22 15:57:23 ERROR: Failed 1 of 1 local_directories
ENG: 2005-06-22 15:57:23 CDT GMT-05:00 Thread-43 After PRECOMMIT res=-1
ENG: 2005-06-22 15:57:23 CDT GMT-05:00 Thread-43 exiting dotask
ENG: 2005-06-22 15:57:23 CDT GMT-05:00 Thread-43 entering awaiting-rollback
ENG: 2005-06-22 15:57:23 CDT GMT-05:00 Thread-43 Got task failed in precommit
ENG: 2005-06-22 15:57:23 CDT GMT-05:00 Thread-43 exiting awaiting-rollback
ENG: 2005-06-22 15:57:23 CDT GMT-05:00 Thread-43 entering rollback
ENG: 2005-06-22 15:57:23 CDT GMT-05:00 Thread-43 ROLLBACK is not applicable for non transactional deployment
LIB: id=m14 2005-06-22 15:57:23 FailedCommit 0.
LIB: 2005-06-22 15:57:23 ERROR: Could not read rollback start state.
LIB: 2005-06-22 15:57:23 ERROR: Unable to do hand shake

Migrateduser

Hmm... I'll try to research something but in the meantime maybe you should call support about this one.

Dave

Current Environments:
(1) TS 6.5 on W2K3
(2) TS 6.1 SP1 on W2K3
(3) Vignette V7 Portal on Solaris 9

stefanmaier

Hi,
two possible reasons for a "DoCopying()" error which we have sometimes:
- there's not enough free space on your target disk
- you don't have write permissions in the target directory

An error like "socket error" I haven't seen before...

Regards
Stefan

tgerber

We have. We have a case open but I thought I'd post it here too in case anyone else has run into this issue before.

tgerber

I would believe those two errors but the publish worked eventually. Also which of the 4 servers would fail varied each time. Sometimes it was one server and others multiple would fail. 2 of the 4 servers failed predominately but not every time. Its very weird.

tgerber

We may have a fix. Here is supports reply:

This looks to be an IIS locking issue. Please look at the following KB and use svrTryCount and svrTryInterval as in the example. This info can be found in the admin guide page 184.

https://support.interwoven.com/kb/kb_show_article2.asp?ArticleID=1353
Random Files Fail to Deploy to Live IIS Server
Knowledge Base Article: 1353
Type: Tech Note

Author: Daniel Song
Synopsis
Deploying files to a live IIS server causes random files to fail.
Details

This is a known issue with IIS server as open files are locked for 60 seconds by default.
OpenDeploy 5.x
Add the following attributes to the transferRules element inthe configuration file:
• svrTryCount (Windows only) â€” enter the number of times OpenDeploy will attempt to deploy the file to the target host. This feature works in conjunction with Microsoft IIS, and is designed to accommodate times of heavy production server traffic.
• svrTryInterval (Windows only) â€” enter the amount of time in seconds OpenDeploy waits between deployment attempts. This feature works in conjunction with Microsoft IIS, and is designed to accommodate times of heavy production server traffic.
Example:
<definition name="IIS">
<source>
...
</source>
<target useReplicationFarm="MyIISFarm">
<transferRules svrTryCount="10" svrTryInterval="10"/>
</target>
</definition>
IIS Shutdown
Another workaround is to shut down the IIS server before deployment and restart it after successful deployment. This can be done with a DNR script.

Migrateduser

So has anyone found a solution to this problem, Iam having a similar problem and see this in the logs:

LIB: 2006-01-25 14:41:00 ERROR: Failed transferring contents of (./mike-test/afile.txt)
LIB: 2006-01-25 14:41:02 ERROR: Could not get file data(./mike-test/afile.txt) from socket.
LIB: 2006-01-25 14:41:02 ERROR: DoCopying() failed, check target log.
LIB: 2006-01-25 14:41:02 ERROR: Failed deploying local_directory[0] () to ()
LIB: 2006-01-25 14:41:02 ERROR: Failed 1 of 1 local_directories
ENG: 2006-01-25 14:41:02 EST GMT+11:00 Thread-13 After PRECOMMIT res=-1
ENG: 2006-01-25 14:41:02 EST GMT+11:00 Thread-13 exiting dotask
ENG: 2006-01-25 14:41:02 EST GMT+11:00 Thread-13 entering awaiting-rollback
ENG: 2006-01-25 14:41:02 EST GMT+11:00 Thread-13 Got task failed in precommit
ENG: 2006-01-25 14:41:02 EST GMT+11:00 Thread-13 still waiting for 0
ENG: 2006-01-25 14:41:02 EST GMT+11:00 Thread-13 exiting awaiting-rollback
ENG: 2006-01-25 14:41:02 EST GMT+11:00 Thread-13 entering rollback

Iam using Red Hat Enterprise Linux AS release 3 (Taroon Update 6)
and OD Version 6.0.1.0.0 Build 41860 Interwoven 20041018

Edited by Michael_Kovacs on 01/24/06 08:27 PM (server time).

iw_store

Hi,

Even i faced this problem, i had permission problem on receiver as said by steffen in this thread.

Sanjeev

Migrateduser

Yes, I took note of the permission, and disk space related points. Although, if the deployment of a single file fails say 3 out of 5 times, i dont see
either permissions nor disk space as a problem. As if it were, than the deployment would fail 100% of the time, no ? Any hints aprreciated.

rodigz

Have you figure out the caused of the deployment failure?
ERROR: Failed transferring contents
thanks!