nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Trasfering branches from one store to another?

dchristie

TS 6.0 Solaris

When creating a new store on the same box is there an easy way to transfer entire branches and their contents to the new store? Just was wondering if anyone might have experience with moving data between stores. Thanks.

Find more posts tagged with

Comments

Dwayne

RTFM on iwmigrate

--

Current project: TS 5.5.2/6.1 W2K

dchristie

I'm trying to get the iwmigrate to work, following the CLT manual here's the output for the failure we're getting:

Command line: ./iwmigrate -m /iwmnt/default -o /iwmnt/devStore -b /default/main/Admin
[Thu Aug 26 16:17:32 2004] No locale specified, using native locale for this system
[Thu Aug 26 16:17:32 2004] Converted backing store location is /iwmnt/devStore
[Thu Aug 26 16:17:32 2004] Configured backing store on system is /usr/Interwoven/iw-store
[Thu Aug 26 16:17:32 2004] Starting backing store environment
[Thu Aug 26 16:17:32 2004] Reading users and groups...
ERROR: no valid autoprivate file found in the current configuration (/usr/iw-home/conf/events/autoprv.txt, /usr/iw-home/local/config/autoprivate.cfg, /usr/iw-home/config/autoprivate.cfg, /usr/iw-home/local/config/autoprivate.cfg) (2)
[Thu Aug 26 16:17:32 2004] done. 49 users and 16 groups read.
[Thu Aug 26 16:17:32 2004] WARNING: global entity database not created
[Thu Aug 26 16:17:32 2004] New webserver_uid nobody (60001)
[Thu Aug 26 16:17:32 2004] New vannotate_uid iwui (10006)
[Thu Aug 26 16:17:32 2004] Cache size: 30000
Thu Aug 26 16:17:32 2004] TEnvironment: fd limit 1024 max 1024
[Thu Aug 26 16:17:32 2004] TEnvironment::ctor creating /iwmnt/devStore
[Thu Aug 26 16:17:32 2004] Error: could not create /iwmnt/devStore (error 13).
[Thu Aug 26 16:17:32 2004] TEnvironment::dtor found 0 dirty.
Failed to start store manager.
[Thu Aug 26 16:17:32 2004] Error initializing server environment.

Any ideas? Also, does iwmigrate simply place a copy of a store through it's process or does it move the store, thus removing the source store?

Thanks for the help.

Dwayne

You've got the command syntax slightly wrong.:

You're using this: iwmigrate -m /iwmnt/default -o /iwmnt/devStore -b /default/main/Admin

Try this instead: iwmigrate -m /iwmnt/default -o /usr/Interwoven/devStore -b /default/main/Admin
and you might want to add -b /usr/Interwoven/iw-store as well, to improve performance

The -o parameter specified where on the local filesystem the store should be created. You're trying to specify where it should eventually be mounted in the IFS.

does iwmigrate simply place a copy of a store through it's process or does it move the store, thus removing the source store?

It's strictly a copy operation. It leaves the source store unmodified. You'll probably want to delete the source branch once you've verified completely that the new store is good. And I'd still want to make sure I had a good backup of the old store first, anyway.

--

Current project: TS 5.5.2/6.1 W2K

Edited by Dwayne on 08/26/04 01:33 PM (server time).

dchristie

Hmmm, seems to be permissions errors.

Command line: ./iwmigrate -m /iwmnt/default -o /usr/Interwoven/devStore -b /usr/Interwoven/iw-store
[Thu Aug 26 16:43:10 2004] No locale specified, using native locale for this system
[Thu Aug 26 16:43:10 2004] Converted backing store location is /usr/Interwoven/devStore
[Thu Aug 26 16:43:10 2004] Configured backing store on system is /usr/Interwoven/iw-store
[Thu Aug 26 16:43:10 2004] Starting backing store environment
[Thu Aug 26 16:43:10 2004] Reading users and groups...
ERROR: no valid autoprivate file found in the current configuration (/usr/iw-home/conf/events/autoprv.txt, /usr/iw-home/local/config/autoprivate.cfg, /usr/iw-home/config/autoprivate.cfg, /usr/iw-home/local/config/autoprivate.cfg) (2)
[Thu Aug 26 16:43:10 2004] done. 49 users and 16 groups read.
[Thu Aug 26 16:43:10 2004] WARNING: global entity database not created
[Thu Aug 26 16:43:10 2004] New webserver_uid nobody (60001)
[Thu Aug 26 16:43:10 2004] New vannotate_uid iwui (10006)
[Thu Aug 26 16:43:10 2004] Cache size: 30000
[Thu Aug 26 16:43:11 2004] TEnvironment: fd limit 1024 max 1024
[Thu Aug 26 16:43:11 2004] TStorageHandle_ASCII[2]: couldn't open existing file /usr/Interwoven/devStore/VERSION (errno 13)for read-write
Permission denied
[Thu Aug 26 16:43:11 2004] ReadInteger: error reading begin of record.
[Thu Aug 26 16:43:11 2004] TStorageHandle_ASCII::GetErrorCount 1
[Thu Aug 26 16:43:11 2004] Error: cannot read version file /usr/Interwoven/devStore/VERSION.
[Thu Aug 26 16:43:11 2004] TEnvironment::dtor found 0 dirty.
Failed to start store manager.
[Thu Aug 26 16:43:11 2004] Error initializing server environment.

Dwayne

Yes, you certainly need to be running it as a user with sufficient access to write to the directory specified by the '-o' parameter.

You don't have to put the store into /usr/Interwoven/devStore. I just chose that because that's where your default store is located, which means that's also where the server will attempt to find it when you add it with iwstoreadm -a devStore, unless you've overriden the location in /etc/iw.cfg

--

Current project: TS 5.5.2/6.1 W2K

dchristie

Got it! Cool, thanks alot. I for some reason had to do each sub-branch individually, but that's no big deal. Thanks again.

dchristie

T.S 6.0 , Solaris

Hmmm, trying to use the iwmigrate tool again, and I just can't figure out why it's not working out. I'm trying to migrate one branch in my store "devStore" up to my "default" store on the same box. The process seems to run, and says it's a success, yet no data is making the transfer. Here's my output:

ken-inwdev01>./iwmigrate -m /iwmnt/devStore -o /usr/Interwoven/iw-store/default -b /devStore/main/ResortServices
iwmigrate: 6.0.0 Build 25262 Interwoven 20030919
Command line: ./iwmigrate -m /iwmnt/devStore -o /usr/Interwoven/iw-store/default -b /devStore/main/ResortServices
[Mon Oct 25 11:46:00 2004] No locale specified, using native locale for this system
[Mon Oct 25 11:46:00 2004] Converted backing store location is /usr/Interwoven/iw-store/default
[Mon Oct 25 11:46:00 2004] Configured backing store on system is /usr/Interwoven/iw-store
[Mon Oct 25 11:46:00 2004] Starting backing store environment
[Mon Oct 25 11:46:00 2004] Reading users and groups...
ERROR: no valid autoprivate file found in the current configuration (/usr/iw-home/conf/events/autoprv.txt, /usr/iw-home/local/config/autoprivate.cfg, /usr/iw-home/config/autoprivate.cfg, /usr/iw-home/local/config/autoprivate.cfg) (2)
[Mon Oct 25 11:46:00 2004] done. 49 users and 16 groups read.
[Mon Oct 25 11:46:00 2004] New webserver_uid nobody (60001)
[Mon Oct 25 11:46:00 2004] New vannotate_uid iwui (10006)
[Mon Oct 25 11:46:00 2004] Cache size: 30000
[Mon Oct 25 11:46:00 2004] TEnvironment: fd limit 1024 max 1024
[Mon Oct 25 11:46:02 2004] TFSEnvironment: inode cache 30000
[Mon Oct 25 11:46:02 2004] Batch Jobs Thread started
[Mon Oct 25 11:46:02 2004] Converting branch /devStore/main/ResortServices
[Mon Oct 25 11:46:02 2004] Begin replay branch /devStore/main/ResortServices from first edition (INITIAL.iwconvert) to most recent (07152004)
[Mon Oct 25 11:46:02 2004] TEnvironment::Flush flushed 0, unlinked 0
[Mon Oct 25 11:46:02 2004] Creating branches needed for /devStore/main/ResortServices
[Mon Oct 25 11:46:02 2004] Found branch /main/ResortServices in input backing store
[Mon Oct 25 11:46:02 2004] Branch /main/ResortServices is already present.
[Mon Oct 25 11:46:02 2004] Verifying chain of editions to be replayed.
[Mon Oct 25 11:46:02 2004] Check edition 0x00002010000000000000040e
[Mon Oct 25 11:46:02 2004] Found edition INITIAL.iwconvert 0x00002010000000000000040e in input backing store
[Mon Oct 25 11:46:02 2004] Edition INITIAL.iwconvert already exists in output backing store
[Mon Oct 25 11:46:02 2004] Skipping this edition.
[Mon Oct 25 11:46:02 2004] Check edition 0x000020100000000000000424
[Mon Oct 25 11:46:02 2004] Found edition INITIAL 0x000020100000000000000424 in input backing store
[Mon Oct 25 11:46:02 2004] Edition INITIAL already exists in output backing store
[Mon Oct 25 11:46:02 2004] Skipping this edition.
[Mon Oct 25 11:46:02 2004] Check edition 0x00002010000000000000042a
[Mon Oct 25 11:46:02 2004] Found edition 07122004 0x00002010000000000000042a in input backing store
[Mon Oct 25 11:46:02 2004] Edition 07122004 already exists in output backing store
[Mon Oct 25 11:46:02 2004] Skipping this edition.
[Mon Oct 25 11:46:02 2004] Check edition 0x000020100000000000000430
[Mon Oct 25 11:46:02 2004] Found edition 07152004 0x000020100000000000000430 in input backing store
[Mon Oct 25 11:46:02 2004] Edition 07152004 already exists in output backing store
[Mon Oct 25 11:46:02 2004] Skipping this edition.
[Mon Oct 25 11:46:02 2004] No unconverted editions were found at the end of sequence specified
[Mon Oct 25 11:46:02 2004] There is no work to be done.
[Mon Oct 25 11:46:02 2004] Edition replay complete for INITIAL.iwconvert to 07152004
[Mon Oct 25 11:46:02 2004] TEnvironment::Flush flushed 1, unlinked 0
[Mon Oct 25 11:46:02 2004] TEnvironment::Flush flushed 0, unlinked 0
[Mon Oct 25 11:46:02 2004]
[Mon Oct 25 11:46:02 2004] Total files/directories/symlinks copied: 0
[Mon Oct 25 11:46:02 2004]
[Mon Oct 25 11:46:02 2004] Total bytes of data copied: 0
[Mon Oct 25 11:46:02 2004]
[Mon Oct 25 11:46:02 2004] Total EA's copied: 0
[Mon Oct 25 11:46:03 2004] Shutting down backing store environment...
[Mon Oct 25 11:46:03 2004] (This may take a while because the cache must be flushed)
[Mon Oct 25 11:46:03 2004] Please wait...
[Mon Oct 25 11:46:03 2004] TEnvironment::Flush flushed 0, unlinked 0
[Mon Oct 25 11:46:03 2004] TEnvironment::Freeze freeze until Tue Oct 25 11:46:03 2005
[Mon Oct 25 11:46:03 2004] TEnvironment::dtor found 0 dirty.
[Mon Oct 25 11:46:03 2004] Shutdown of backing store environment complete.
[Mon Oct 25 11:46:03 2004] Backing store environment is shut down
[Mon Oct 25 11:46:03 2004] iwmigrate succeeded

Any ideas? Thanks!!

Adam Stoller

According to the output you showed - there are no new editions in /devStore/main/ResortServices in comparison to what currently exists in /default/main/ResortServices - and thus the migration is a no-op.

How did you go about preparing to perform the migration? (try to be as specific as possible with respect to what commands you ran, what contents existed, didn't exist in each location, etc.)

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

dchristie

The ResortServices branch in devStore is new, I've probably never cut an Edition per say, I wasn't aware you had to.

In preparing for the migration I shut down the store on default, and then ran the command. I wasn't sure if I needed to create a new ResortServices branch first on my target area and then run the command, or if iwmigrate will create the ResortServices for me. I have run it both ways though, and the output that I posted was with the abscense of a ResortServices branch in default.

Should I cut an Edition of the ResortServices in devStore and then run my command?

dchristie

Ok, got it. So you do have to have an Edition, with your submissions already before running iwmigrate. After doing that, the files did transfer over. I hadn't noticed before, but it had made the ResortServices branch for me, but it just was an empty workarea. Cool, thanks again!!

Adam Stoller

No problem.

iwconvert and iwmigrate both operate on editions. Each edition is (for the purposes of explanation) composed of one or more submit events (actually it can be zero - but then there's nothing to transfer) and basically the process "replays" the submit events that occurred between the last known edition on the target side and the next edition to be transferred from the source to the target.

Both iwconvert and iwmigrate will create the branch(es) needed on the target side if they don't already exist.

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

dchristie

Well, I thought we had a clean transfer of data, but a problem has arisen that we can't seem to figure out. For some reason, the branch that was migrated from the "devStore" store to the "default" store is not allowing us to edit or modify anything to the files within it. What I mean is for example, the DCT's, DD.cfg's, PT's are all in their appropriate folders, but are un-editable in anyway. You can't edit them, or upload them, or anything, all the menu options are grayed out. When a workflow is attempted, the "edit" link for the DCT's is not click able.

I would think that it might be a permissions issue, but the source and migrated branch have all the same users, groups, and permissions. The workareas have the same names as well. The other branches in the effected store still are ok. Any ideas? Thanks.

Adam Stoller

These are templating-generated files? And the DCRs and PTs associated with those generated files exist in the correct locations?
(I've seen interesting cases where if you have a file which was generated, and still has it's TST EAs on it - but the DCR and/or PT which are referred to by those EAs no longer exists, the GUI [CCPro] prevents you from editing the file).

You're sure the permissions are correct on the branch, workarea, and all folders leading to the file in question?
You're sure that all users are in the correct groups?
You're sure the backing store is active and not frozen?

I'd suggest using Supports diagnostic tool and opening a case with Support - as they will probably be in a better position to assist you with this kind of problem.

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

dchristie

Yes, these are templating-generated files, and the DCR's and PT's exist in the correct locations. Everything else permission and group-wise looks correct.

Yeah, I'll open a ticket with support and post the results when I can. Thanks.

dchristie

Well, we've basically hit a brick wall on this one. So far, Support hasn't come up with anything concrete. At this point they're thinking that it's the iwmigrate for 6.0 that is the issue. But I don't know if I buy that. We have used the iwmigrate before with no problems, so I'm not understanding that line of thinking or how nobody else has had issues with it. We have deleted the stores several times and still get the same responses. Everything in the migreated branch is not editable. It's pretty strange. At this point we're starting to have to look at recreating the branch by hand to transfer the data. Well, if anyone has some ideas we'd love to hear them.

Frederik

Hi dchristie,

from your description (can't edit anything), it strikes me that perhaps the backing store is frozen?

Lo and behold, the logs even say
[Mon Oct 25 11:46:03 2004] TEnvironment::Freeze freeze until Tue Oct 25 11:46:03 2005

I checked my iwmigrate logs (ts 552), and I saw the same thing (freeze until next year)... but I never had a problem like yours, so perhaps in my case, there was some unfreeze happening by iwmigrate, and in your case there isn't.

I bet you can find info in the manual about checking for frozen status (iwstat & iwfreeze CLT)

-- Fred

Migrateduser

Could you check the permissions on these files via the file system. Also is this problem limited to templating files i.e DCR's etc or any file..

shashi

dchristie

The permissions are being checked through the file system and seem to be good. The problem is more than just files, in the affected branch you can't even create a file or folder, the option is grayed out.