nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

iwperl not finding files ????

TroyP

I have a script that seems to be having touble finding files.

No matter what I do the files that I am processing do not exist even though I can do an ls -l on them just before my other commands.

I will upload my whole script. DEBUG is below...

 
  while (){
    chomp;
    DEBUG("found line: $_");
    next unless ($_ =~ /[a-zA-Z]/);
    DEBUG("has an alfa letter: $_");
    DEBUG(`ls -l $_`);
if (-e $_) {
     DEBUG("file exists: $_");
    } else {
     DEBUG("current dir: ".getcwd());
     DEBUG("file DNE $_");
     next;
    }
    DEBUG("\nprocessing file:$_");
    if (qx($iwhome/custom/bin/isdcr.ipl $_)) {
     #DEBUG("skipping dcr");
     my $result=`iwextattr -s TeamSite/Metadata/ddpath=$_ $_`;
    } else {
     &applyDDFileExtAttr($_);
    }
  }


config:axa-equitable/dd-aeportal-test6.xml
area:/default/main/aeportal/WORKAREA/content
changed dir to /default/main/aeportal/WORKAREA/content
filelist:/tmp/0521.25.lst
dbname:INT
pre-processing filelist
----------------------------
found line: axae/myportal/w/ann/my-business/why-axa-now/history/history.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/history.html
-rwxrwxrwx 1 tssadmin iwglobal 1249 May 21 11:21 axae/myportal/w/ann/my-business/why-axa-now/history/history.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/history.html
----------------------------
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
-rw-rw-rw- 1 tsseditor iwglobal 5541 May 21 09:01 axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
----------------------------
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
-rw-rw-rw- 1 tsseditor iwglobal 5521 May 21 09:01 axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
----------------------------
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
-rw-rw-rw- 1 tsseditor iwglobal 7487 May 21 09:01 axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
----------------------------
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
-rw-rw-rw- 1 tsseditor iwglobal 5487 May 21 11:47 axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html

Even when I remove the test for file existance the call to iwextattr fails because the file can not be loacated.


processing file:axae/myportal/w/ann/my-business/why-axa-now/history/history.html
EA TeamSite/Templating/DCR/Type not found
Found file-uuid:axae/myportal/w/ann/my-business/why-axa-now/history/history.html
Get uuid tags on axae/myportal/w/ann/my-business/why-axa-now/history/history.html
ERROR:02006: Error locating axae/myportal/w/ann/my-business/why-axa-now/history/history.html

Find more posts tagged with

Comments

ISCBorisB

You must provide valid Vpath to the command. Something like this:

iwextattr -s TeamSite/Metadata/ddpath=what_you_need /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/history.html

nipper

try something like this

my $result=`iwextattr -s TeamSite/Metadata/ddpath=$_ $area."/".$_`;

TroyP

You must provide valid Vpath to the command. Something like this:

iwextattr -s TeamSite/Metadata/ddpath=what_you_need /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/history.html

I have tried that although I don't think that is true based on other working scripts.

Here is a smaller test script that uses your recommedation but has the same behavior. Script, Output and data files below.

  
>cat /iw-home/teamsite/custom/bin/file-exist-test.ipl
#!/iw-home/teamsite/iw-perl/bin/iwperl -w
use Getopt::Long;
use Pod::Usage;
use TeamSite::Config;
use Cwd;
my $man=$help=0;
my $area=$inst="";
my %khash=%params=();
(my $iwhome = TeamSite::Config::iwgethome()) =~ tr|\\|/|;
(my $iwmnt = TeamSite::Config::iwgetmount()) =~ tr|\\|/|;

  while (<>){
    chomp;
    DEBUG("found line: $_");
    next unless ($_ =~ /[a-zA-Z]/);
    DEBUG("has an alfa letter: $_");
    my $fvpath="/default/main/aeportal/WORKAREA/content/".$_;
    DEBUG("fvpath: $fvpath");
    DEBUG(`ls -l $fvpath`);
    if ( (-e "$fvpath") ) {
       DEBUG("file exists: $_");
    } else {
       DEBUG("current dir: ".getcwd());
       DEBUG("file DNE $_");
       next;
    }
    DEBUG("\nprocessing file:$_");

  }

sub DEBUG {
  my ($msg) = @_;
  print "$msg\n";
}
/iwmnt/default/main/aeportal/WORKAREA/content
>/iw-home/teamsite/custom/bin/file-exist-test.ipl /tmp/0521.25.lst
Name "main::inst" used only once: possible typo at /iw-home/teamsite/custom/bin/file-exist-test.ipl line 8.
Name "main:arams" used only once: possible typo at /iw-home/teamsite/custom/bin/file-exist-test.ipl line 9.
Name "main::help" used only once: possible typo at /iw-home/teamsite/custom/bin/file-exist-test.ipl line 7.
found line: axae/myportal/w/ann/my-business/why-axa-now/history/history.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/history.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/history.html
-rwxrwxrwx  1 tssadmin iwglobal 1249 May 21 11:21 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/history.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/history.html
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
-rw-rw-rw-  1 tsseditor iwglobal 5541 May 21 09:01 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
-rw-rw-rw-  1 tsseditor iwglobal 5521 May 21 09:01 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
-rw-rw-rw-  1 tsseditor iwglobal 7487 May 21 09:01 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
-rw-rw-rw-  1 tsseditor iwglobal 5487 May 21 11:47 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
/iwmnt/default/main/aeportal/WORKAREA/content
>cat /tmp/0521.25.lst
axae/myportal/w/ann/my-business/why-axa-now/history/history.html
axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
/iwmnt/default/main/aeportal/WORKAREA/content

TroyP

try something like this
my $result=`iwextattr -s TeamSite/Metadata/ddpath=$_ $area."/".$_`;

You guys are fast. Here is another test file with your idea. Same result.

 

>cat /iw-home/teamsite/custom/bin/file-exist-test.ipl
#!/iw-home/teamsite/iw-perl/bin/iwperl -w
use Getopt::Long;
use Pod::Usage;
use TeamSite::Config;
use Cwd;
my $man=$help=0;
my $area=$inst="";
my %khash=%params=();
(my $iwhome = TeamSite::Config::iwgethome()) =~ tr|\\|/|;
(my $iwmnt = TeamSite::Config::iwgetmount()) =~ tr|\\|/|;

  while (<>){
    chomp;
    DEBUG("found line: $_");
    next unless ($_ =~ /[a-zA-Z]/);
    DEBUG("has an alfa letter: $_");
    my $fvpath="/default/main/aeportal/WORKAREA/content/".$_;
    my $result=`iwextattr -s TeamSite/Metadata/ddpath=$_ "/default/main/aeportal/WORKAREA/content/"$_`;
    DEBUG("fvpath: $fvpath");
    DEBUG(`ls -l $fvpath`);
    if ( (-e "$fvpath") ) {
       DEBUG("file exists: $_");
    } else {
       DEBUG("current dir: ".getcwd());
       DEBUG("file DNE $_");
       next;
    }
    DEBUG("\nprocessing file:$_");

  }

sub DEBUG {
  my ($msg) = @_;
  print "$msg\n";
}
/iwmnt/default/main/aeportal/WORKAREA/content
>/iw-home/teamsite/custom/bin/file-exist-test.ipl /tmp/0521.25.lst
Name "main::inst" used only once: possible typo at /iw-home/teamsite/custom/bin/file-exist-test.ipl line 8.
Name "main:arams" used only once: possible typo at /iw-home/teamsite/custom/bin/file-exist-test.ipl line 9.
Name "main::help" used only once: possible typo at /iw-home/teamsite/custom/bin/file-exist-test.ipl line 7.
found line: axae/myportal/w/ann/my-business/why-axa-now/history/history.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/history.html
ERROR:00920: Error locating /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/history.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/history.html
-rwxrwxrwx  1 tssadmin iwglobal 1249 May 21 11:21 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/history.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/history.html
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
ERROR:00920: Error locating /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
-rw-rw-rw-  1 tsseditor iwglobal 5541 May 21 09:01 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
ERROR:00920: Error locating /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
-rw-rw-rw-  1 tsseditor iwglobal 5521 May 21 09:01 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
ERROR:00920: Error locating /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
-rw-rw-rw-  1 tsseditor iwglobal 7487 May 21 09:01 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
found line: axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
has an alfa letter: axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
ERROR:00920: Error locating /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
-rw-rw-rw-  1 tsseditor iwglobal 5487 May 21 11:47 /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
current dir: /iwmnt/default/main/aeportal/WORKAREA/content
file DNE axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
/iwmnt/default/main/aeportal/WORKAREA/content
>cat /tmp/0521.25.lst
axae/myportal/w/ann/my-business/why-axa-now/history/history.html
axae/myportal/w/ann/my-business/why-axa-now/history/milestones2.html
axae/myportal/w/ann/my-business/why-axa-now/history/milestones3.html
axae/myportal/w/ann/my-business/why-axa-now/history/milestones4.html
axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
/iwmnt/default/main/aeportal/WORKAREA/content

nipper

Try this (assuming you have $iwhome set):

my $command="$iwhome/bin/iwextattr -s TeamSite/Metadata/ddpath=$_ /default/main/aeportal/WORKAREA/content/$_";
print "$command \n";
my $result = qx($command);

ISCBorisB

Try this (assuming you have $iwhome set):

my $command="$iwhome/bin/iwextattr -s TeamSite/Metadata/ddpath=$_ /default/main/aeportal/WORKAREA/content/$_";
print "$command \n";
my $result = qx{$command};

Catch STDERR too
my $result = qx($command 2>&1);

nipper

true, then he probably ought to print out $result as well.

TroyP

I uploaded a working copy of my script based on your comments.

I used my original script for 4 deployments before I started getting errors causing me to create my original post.

I was never able to get the file existence test to work with the -e operator. You can see my workaround. But I have a simple unit test that says it should. code below.

You'll also note that I have backtics that I haven't re mediated yet. Hoever they work.

At the same time we had a problem on the server having to do with the number of open file handles. This may have been what was giving me problems.

Thoughts?

nipper

No clue why yours is not working, I just ran this


#/apps/Interwoven/iw-home/iw-perl/bin/iwperl
use TeamSite::Config;
my $iwmnt = TeamSite::Config::iwgetmount();
use File::Find;
$start = "/default/main/branch/WORKAREA/Content/";
find(\&wanted, $start);

foreach $file (@list) {
  print "$file exists \n" if (-e $file);
  print $iwmnt.$file." exists \n" if (-e $iwmnt.$file);
}
sub wanted {-f && push(@list, $File::Find::name);}

It prints outs /default/main... as well as /iwmnt/default/main.....

Adam Stoller

I uploaded a working copy of my script based on your comments.
...
At the same time we had a problem on the server having to do with the number of open file handles. This may have been what was giving me problems. Thoughts?

I'm confused too - Your script has lots of problems in it, not the least of which is some serious lack of efficiencies, you never seem to capture STDERR, your formatting is poor, you don't use either the strict or warnings pragmas, and you're missing decent documentation / comments to explain the overall purpose and process of the script as well as explain some of the more obscure sections of code.

I'd suggest considering this current version of your script as a reference, and try to re-write the code from scratch, more cleanly, more efficiently, and spend some time documenting the process you are intending to follow before actually writing the code -- this often helps to streamline the code and figure out flaws in the logic.

As for your filehandle issue:

if ($params{'filelist'}) {
        open(FILELIST,"<",$params{'filelist'}) or die "Can't open file list";
        ...
}

You never close FILELIST

TroyP

I'm confused too - Your script has lots of problems in it, not the least of which is some serious lack of efficiencies, you never seem to capture STDERR, your formatting is poor, you don't use either the strict or warnings pragmas, and you're missing decent documentation / comments to explain the overall purpose and process of the script as well as explain some of the more obscure sections of code.

I'd suggest considering this current version of your script as a reference, and try to re-write the code from scratch, more cleanly, more efficiently, and spend some time documenting the process you are intending to follow before actually writing the code -- this often helps to streamline the code and figure out flaws in the logic.

As for your filehandle issue:
if ($params{'filelist'}) {
        open(FILELIST,"<",$params{'filelist'}) or die "Can't open file list";
        ...
}
You never close FILELIST

ghoti, I regard most if not all of them as not helpful.

The open file handle problem on the server had nothing to with this script but with another process on the server. My past experience shows that when there are to many open file descriptors on a server all bets are off when it comes to the results of any command. This script was working and thing for some reason started failing. My question was specifically about the test for the existence of a file with the -e operator.

Adam Stoller

ghoti, I regard most if not all of them as not helpful.

The open file handle problem on the server had nothing to with this script but with another process on the server. My past experience shows that when there are to many open file descriptors on a server all bets are off when it comes to the results of any command. This script was working and thing for some reason started failing. My question was specifically about the test for the existence of a file with the -e operator.

If you don't want to learn how to write better code, why should we bother trying to help you fix your bad code. As a service, I've provided a reformatted and annotated version of the code you posted.

Just because a script happened to work before doesn't mean it's a well-written script and that it doesn't have bugs in it that will cause strange problems under unforeseen circumstances.

The script you attached does not use the '-e' directive and thus I didn't comment on it before, however I did indicate where it should probably go. Whether it will work or fail the way your previous attempts did is anyone's guess - but frankly right now it's like trying to shine a penny in the middle of a town dump. Cleanup the code and then try to debug. The mere act of cleaning up code sometimes fixes strange and difficult-to-reproduce bugs.

TroyP

I think I have narrowed down the root cause of where my problems started. There is something about how perl concatenates strings and evaluates shell commands that I am missing.

Here is a simple program than my original to illustrate what I found (at least is not as complex as my original on in this post. The point of the script is to build the vpath of a file in different ways and then see if we can use the vpath to test if a file exists.


This script will be called from the command line like this:
/iw-home/teamsite/custom/bin/file-exist-test.ipl /tmp/0521.10.lst

and /tmp/0521.10.lst has one file listed in it specified  as a vpath relative to the workarea.

>cat /tmp/0521.10.lst
axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html


#!/iw-home/teamsite/iw-perl/bin/iwperl -w
use strict;
use warnings;

#$file is just the hard coded vpath 
my $file="/default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html";

#$relpath is the 'same; as what is read from the ARGV file
my $relpath="axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html";

  while (<>){
    chomp;
    my $fvpath1="/default/main/aeportal/WORKAREA/content/"."$relpath";
    my $fvpath2="/default/main/aeportal/WORKAREA/content/$_";

       DEBUG("   file:$file");
       DEBUG("fvpath1:$fvpath1");
       DEBUG("fvpath2:$fvpath2");

    if ($fvpath1 eq $file) {
       DEBUG("fvpath1 and file are the same");
    } else {
       DEBUG("fvpath1 and file are not equal");
    }

    if ($fvpath1 eq $fvpath2) {
       print "fvpath1 and fvpath2 are the same\n";
    } else {
       DEBUG("fvpath1 and fvpath2 are not equal");
    }


    if ( -e $file ) {
       DEBUG("file exists: $file");
    } else {
       DEBUG("file DNE $file");
    }

    if ( -e $fvpath1 ) {
       DEBUG("fvpath1 exists: $fvpath1");
    } else {
       DEBUG("fvpath1 DNE $fvpath1");
    }


    if ( -e $fvpath2 ) {
       DEBUG("fvpath2 exists: $fvpath2");
    } else {
       DEBUG("fvpath2 DNE $fvpath2");
    }


  }


sub DEBUG {

  my ($msg) = @_;
  print "$msg\n";

}


##This is the output of the script with my comments:
##These three strings display as the same as far as I can see
   file:/default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath1:/default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath2:/default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html

##Why are these not equal as strings?
fvpath1 and file are the same
fvpath1 and fvpath2 are not equal


##Why does fvpath2 not exist?
file exists: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath1 exists: /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath2 DNE /default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html

Adam Stoller

Try changing your debugging lines from:

    DEBUG("   file:$file");
    DEBUG("fvpath1:$fvpath1");
    DEBUG("fvpath2:$fvpath2");

to:

    DEBUG("   file:'$file'");
    DEBUG("fvpath1:'$fvpath1'");
    DEBUG("fvpath2:'$fvpath2'");

This will verify that you don't have any trailing white-space captured in the string.

Additionally, instead of printing your debug messages to STDOUT, send them to a log file and then run: cat -vte logfile on it to verify that there aren't any "invisible" characters getting in the way.

(It's good to see you using 'strict' and 'warnings' pragmas - now you can get rid of the '-w' on the #! line)

I just ran a test version of your script (the first parts comparing strings) - and got:

file:/default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath1:/default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath2:/default/main/aeportal/WORKAREA/content/axae/myportal/w/ann/my-business/why-axa-now/history/milestones.html
fvpath1 and file are the same
fvpath1 and fvpath2 are the same

Perhaps there's something strange on your server??

wendyb_22

I have the same problem. Here is my simple script that reads a directory and lists the files. It finds some files, but not all. It doesn't seem to find files of group iwglobal. I am running the script within the same directory I am listing files (iwmnt/default/main/DEV/WORKAREA/.../templatedata/../content/data/test)

#!/opt/iw-home/iw-perl/bin/iwperl
$dir = shift || '.';
opendir DIR, $dir or die "Can't open directory $dir $!\n";
while ($file = readdir DIR) {
next if $file=~/^\./;
print "Found a file: $file\n";
}

TroyP

I have the same problem. Here is my simple script that reads a directory and lists the files. It finds some files, but not all. It doesn't seem to find files of group iwglobal. I am running the script within the same directory I am listing files (iwmnt/default/main/DEV/WORKAREA/.../templatedata/../content/data/test)
}

Is iwmnt/default/main/DEV/WORKAREA/.../templatedata/../content/data/test
this a file that you find or your initial directory?

Can you give an example of a file that the script doesn't list but should?

My problem in my original post was that I was sometimes moving filelists from a windows box to a linux box. I mistakenly though chomp was smart enough to deal with that and I also couln't see any ^M characters in the file on the linux box. ... but a \r was trailing each line.

nipper

I have the same problem. Here is my simple script that reads a directory and lists the files. It finds some files, but not all. It doesn't seem to find files of group iwglobal. I am running the script within the same directory I am listing files (iwmnt/default/main/DEV/WORKAREA/.../templatedata/../content/data/test)

#!/opt/iw-home/iw-perl/bin/iwperl
$dir = shift || '.';
opendir DIR, $dir or die "Can't open directory $dir $!\n";
while ($file = readdir DIR) {
next if $file=~/^\./;
print "Found a file: $file\n";
}

Your code is correct. I have tested it inside TS and out. No problem.

Is workarea security turned on ? Do you have permissions to do this ?

wendyb_22

Here is what I get back from my ls -l command. The only difference I see is that the one that doesn't work is of group iwglobal. The are both xml files of the same format.

This one gets listed - no problem
-rwxrwxr-x 1 watuser nobody 3615 Aug 13 13:32 test_1532000_1532001_eng.base

This one doesn't list
-rwxrwxrwx 1 watuser iwglobal 4474 Jan 21 2008 test2_1528376_1528377_eng.base

When I run my script I run as sudo ./test.ipl. And it works for some files in that directory, so I believe I have permissions to do this unless there is something special with permissions and iwglobal.

I went into administration in Teamsite and set full permission on Branches,Workareas,Directories and Files and still had the problem.
I do see that the Web Server UID is noboby (my files marked as nobody do display). Not sure if there is something else that needs to be set for iwglobal.

And this is how I am running my script sudo ./test.ipl
Also, I am doing this on a Sun/solaris machine - not sure if that is relevant or not.

TroyP

Here is what I get back from my ls -l command. ...

I am not sure if it's relavant but...

Are you sudo'ing to root or a different user? Can you have that user run your script and also do a listing on the directory?

wendyb_22

I am sudo'ing to root.
I can even edit and save the file if I go into it.
It is just the readdir function that is not picking it up in the list.
I even copied the file to another file name, saw that the group was now root and my script still doesn't pick up the file. It is very weird.

TroyP

I am sudo'ing to root.
I can even edit and save the file if I go into it.
It is just the readdir function that is not picking it up in the list.
I even copied the file to another file name, saw that the group was now root and my script still doesn't pick up the file. It is very weird.

Let's really confirm it's a group issue.

Can you pick a file that is not being found, change the group to nobody, and see if it's found then?

Can you run the scrpipt as a valid TS user that has access to the workarea and files? Can you add root to teamsite as a master user temporarily?

Adam Stoller

Let's really confirm it's a group issue.

Can you pick a file that is not being found, change the group to nobody, and see if it's found then?

Can you run the scrpipt as a valid TS user that has access to the workarea and files? Can you add root to teamsite as a master user temporarily?

Unless something has changed - 'root' is a defacto master user in TeamSite and does not need to be explicitly added as such.

The idea of changing the group is interesting, but based on the ls -l output shown, it shouldn't have any effect, the files were both shown to be world-readable.

I'd also suggest trying the following, slightly modified, script:

#!/opt/iw-home/iw-perl/bin/iwperl
use strict;
use warnings;
my $dir = shift || '.';
opendir DIR, $dir or die "Can't open directory $dir $!\n";
my @files = grep { -f "$dir/$_" && !/^\./ } readdir(DIR);
closedir(DIR);
print "Found a file: $_\n" foreach (@files);