nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

External Task errors with 'find'

oroque

Hi,

Here's a breakdown of the scenario:
-TeamSite 6.1 SP1 on Solaris 8
-User "qaauthor.one.911" is in primary group "911web".
-All directories leading up to the path specified below are readable by all users(r-- at minimum).
-The workarea of 911web (common_wa1) has file permissions of drwxrwsr-x and is owned by group "911web"

When "qaauthor.one.911" runs the command
/usr/bin/find /.iwmnt/default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation/imported_files
via command line (telnet), it returns the directory contents (as expected).

Logged in as "qaauthor.one.911" and within a workflow, there is an external task that runs the same command but returns with the error :
/usr/bin/find: cannot open /.iwmnt/default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation/imported_files: Permission denied

Any idaa why?

Thanks,
Oscar

Find more posts tagged with

Comments

Adam Stoller

Who is the 'owner' of the externaltask as defined by the WFT?

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

oroque

The owner is "qaauthor.one.911"

Adam Stoller

Other than the rather strange (to me) userid - not being able to see the wft, the externaltask script, and to be able to interact with your system to see the problem in action -- it's kind of difficult to suggest much more than that you contact Support and work with them. Sorry.

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

Dwayne

Read permission is not sufficient in this case. You also need execute permission on the directories.

Read permission on a directory allows you to see a list of files in that directory. In order to actually USE that directory, you need execute permission.

--

Current project: TS 5.5.2/6.1 W2K

oroque

Thanks fish and Dwayne for all your answers.

I double-checked all the folders leading up to the desired folder and they all have the read and execute bits set (for user, group, and others).

One last thing to add (if it helps solve this issue):
The command is run inside of a perl script, here is a snippet:
my $find_cmd = "/usr/bin/find /.iwmnt/default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation/imported_files 2>&1";
my @cmd_output = `$find_cmd`;

Edited by oroque on 11/04/04 06:44 AM (server time).

birtdatepicker.zip

Migrateduser

This puzzles me, too, but just for fun, what if you were to remove the leading /.iwmnt from the WF version, which leaves it as "/default/..."? Also, since there's some sort of error SOMEWHERE, try trapping the STDERR from your externaltask at the point where you're executing that command and log it somewhere.

Dave

Current Environment(s):
(1) TS 6.1 SP1 on W2K3
(2) TS 6.1 SP1 on W2K
(3) TS 5.5.2 SP2 on Win2K

Dwayne

I would suggest putting a call to run whoami and groups in your script, right before the invocation of find. to make sure that you're running as the user you think you are. Because that's the only thing I can think of at this point that would explain the symptoms you're seeing.

--

Current project: TS 5.5.2/6.1 W2K

oroque

I edited the script as both of you suggested and logged the output.

Here is the new snippets to the script:
my $whoami_cmd = `whoami`;
my $groups_cmd = `groups`;
print LOG "Logged in as: $whoami_cmd under group $groups_cmd .";

Here is the result:
Logged in as: qaauthor.one.911 under group 911web
Searching for files...
/usr/bin/find /default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation/imported_files 2>&1
/usr/bin/find: cannot open /default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation/imported_files: Permission denied

Dwayne

Bizarre.

What do you get as the output of the groups command when run from the command line as that user? Although, that shouldn't matter, since you said that 'other' has at least r-x permissions all the way down.

Is it possible that somebody changed permissions somewhere along the way? I know you said you checked it, but, for the sake of my sanity, I'd like to see the output of:

ls -ld /default
ls -ld /default/main
ls -ld /default/main/911web
ls -ld /default/main/911web/WORKAREA
ls -ld /default/main/911web/WORKAREA/common_wa1
ls -ld /default/main/911web/WORKAREA/common_wa1/911Web
ls -ld /default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation
ls -ld /default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation/imported_files

Current project: TS 5.5.2/6.1 W2K

oroque

Hi Dwayne,

ls -ld /default
lrwxrwxrwx 1 root other 14 Aug 26 22:19 /default -> /iwmnt/default

ls -ld /default/main
drwxrwxr-x 11 root root 512 Nov 2 15:32 /default/main

ls -ld /default/main/911web
drwxrwxr-x 5 interwoven_adm 911web 512 Oct 29 15:02 /default/main/911web

ls -ld /default/main/911web/WORKAREA
dr-xr-xr-x 3 interwoven_adm 911web 512 Oct 29 15:03 /default/main/911web/WORKAREA

ls -ld /default/main/911web/WORKAREA/common_wa1
drwxrwsr-x 5 interwoven_adm 911web 512 Nov 3 09:34 /default/main/911web/WORKAREA/common_wa1

ls -ld /default/main/911web/WORKAREA/common_wa1/911Web
drwxrwsr-x 8 oscar.roque 911web 512 Nov 3 09:34 /default/main/911web/WORKAREA/common_wa1/911Web

ls -ld /default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation
drwxrwsr-x 10 oscar.roque 911web 512 Nov 3 13:57 /default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation

ls -ld /default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation/imported_files
drwxrwsr-x 2 root 911web 512 Nov 3 13:57 /default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation/imported_files

Dwayne

OK. I'm officially out of ideas. The only permissions we haven't checked are those on /iwmnt, but that would be a longshot at best, at this point. Or, even MORE of a stretch, you could check the permissions on find to make sure it's not got a SUID bit set or something. but that would impact the command line as well as from the external task.

Would it be possible to switch to using the Perl module instead of using find? I don't know if it would help the problem or not, but, if nothing else, it would probably be more effecient in terms of system resources.

--

Current project: TS 5.5.2/6.1 W2K

oroque

Hi Dwayne,

I was actually initially using the Find.pm Perl Module when i encountered a similar error which was something like "cannot cd to :".
It would find the files in the directory, but after searching the first directory, it would spit out this error.

Thanks for all the help so far.

Dwayne

Are there subdirectories of the target directory? And, if so, what is the permission of those directories? Perhaps the error message is misleading.

--

Current project: TS 5.5.2/6.1 W2K

oroque

Within our desired directory, our diectory is empty (i have also tried putting a dummy file1.txt into the dir with same permissions as the directory) - still same thing.

Dwayne

I'm sorry, but I've not nothing else. Sorry I couldn't help.

--

Current project: TS 5.5.2/6.1 W2K

oroque

Thanks for all your help Dwayne.

Anyone else have ideas?

Migrateduser

I'm just as stumped... but what if you were to run the find command (from the WF, of course) targetting the parent directory? I wonder at what point will it work.

Dave

Current Environment(s):
(1) TS 6.1 SP1 on W2K3
(2) TS 6.1 SP1 on W2K
(3) TS 5.5.2 SP2 on Win2K

oroque

I tried running it on /.iwmnt and /tmp
Same error.....

Adam Stoller

Can you post the actual externaltask script ? At this point, though it seems rather unlikely from all earlier reports, it seems the most likely suspect.

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

oroque

Can't see any options that allows me to post - I'll try and cut snippets out.

Workflow External Task:
<externaltask lock = "f" name = "ScanDocs_UAT" owner = "__INSERT__($uContributor);" retry = "f" start = "f" description = "Scanning Imported Documents: __INSERT__($uDescription);">
<areavpath v = "__INSERT__($cVPath);"/>
<successors>
<successorset description = "Go to DeployScript_UAT">
<succ v = "DeployScript_UAT"/>
</successorset>
<successorset description = "Rollback: Make Decision">
<succ v = "MakeDecision"/>
</successorset>
</successors>
<command v = "/interwoven/TeamSite/httpd/iw-bin/create_filelist.ipl"/>
<activation>
<or>
<pred v = "URLScript_UAT"/>
</or>
</activation>
<variables>
<variable key = "dirs" value = "911Web/GeneralInformation/imported_files,911Web/LSP/imported_files,911Web/Municipalities/imported_files,911Web/PSAP/imported_files"/>
<variable key = "filelist" value = "/interwoven/OpenDeployNG/conf/wf_templates/911web/911web_imported_docs.txt"/>
<variable key = "mail_to" value = "__INSERT__($uContributor);"/>
<variable key = "mail_cc" value = "oscar.roque@myemail.com"/>
<variable key = "mail_from" value = "__INSERT__($uContributor);"/>
</variables>
</externaltask>

oroque

Snippets of Perl: (runs after getting all needed variables, and converting any comma delimited lists to arrays)
#=====================================================================
# Name: convert_dirs
# Args: $oref - reference to hash of options
# Purpose: Converts relative dirs to full path dirs (from wf_area)
# Returns: None. Modifies $opts{full_dirs} directory
#=====================================================================
sub convert_dirs{
my($oref) = shift;
if($$oref{dirs}[0] ne ""){
my @dirs = @{$$oref{dirs}};
my @full_dirs;
my $path = $$oref{wf_area};

foreach my $dir (@dirs){
$dir =~ s/^\.\///g;
$dir = $path . '/' . $dir;
push(@full_dirs, $dir);
}
@{$$oref{full_dirs}} = @full_dirs;
}
}

#=====================================================================
# Name: scan_dir
# Args: $oref - reference to hash of options
# $href - reference to hash of task/workflow info
# Purpose: Scan a directory and add new files to a filelist
# Returns: None. Modifies Files on the TS filesystem
#=====================================================================
sub scan_dir{
my($oref, $href) = @_;
my @dirs = @{$$oref{full_dirs}};
my @find_cmds;

if($LOGGING){
my $whoami_cmd = `whoami`;
my $groups_cmd = `groups`;
my $pwd_cmd = `pwd`;
my @ls_cmd = `ls -l /.iwmnt/default/main/911web/WORKAREA/common_wa1/911Web/GeneralInformation`;

$whoami_cmd =~ s/\n//g;
$groups_cmd =~ s/\n//g;
$pwd_cmd =~ s/\n//g;

print LOG "Logged in as: $whoami_cmd under group $groups_cmd .\n";
print LOG "Current dir $pwd_cmd ...\n";
print LOG "Contents\n";
print LOG @ls_cmd;
}

print LOG "Checking if directories exist...\n" if ($LOGGING);

if($dirs[0] ne ""){
# Point of failure Check: Ensure ALL dirs exist
foreach my $dir (@dirs){
$dir =~ s/^\/\.iwmnt//g;
print LOG " $dir " if ($LOGGING);
if( (-e $dir) && (-d $dir) ){
print LOG "OK\n" if ($LOGGING);
push(@find_cmds, "/usr/bin/find $dir 2>&1");

}
else{
print LOG "FAILED\n" if ($LOGGING);
}
}

print LOG "Searching for files...\n" if ($LOGGING);
foreach my $find_cmd (@find_cmds){
print LOG " $find_cmd\n" if ($LOGGING);
my @cmd_output = `$find_cmd`;
foreach my $cmd_line (@cmd_output){
$cmd_line =~ s/\n//g;
print LOG " $cmd_line " if ($LOGGING);
if((-e $cmd_line) && !(-d $cmd_line)){
print LOG "OK\n" if ($LOGGING);
push(@files_found, $cmd_line);
}
else{
print LOG "NOT A FILE\n" if ($LOGGING);
}
}

}
}
else{
print "No dirs given in workflow!\n";
print LOG "No dirs specified!\n" if ($LOGGING);
$hash{task}->CallBack(1, "Script error: No dirs passed.");
exit(0);
}

print LOG "Directory scanning completed.\n" if ($LOGGING);
}

#=====================================================================
# Name: maintain_filelist
# Args: $oref - reference to hash of options
# $href - reference to hash of task/workflow info
# Purpose: Adds files to a given fileslist
# Returns: None.
#=====================================================================
sub maintain_filelist{
my($oref, $href) = @_;
my $file_list = $$oref{filelist};

# Point of Failure Check: Check if file R, W
print LOG "Reading filelist...\n" if ($LOGGING);
print LOG " $file_list " if ($LOGGING);
if(-r $file_list) {
print LOG "OK\n" if ($LOGGING);
print LOG "Checking write permissions..." if ($LOGGING);
if(-w $file_list){
print LOG "OK\n" if ($LOGGING);

print LOG "Opening filelist and reading previous values...\n" if ($LOGGING);
open(FILELIST_READ, "< $file_list");
my @existing_files;
while(<FILELIST_READ>){
my $existing_file = $_;
$existing_file =~ s/\n//g;
push(@existing_files, $existing_file);
print LOG " $existing_file\n" if ($LOGGING);
}
close(FILELIST_READ);

my @combined_array = (@files_found, @existing_files);
my %unique;

foreach my $dir (@combined_array)
{
$dir =~ s/^$$oref{wf_area}/\./g;
$unique{$dir}++;
}

# get all the unique dirs
my @unique_dirs = sort keys(%unique);

print LOG "Writing to filelist...$file_list\n" if ($LOGGING);
print LOG "WF Area: $$oref{wf_area}\n" if ($LOGGING);
open(FILELIST_WRITE, "> $file_list");
foreach my $unique_dir(@unique_dirs){
if($unique_dir ne ""){
print FILELIST_WRITE "$unique_dir\n";
print LOG " $unique_dir\n" if ($LOGGING);
}
}
close(FILELIST_WRITE);

}
else{
print LOG "FAILED\n" if ($LOGGING);
exit_due_to_error(1, "Error: Can not write to $file_list");
}

}
else{
print LOG "DOES NOT EXIST.\n" if ($LOGGING);
print LOG "Creating file list.\n" if ($LOGGING);
# create the file list
# ensure the directory can be written to
my $file_list_dir = $file_list;
$file_list_dir =~ s/(.*\/)(.*)/$1/g;
print LOG "Checking write permissions on $file_list_dir..." if ($LOGGING);
if(-w $file_list_dir){
print LOG "OK\n" if ($LOGGING);
open(FILELIST_WRITE, "> $file_list");
foreach my $file (@files_found){
$file =~ s/^$$oref{wf_area}/\./g;
print FILELIST_WRITE "$file\n";

}
close(FILELIST_WRITE);
print LOG "File list created.\n" if ($LOGGING);

}
else{
print LOG "FAILED\n" if ($LOGGING);
exit_due_to_error(1, "Error: Can not create file list in $file_list_dir");
}
}
}

Adam Stoller

Can't see any options that allows me to post - I'll try and cut snippets out.
It's the second checkbox under the textarea where you type in your post:
[ ] I want to preview my post and/or attach a file

However - although I would probably write the code differently, I don't see anything (after a casual review) in there that would explain the problems you're seeing. Sorry.

May I suggest you create a simpler version of the script - that does essentially nothing except the 'find' and see what happens ...

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

oroque

I don't actually like running the find command and initially tried using the Find.pm module (which made things a lot simpler).

As for you suggestion of removing find, I tried that as well and it carries on and calls back the task.

Do you think it might be an error caused by apache/tomcat permissions?

Edited by oroque on 11/04/04 08:50 AM (server time).

Adam Stoller

Feel free to use Find.pm - what I'm suggesting is a much simpler script - which only performs the find operaton (and probably the callback) and see if - in a simpler script - the same problem exists. If it doesn't - then the problem is somewhere in the existing script. If it does - keep simplifying.

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com