win2k3 server is slow

I just installed TS 6.5 sp1 on our dev server and then afterwards I ran a perl script that adds users to the local NT groups as well as adds them to the roles files based on a config file.

Maybe 200 plus entries in the config file. The processing took 2 HOURS!

Does anyone have suggestions or scripts that can test how fast the processor is processing perl?

or any other suggestion on where to look?

Looking at the performance via task manger show low CPU usage

Has anyone else expierence this?

Thanks in advance!
win2k3 TS 6.5 sp1; OD 6.0.1; DD enabled
The Professor-

Find more posts tagged with

Comments

Migrateduser

I can't imagine why it would take two hours -- was your CPU relatively flatlined during the whole 2 hours? I'm sure you didn't sit there watching it, but are you aware of any spiking? Also, how much memory is there on this box? Perhaps you can post the script you're using in case there are any inefficiencies?

Dave

Current Environment(s):
(1) TS 6.5 on W2K3
(2) TS 6.1 SP1 on W2K3
By the way, I miss Unix terribly.

ProfessorX

was your CPU relatively flatlined during the whole 2 hours
yes
but are you aware of any spiking
no
Also, how much memory is there on this box
2gig

########################### CODE #############################
#
# DESCRIPTION
# Script populates TS uid files according to instructions obtained from
conf file(s)
# -v switch sets logging verbose mode - 0: suppress all(mute), 1:
report errors only, 2: report all. Default is 2.
# It is irrelevant whether there is a space between the switch and the
argument.
#
# EXAMPLES
# iwperl $iw-home\custom\bin\users_groups.ipl [-v 0|1|2]
ts_roles_2003_04_10.cfg
#
#--------------------------------------------------------------------------------
# MODIFICATION LOG
# - 04/10/2003 Original cut
#--------------------------------------------------------------------------------

# components declaration
use POSIX;
use Getopt: Smiley Frustrated

td;
use Time::Local;
use File::Basename;
use TeamSite::Config;
use Win32::NetAdmin;

# initialize variables...
my $scr_name='sec_management_ts';
my $USAGE = <<END_USAGE;
usage: iwperl \$iw-home\\custom\\bin\\sec_management_ts.ipl [-v 0|1|2]
conf_file1 [conf_file2] ...
-v specifies logging verbose mode - 0: mute, 1: errors only, 2: all
END_USAGE

# Get/Set switches
getopts("v:") || die "$USAGE\n";
my $debug_lvl = $opt_v;
defined($debug_lvl) || do {$debug_lvl = 2;};
($debug_lvl =~ m|^[0-2]$|) || die "$USAGE\n";
(@ARGV) || die "$USAGE\n";

# Get IW home and mount
my $host = `hostname`;
chop $host;
my $iwhome = TeamSite::Config::iwgethome();
my $iwmount = TeamSite::Config::iwgetmount();
$iwhome =~ s|\\|/|g;
$iwmount =~ s|\\|/|g;

# Let's go
my @ttime = localtime;
my $tdate = strftime('%m.%d.%Y %H:%M:%S', @ttime);
my $tsuffix = strftime('%Y_%m_%d_%H%M%S', @ttime);

# Open log
$debug_lvl!=0 && open LOGOUT,
">$iwhome/custom/logs/sec_mng_ts_$tsuffix.log";

$debug_lvl!=0 && print LOGOUT "$scr_name.inf01 - Processing started
$tdate\n";
$debug_lvl >1 && print LOGOUT "$scr_name.inf03 - Hostname is '$host'\n";
$debug_lvl >1 && print LOGOUT "$scr_name.inf04 - IW-HOME is '$iwhome'\n";
$debug_lvl >1 && print LOGOUT "$scr_name.inf05 - IW-MOUNT is '$iwmount'\n";

while (@ARGV) {
# Get the next element from param list.
chomp($ARGV = shift(@ARGV));

# Check File properties
!(-e $ARGV) and do {$debug_lvl>0 && print LOGOUT "$scr_name.err01 -
File '$ARGV' does not exist\n"; next;};
!(-f $ARGV) and do {$debug_lvl>0 && print LOGOUT "$scr_name.err02 -
'$ARGV' is not a plain file\n"; next;};
!(-r $ARGV) and do {$debug_lvl>0 && print LOGOUT "$scr_name.err03 -
Can not read file '$ARGV' - check permissions\n"; next;};

prosess_cfg_file($ARGV);
}

# That's it
$tdate = strftime('%m.%d.%Y %H:%M:%S', localtime);
$debug_lvl!=0 && print LOGOUT "$scr_name.inf02 - Processing finished
$tdate\n\n";
$debug_lvl!=0 && close LOGOUT;

exit;

#--------------------------------------------------------------------------------------------------
# Subroutine pecesses configuration file line by line and performs
requested Add/Delete actions

sub prosess_cfg_file {
my ($filename) = @_;
my ($action, $grp, $uname, $roles, $command, $result, $line,
$op_flag);

open FROM, "$filename";
while (<FROM>) {
chomp($_); $line = $_; # Save $_
for possible error messages

/^\s*$/ && next; # Ignore
blank lines

/^\s*#/ && next; # Ignore
comments

# Split up the line and process requests
($action, $grp, $uname, $roles) = split(/\t+/, $_);

if ($uname =~ /^\s*$/ ) { # Simple
line syntax check
$debug_lvl>0 && print LOGOUT "$scr_name.err06 - Missing
elements in the line \"$_\"\n";
next;
};

# Bild a "case" operator
$_ = $action;

/^A$/i and do {
# An add of TeamSite user requested

# Check NT grouping first
($op_flag, $result) = add_user_to_nt_group($grp, $uname);
if ($op_flag) {
$command = "$iwhome/iw-perl/bin/iwperl
$iwhome/bin/iwadduser.ipl -user $uname -roles $roles 2>\&1";
$result = `$command`;
if ( $? == 0 ) {
$debug_lvl>1 && print LOGOUT "$scr_name.inf06
- Added user \"$uname\" to the group \"$grp\"\n";
}
else {
$debug_lvl>0 && print LOGOUT "$scr_name.err04
- $result\n";
}
}
else {$debug_lvl>0 && print LOGOUT "$scr_name.err04 -
$result\n";}
next;
};

/^D$/i and do {
# Removal of TeamSite user requested.
# Please note that the order of operations is reversed
here comparing to "add" operation:
# removal from UID files is attempted first and from NT
local group then.

$command = "$iwhome/iw-perl/bin/iwperl
$iwhome/bin/iwrmuser.ipl $uname 2>\&1";
$result = `$command`;
if ( $? == 0 ) {
# Try to remove an account from NT group
($op_flag, $result) =
remove_user_from_nt_group($grp, $uname);
if ($op_flag) {
$debug_lvl>1 && print LOGOUT "$scr_name.inf07
- Removed user \"$uname\" from the group \"$grp\"\n";
}
else {
$debug_lvl>0 && print LOGOUT
"\n$scr_name.err05 - $result\n";
}
}
else {$debug_lvl>0 && print LOGOUT "\n$scr_name.err05 -
$result\n";
}
next;
};

# Non recognized commands
$debug_lvl>0 && print LOGOUT "$scr_name.err07 - Error in the
line \"$line\"\n";

}
close FROM;
}

#--------------------------------------------------------------------------------------------------
# Subroutine verifies Group / User presence and tries to create / modify
corresponding
# local groups to make adding TS User possible. Please note that user
account should exist,
# only local groups may be created and modified.
# Subroutine returns TRUE if successfull, otherwise it returns FALSE.
# In either case, brief message is returned as well, in case of failure it
contains error
# description.

sub add_user_to_nt_group {
my ($ntgroup, $ntuser) = @_;
my $retcode = 1; my $err_msg = 'Done';
my $comment;

# Check if we have a group to deal with
if (defined($ntgroup)) {
if (!Win32::NetAdmin::LocalGroupGetAttributes('', $ntgroup,
$comment)) {

# Local group does not exist, create it
$retcode = (Win32::NetAdmin::LocalGroupCreate('',
$ntgroup, 'IW Group for sharing'));
}

if ($retcode) {

# Check if user is already a member of this group
if (!Win32::NetAdmin::LocalGroupIsMember('', $ntgroup,
$ntuser)) {

# User is not a member, add him
$retcode = Win32::NetAdmin::LocalGroupAddUsers('',
$ntgroup, $ntuser);
}
}
($retcode) || do{$err_msg = "Failed to create \"$ntgroup\"
group or add a member to it.".
"\n Please make sure that you have Admin priviliges and
that \"$ntuser\" is a valid account."};
}
else {

# This should not happen ! Just in case...
$retcode = 0; my $err_msg = "Subroutine
\"add_user_to_nt_group\" has been incorrectly invoked.";
}

# "GetLastError" call below works but the resulting message is
comprehensible to MS only. So...
#return ($retcode, Win32::FormatMessage(Win32::GetLastError()));

return ($retcode, $err_msg);
}

#--------------------------------------------------------------------------------------------------
# Subroutine verifies Group / User presence and tries to remove a user
account
# from it. Please note that the group itself never gets deleted even if
empty.
# An absence of group and/or account in it is considered normal.
# Subroutine returns TRUE if successfull, otherwise it returns FALSE.
# In either case, brief message is returned as well, in case of failure it
contains error
# description.

sub remove_user_from_nt_group {
my ($ntgroup, $ntuser) = @_;
my $retcode = 1; my $err_msg = 'Done';
my $comment;

# Check if we have a group to deal with
if (defined($ntgroup)) {
if (Win32::NetAdmin::LocalGroupGetAttributes('', $ntgroup,
$comment)) {
# Local group exists

# Check if user is already a mmember of this group
if (Win32::NetAdmin::LocalGroupIsMember('', $ntgroup,
$ntuser)) {

# User is a member, remove him
$retcode =
Win32::NetAdmin::LocalGroupDeleteUsers('', $ntgroup, $ntuser);
}
}
($retcode) || do{$err_msg = "Failed to remove \"$ntuser\" from
group \"$ntgroup\".".
"\n Please make sure that you have Admin priviliges."};
}
else {

# This should not happen ! Just in case...
$retcode = 0; my $err_msg = "Subroutine
\"remove_user_from_nt_group\" has been incorrectly invoked.";
}

return ($retcode, $err_msg);
}

Thanks in advance!
win2k3 TS 6.5 sp1; OD 6.0.1; DD enabled
The Professor-

Migrateduser

I can see where this might be a heavy script, but it shouldn't take 2 hours... what debug level are you running it at? Also, as part of your debugging, what happens if you were to inject plenty of statements in there with a timestamp and a line number (or something more descriptive) and while the script is running, do the Windows equivalent of a tail -f on the log file? This might indicate to you where the script is crawling, if that's the case.

Dave

Current Environment(s):
(1) TS 6.5 on W2K3
(2) TS 6.1 SP1 on W2K3
By the way, I miss Unix terribly.

stefanmaier

Hi,
we have a similar script with a runtime of 10 seconds and a user list with 40 users.
Out implementation is done with perl module Win32API::Net, we use
Win32API::Net::LocalGroupGetMembers and
Win32API::Net::LocalGroupAddMembers

In your code i see the perl function LocalGroupAddUsers(server, groupName, users),
in which the server-element is empty.
Did you try to fill it with your server name?

Regards
Stefan

ProfessorX

We have the exact same environment on our PROD server. It took seconds there so I don't think it has to do with the script.

Can anyone provide me with a perl script that can check CPU you activity or the like?

Thanks in advance!
win2k3 TS 6.5 sp1; OD 6.0.1; DD enabled
The Professor-

Migrateduser

There are a few things you can do here. The easiest would be to download process explorer from sysinternals.com. It will at least give you the high level overview of how much time the script is spending in I/O, system calls, etc.

If you want to get really detailed info about where the time is being spent, you need to profile your script. Here's an article that will get you started if you go down that road:

http://www.perl.com/pub/a/2004/06/25/profiling.html

ProfessorX

Ok here is what I found out

c:\>iwperl

/iwov/teamsite/bin/iwadduser.ipl -user cms\aguy -roles editor
Performing cmd /c

\iwov\teamsite\bin\iwsvcreset.ipl IWAccessService edb > nul

During the command that calls iwadduser.ipl

iwadduser.ipl when finshed then calls iwreset. It is here that the time is taking...16 seconds

Running iwreset by itself takes 16 seconds.

On PROD server with same exact hardware and software it takes about 3 seconds

Any hints clues to where the bottlenecking could be?

Thanks in advance!
win2k3 TS 6.5 sp1; OD 6.0.1; DD enabled
The Professor-

Adam Stoller

Is there perhaps different network topology between the two TS servers and your PDC/BDC/AD server?
You might try using something like traceroute (I think on Windows it's tracert?) on the two servers to see what the network path and response rates are between your TS servers and your account server.

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com