Extracting the title metatag from thousands of files

Hi,
I have been reading the threads regarding iwextattr clt to extract metadata from a file and someone posted a script that works recursively. However I am new to perl and am having a hard time. We work on TS 6.7.1/Unix platform. I am trying to extract the Title metatag from thousands of files. Is there a simple perl script that someone can help me with. Again, I know this question has been asked before, but I'm new to perl and I'm new to running iwperl commands.

Any help would be appreciated.

Thanks.

Claire

Find more posts tagged with

Comments

nipper

THIS IS COMPLETELY UNTESTED

something like


#!c:\iw-home\iw-perl\bin\iwperl
use File::Find;
$start = "Y:/default/main/branch/WORKAREA/Content/";
find(\&wanted, $start);
foreach $file(@list) {

if (!($file=~ m|\.html$|) ) { next;}
my $html= _getHTML($file);
if ($html =~ m|(.*)|igsm) {print "$file, $1\n";}
}


sub _getHTML
{
 my($file) = @_;

 open (HTML, "$file") || die "Cannot open $file for reading:$!";

 {
  local $/ = undef;
  $html= ;
 }
 close HTML;
 return $html;

}
sub wanted {-f && push(@list, $File::Find::name);}

moonkhanna

Hi,
I have been reading the threads regarding iwextattr clt to extract metadata from a file and someone posted a script that works recursively. However I am new to perl and am having a hard time. We work on TS 6.7.1/Unix platform. I am trying to extract the Title metatag from thousands of files. Is there a simple perl script that someone can help me with. Again, I know this question has been asked before, but I'm new to perl and I'm new to running iwperl commands.

Any help would be appreciated.

Thanks.

Claire

Claire, since you know iwextattr would work for you, what help are you exactly looking for?

nipper

Claire, since you know iwextattr would work for you, what help are you exactly looking for?

Opps, my bad on the last post, I missed the iwextattr part & wrote a script to read and HTML page & grab the title tags.

This will read an EA


#!c:\iw-home\iw-perl\bin\iwperl
use File::Find;
use TeamSite::Config;
(my $iwhome = TeamSite::Config::iwgethome()) =~ tr|\\|/|;
(my $iwmount = TeamSite::Config::iwgetmount()) =~ tr|\\|/|;
my $start = "Y:/default/main/branch/WORKAREA/Content/";
my $key="EXTENDED ATT TO GET";
find(\&wanted, $start);
foreach $file(@list) {
 $file=~ s/^$iwmount//;

 my $cmd = "$iwhome/bin/iwextattr -g \"$key\" \"$file\"";
 chomp(my $value = `$cmd 2>&1`);
 if ($value)
 { print "$file,$value\n"; }
}

sub wanted {-f && push(@list, $File::Find::name);}

RonaldV

Claire,

in the teamsite/html world we have two type of "metadata".

- teamsite-metadata&colon; stored as extended attributes
- html-metadata&colon; stored inside a meta-tag in the head-tag of the html source.

So to which you refer?

Migrateduser

Hi
Thanks so much to everyone who responded. I'm looking for the actual perl script that I would need to write...Nipper provided a good example, thank you Nipper. I am not working on HTML pages, this is a dynamic site where we don't generate pages. The DCR's contain the metadata. The second thing I need to know is when I finish completing the perl script based on the example Nipper provide, what command do I use to run it? What would the actual command I would use to run this script. Thanks again.

Claire

nipper

iwperl thisscript.ipl

If this is only for DCRs then you will want to use my 1st example but change the regex to parse for the title. If you post a DCR someone can help. Also, change the $start variable to look in a lower folder (not the workarea root, but templatedata/cat/type/data or some similar). You will also need to remove if (!($file =~ m|\.html$|){next;} statement

You can also use perl modules to parse the DCR for you and pull out the title, but I find regex is much faster.

Migrateduser

Hi

Nipper, I just read your latest post...thanks. I will work with the script and let you know. Thanks again..and thanks to everyone for responding to my post.

Claire

RonaldV

Hi

Nipper, I just read your latest post...thanks. I will work with the script and let you know. Thanks again..and thanks to everyone for responding to my post.

Claire

http://www.oreilly.com/catalog/lperl3/ ???

Migrateduser

I have attached the dcr that we are using, I just want to extract the TeamSite/Metadata/TITELE extended attribute from all the files and write it to a text file. The title is duplicated from the dcr to become a TeamSite extended attribute. My question is, and again I'm new to perl, I want to know how to do a "get" for an extended attribute...do I need to include the iwextattr? My apologies for the lame question, but I just want to make sure I understand how this works.

nipper

Use the code I provided in post #4. All you need to do is change the value for $key and put in the quotes TeamSite/Metadata/TITELE

The script will write all of them to the screen. Read a bit about perl and you should be able to get it to write to a file instead, after you are certain it is doing what you want.

Adam Stoller

I have attached the dcr that we are using, I just want to extract the TeamSite/Metadata/TITELE extended attribute from all the files and write it to a text file. The title is duplicated from the dcr to become a TeamSite extended attribute. My question is, and again I'm new to perl, I want to know how to do a "get" for an extended attribute...do I need to include the iwextattr? My apologies for the lame question, but I just want to make sure I understand how this works.

Your attachment didn't make it.

If you're going to work on developing customizations in TeamSite you probably should go through the developer courses offered by Interwoven... That being said:

I think that covers it.

Migrateduser

It worked! Thank you so much, I really appreciate this.
Claire

Adam Stoller

It worked! Thank you so much, I really appreciate this.
Claire

For completeness sake, you should post the details of your resolution - and - close the thread.