iwextattr -u option and utf-8. Japanese EA values

I have a templated page which has MetaTagger EA's. These are keywords and description. The values are in Japanese which is causing a problem.

In my tpl I am extracting these and using them in my html [meta/] tags as values.

My problem is that unless I do the following the text comes out all garbled. I also tried the -u option and that did not help. See below output.

Example "ãƒœãƒ¼ã‚ºã�®æ¥*å‹™ï¼�åº—èˆ—å�‘ã�‘è£½å“�ã�®ã‚¢ãƒ«ãƒ•ã‚¡ãƒ™ãƒƒãƒˆé*†ä¸€è¦§ã�§ã�™ã€"

To get around this I've done the following.

use Encode;
my $iwhome = TeamSite::Config::iwgethome();
my $opath = getVpath(iwpt_get_ofile_name());
my $keywords = decode("utf8",qx($iwhome/bin/iwextattr -g TeamSite/Metadata/Keywords $opath));
my $description = decode("utf8",qx($iwhome/bin/iwextattr -g TeamSite/Metadata/Description $opath));

Note: getVpath is a method form a utility package. It works fine Smiley Wink

Basically I'm wondering why a simple: my $var = qx($iwhome/bin/iwextattr -g TeamSite/Metadata/Keywords $opath); does not work??

I'm looking for some enterprise tips an making sure I use the BEST practices for international sites and templating. Please let me know your thoughts.

TeamSite 6.7
Solaris 10

Find more posts tagged with

Comments

Tim__D

I did some research online and found some info on utf-8 flags concatenation etc.. As a test I used the use Encode qx(is_utf8); method to check the utf-8 flag of the EA's I'm getting back to TeamSite. Both are false. The flag is off for values getting back from TeamSite EA's. This for English and Japanese values.

In contrast scalar variables containing values from iwpt_dcr_value tags does have the utf-8 flag on?

I'm thinking this is the problem. Why would the output of this CLT not be in UTF-8?

ISCBorisB

I did some research online and found some info on utf-8 flags concatenation etc.. As a test I used the use Encode qx(is_utf8); method to check the utf-8 flag of the EA's I'm getting back to TeamSite. Both are false. The flag is off for values getting back from TeamSite EA's. This for English and Japanese values.

In contrast scalar variables containing values from iwpt_dcr_value tags does have the utf-8 flag on?

I'm thinking this is the problem. Why would the output of this CLT not be in UTF-8?

I *think* that your problem is STDOUT stream from which you slurp the result of iwextattr execution.
Unlike populating variable with the output of some command, iwpt_dcr_value is a function, you get a result from memory without any IOs.

If you are looking for the alternatives to what you are already doing you can perhaps use -x option and read/parse
resulting XML (use UTF-8 mode, directly or via Open pragma). Or you may try to set STDIN/STDOUT opening
mode and see if that helps. For some discussion look here

Tim__D

I *think* that your problem is STDOUT stream from which you slurp the result of iwextattr execution.
Unlike populating variable with the output of some command, iwpt_dcr_value is a function, you get a result from memory without any IOs.

If you are looking for the alternatives to what you are already doing you can perhaps use -x option and read/parse
resulting XML (use UTF-8 mode, directly or via Open pragma). Or you may try to set STDIN/STDOUT opening
mode and see if that helps. For some discussion look here

Thanks for the information. I will look into that method.