UTF8 encoding for generated XML

Hello Everyone,

In my current project, xml files are being generated from the tpl's. The encoding of the generated XML is ANSI. The command being used for generating this files is

$pt_compiler -pt "$tplfile" -iw_pt-dcr "$dcrName" -ofile "$targetfile -oenc "utf8"

To check the encoding of the file i open the file in the notepad and click on save as.

How can i ensure that the generated xml's are utf8 encoded and multilingual compliant.

Below is a section from the presentation template

 <iw_perl> iwpt_output("<");iwpt_output("![CDATA["); iwpt_output( HTML::Entities::encode( iwpt_dcr_value("dcr.TITLE") ) ); iwpt_output("]]");iwpt_output(">");</iw_perl> 

Thanks

Manish

Find more posts tagged with

Comments

BlueWhale

Make sure you have xml version="1.0" encoding="UTF-8" as the first line of your generated xml.

ISCBorisB

Make sure you have xml version="1.0" encoding="UTF-8" as the first line of your generated xml.

Are you kidding? You mean that you can ensure that your XML is UTF-8 encoded by simply telling your Parser that it is?

ISCBorisB

The encoding of the generated XML is ANSI [...]
How can I ensure that the generated xml's are utf8 encoded?

What could that possibly mean? Your XML should be UTF-8 encoded but isn't? If so, provide sample value of dcr.TITLE
that causes it and attach generated XML. (Normally DCR Items' values are provided to you in UTF-8, that's default DCR Encoding)

Migrateduser

Dude, try with this and it will work.

-oenc UTF-8

Hello Everyone,

In my current project, xml files are being generated from the tpl's. The encoding of the generated XML is ANSI. The command being used for generating this files is

$pt_compiler -pt "$tplfile" -iw_pt-dcr "$dcrName" -ofile "$targetfile -oenc "utf8"

To check the encoding of the file i open the file in the notepad and click on save as.

How can i ensure that the generated xml's are utf8 encoded and multilingual compliant.

Below is a section from the presentation template

Thanks

Manish

nipper

Once you verify it is UTF-8 you may also need the BOM in the front of the TPL. Search the forums for BOM and you will see some sample code.

manish777

The problem is not happening while generating the file but happens while parsing the file using the DOM parser and printing back the file using a DOM Parser.

my $xml_string;
my $found;
my $newnode;
my $doc;
my $parser = XML: Smiley Very Happy

OM:

arser->new(KeepCDATA => 1);
open (FILE, $targetfile);
$xml_string = join ('', ());
close FILE;
$newnode = ( $parser->parsefile( $newfilename ) )->getDocumentElement();
utf8::upgrade( $xml_string ); $doc = $parser->parse( $xml_string );
my $rootnode = $doc->getDocumentElement();
$newnode->setOwnerDocument( $doc );
if( !$delete ){
$rootnode->appendChild( $newnode );
}
y $id = $newnode->getAttribute("ID");
$LOG->debug("TARGET MAIN XML = $targetfile, ID = $id");

my @nodes = $rootnode->getElementsByTagName( $type );
$LOG->debug("TYPE = $type");
foreach my $node (@nodes) {
if( $id eq $node->getAttribute('ID') ){
(!$delete)?$rootnode->replaceChild( $newnode, $node ):$rootnode->removeChild( $node );
$found = 1;
last;
}
}

# write XML
my $output_str= $rootnode->toString;
my $encode_outstr = Encode::encode( "utf8", $output_str );

$rootnode->printToFile( $targetfile );
`chmod 775 $targetfile`;

The line $rootnode->printToFile( $targetfile ); is actually writting file in ANSI format.

If i try to open the file and write using the below code the multiligual content gets corrupted even after $encode_outstr = Encode::encode( "utf8", $output_str );

open(OUT, ">:utf8", "$targetfile") or die "Could not write to target xml $targetfile";
print OUT "$encode_outstr";
close(OUT);

the multiligual characters get corrupted.

Would really appreciate if someone can tell me where am i going wrong.

manish777

Can anyone please help me on the above issue.

nipper

Just because you write a file in UTF format does not mean that it will be properly encoded. Read about encoding the data and then push it to the file

ISCBorisB

Can anyone please help me on the above issue.

Yes, some of us probably can. Try to understand though that people who can help are usually busy and are not
interested in playing "Twenty Questions to pry your actual question out of you" Game.

Zip up small representative XML before processing, script you've used to process it and the result. Attach zip.
Refrain from "the multiligual characters get corrupted" comments, nobody except you knows what does that really
mean anyway.

manish777

I have attached the two xmls which are being read and than appended to the assets.xml. I have renamed output file from assets.xml to result_assets.xml.

The characters are getting displayed in chinese in the browser.

Thanks everyone for all the help