how to convert special characters to numeric equivelant

Hi All,

We are using TeamSite6.1 on Solaris 8 platform.
we are facing a problem with special characters.
Content author is usually copy and paste the content from MS-Word.
User copy and paste the special characters like word format single quotes, word format double quotes, —,⅓ ⅔ ∞ ⅝ ⅞ ≠ ≈ ÷ ™.
when these characters are deployed(as metadata) to database(Oracle 9i), they stored as some junk characters, and these characters are displaying as ? or small square. my question is, is there any way to convert these special characters to numeric equivelant or html equivelant. Ex ™ should converted to ™

Your suggestions will be appreciated.
Thanks in advance

Find more posts tagged with

Comments

Migrateduser

Hi Surender,

First, I need to break the news that TS 6.1 has been EOL for a while now. However, please take a look at this KBA from Ektron to see if it can help you with your current task.

INFO:Encoding special characters
http://dev.ektron.com/kb_article.aspx?id=384

I hope this helps,

Manny

Surender

The problem is not in the VF. Simple text box and textarea.
I tried using JavaScript regular expressions in datacapture.cfg but datacapture throwing Parser exception. I also tried using Perl regular expression in cgi file but no use.
If anybody has faced the same issue and find any solution please let me know.

Thanks

Migrateduser

Surender,

will keep you posted if I come across this type of behavior.

iwTech

Try this

, will help to get some idea,

Let me know

-Vin

Surender

Hi Vin,
Thanks for your reply.
Definitely it will help me.

Is there any other way to convert it to HTML equivelant instead of '&#x%04X;' EX: word format single quote should converted to ‘
If you know any method available please let me know.

Thanks

nipper

deleted - wrong thread

ISCBorisB

Hi Vin,
Thanks for your reply.
Definitely it will help me.

Is there any other way to convert it to HTML equivelant instead of '&#x%04X;' EX: word format single quote should converted to ‘
If you know any method available please let me know.

Thanks

You may want to take a look at [thread=21410]this[/thread] thread, in it we've discussed several aspect of dealing with non-portable MS symbols, etc...

iwTech

Hi Vin,
Is there any other way to convert it to HTML equivelant instead of '&#x%04X;' EX: word format single quote should converted to ‘
If you know any method available please let me know.

Thanks

I hope the reference by Boris helped you.

I have a similar situation, we fixed it by customizing an external editor ,

called FCKeditor , it uses a .js to clean (80%-90%) the word docs,

It’s basically a good java script regex code ,

Refer /study the code and write your custom .js

( you can execute this OnSave ) and clean the code before save it

(Web-based HTML text editor with powerful formatting capabilities )

Try to view the code

, Search function CleanWord () , A very good reference

-Vin

Surender

Hi Vin,

When I try to print the following special characters
‘w-sgl’,“w-dbl”, — MDash, – NDash ™
using sprintf('&#x%04X;', ord($_[0]));

it is printing the following output:
âw-sglâ,âw-dblâ, â MDash, â NDash â¢

do you have any idea how to convert these characters to HTML entities.
I try to convert using regular expr, but not working.

Thanks

kaalraa

You also have a module called HTML::Entities. Try, if that could help you.

http://search.cpan.org/~gaas/HTML-Parser-3.56/lib/HTML/Entities.pm

kumardas

you can also use native2ascii conversion in command prompt. Then you will get the exact conversion.

ISCBorisB

you can also use native2ascii conversion in command prompt. Then you will get the exact conversion.

I do not beleive that 'native2ascii' may help in this case. MS Office special characters are not portable.
In many cases they are not rendered correctly even by IE, go figure.

Surender

Hi All,
Thanks for your reply.
HTML::Entities seems to be very useful. But the problem here is when I try to print the value in simple .ipl file

use HTML::Entities;

my $input = "Title ‘sgl’,“w-dbl”, — MDash, – NDash ™ ";
print encode_entities($input), "\n";

The output is:
Title sgl,w-dbl,  MDash,  NDash 
But the same value when I pass to .cgi file from JavaScript in a datacapture.cfg as a parameter and try to print the encoded value the output is different.

Title âsglâ,âw-dblâ, â MDash, â NDash â¢

anybody have any idea ?

Thanks