VFE & special character problems

Im having some weird issues with our VFE on ts 5.5.2...i have a toolbar that lets a user add special characters, i.e. euro symbol. i want to send the values to the DCR as the Name Code NOT the actual symbol

it appears to work fine when i enter them into the VFE and select "view as html"

€—

however, after i save it shows up in the dcr as this!

<value>€—</value>

why is it doing this? how do i disable it converting the Name codes to the symbols? im hoping i dont have to use formapi to convert them, since i dont see how this will even work since the conversion appears to be happening on the save event, not onitemchange.

In Por Ylem
Join the most popular player-run UO shard

Find more posts tagged with

Comments

Migrateduser

Try issuing the ASCII code instead of the syntax you're using.

Migrateduser

im not sure what u mean...the

€
—

values are defined via the VFE and i dont think there are other values to use for them

In Por Ylem
Join the most popular player-run UO shard

Dwayne

Well, since you're controlling the insertion of the text, could you instead of inserting € insert &euro;?

Of course, your DCR would look really funky, but who cares?

<value>&amp;euro;</value>

--

Current project: TS 5.5.2/6.1 W2K

Migrateduser

Actually, you know, I think that would do it. The VFE is parsing whatever you put into it, so giving it € would causes it to parse the string into the symbol, but giving it &euro; parses the & into "&", leaving the web browser to reparse it into the symbol.

What was referring to was giving the other notation for it, i.e. &279; (or whatever the ASCII value actually is). There are ASCII charts all over the internet.

Dave

ela

Hi,

The — shouldn't be there in any case, so you need to correct your toolbar function.According to http://www.w3.org/TR/REC-html40/sgml/entities.html you should use €

How's your cleaning by the way?

In the clean charencode part of the visualformatconfig.xml file I have this: <preservechars value="&<>"/> which preserves & < and >.
It makes it a bit easier to look at the code in the html view, and when I insert the € in wysiwyg I get this in the html view: €.

Eldbjoerg

Migrateduser

i fixed this by changing the encoding here:

<clean charencode="UTF-8"

to

<clean charencode="charref"

now it saves all special characters with the character references instead of the actual symbols.

In Por Ylem
Join the most popular player-run UO shard

Adam Stoller

(TS6.1SP1 Solaris8 / WXP w/ IE or Firefox)

I've got a similar situation - and I tried changing the VFE clean to use charref instead of UTF-8 but that still doesn't seem to resolve our problem.
Using the clean with the default "utf-8", if I look at the HTML code within VFE, I see: ’
Using the clean with the "charref" setting, if I look at the HTML code within VFE, I see: &#8217;
Looking at the resultant DCR via less, I see: <E2><80><99>
Looking at the resultant DCR via cat, I see: ΓÇÖ
Looking at the resultant DCR via cat -vte, I see: M-bM-^@M-^Y
Looking at the resultant DCR via vi, I see: \342\200\231

One thing we did notice is that when we generate the page as foo.jsp - the funky chars show up, but if I take the same file and rename it to foo.html - it renders correctly.

This would seem to indicate that there's some aspect of the JSP processing that is failing to recognize or encode the characters correctly.

All I really want to do at this point is catch the character sequence in my PT and replace it with a single-quote (') - but the following code doesn't seem to be able to catch it:use HTML::Entities;
$text = encode_entities($text, "\200-\377");
$text =~ s|\’|'|sgm;
$text =~ s|\’|'|sgm;
$text =~ s|\â\\|'|sgm;(where $text contains the result of iwpt_dcr_value('dcr.****') Smiley Wink

Any ideas?

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

Adam Stoller

We just resolved our issue with a JSP directive - <%@ page pageEncoding="UTF-8" %> which gets inserted into the <head> section of the generated HTML/JSP page - and bingo! the characters show up correctly - and this is without changing the clean code from "utf-8" to "charref" (although it would probably work that way as well).

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

Migrateduser

using websphere 4.x we get this error, it doesnt seem to like that pageEncoding attribute

[10/21/04 10:16:05:355 EDT] 56a3a0e4 WebGroup X Servlet Error:

\WebSphere\AppServer\installedApps\PwcmApp.ear\PwcmWeb.war\commentaries\commentaryHome.jsp(102,35) JSPG0063E: Page directive: Invalid attribute, pageEncoding: org.apache.jasper.JasperException: JSPG0063E: Page directive: Invalid attribute, pageEncoding

In Por Ylem
Join the most popular player-run UO shard

Migrateduser

This is just an idea, but -- instead of € -- have you tried inserting it as &euro; ? The DCT should convert & to simply "&" and leave your output the way you want it.

Dave

Current Environment(s):
(1) TS 6.1 SP1 on W2K3
(2) TS 6.1 SP1 on W2K
(3) TS 5.5.2 SP2 on Win2K

Adam Stoller

I'd suggest you contact your IBM / Websphere support contact to see what they have to say about that - I just looked in google and found a number of references that seem to show the usage of this directive for JSP pages - so it may be a websphere-specific thing.

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com