Issue in rendering French characters.

Hi,

I am facing one problem with French characters. I have one component which is having a text box, the value of text box will be filled by end user which we send as a query string in request. The request is forwarded to a jsp page. The flow is working fine with English characters, but let's say if user enters any french character like "résultat" we receive the value as "rÃ©sultat" in the query string.

I have tried to set the request's character encoding as "UTF-8" in JSP page.But still I am facing the same problem. Can someone suggest what changes needs to be done and where(i.e. component or JSP page).

Thanks in advance

Find more posts tagged with

Comments

rajivgupta

are you using normal text box or one with tinymce....
If not using tiny mce try with that ...

SE123

are you using normal text box or one with tinymce....
If not using tiny mce try with that ...

Its not a textArea but it is just a textbox and we can not use any editors their like Tiny mce. So can't we do it by using the same text box but by any other way like by using some encoding schemes or any other way?

tec_iwov

how does the component put the value on the query string?

did you try encoding the value when building the url to the jsp page?

SE123

how does the component put the value on the query string?

did you try encoding the value when building the url to the jsp page?

Thanks for your reply,
In component I am reading the value of text box and creating the URL in java script function and that particular URL is submitted to jsp through Java Script submit. However, I have noticed just now that when I create the URL in javascript function the URL which comes out from that is givenb below:

http://www.dev.com/Search.jsp?f=0,100&r=10&db=fr_FRq=r%E9sultat

that means before even submitting the request to JSP the parameter "q" in URL takes the Junk Character instead of french character. SO I guess we need to find some way that when JS function takes the value of textbox it shuold not take the junk characters but it should read it as french character. Do you have any idea what can be done?

tanguyr

that means before even submitting the request to JSP the parameter "q" in URL takes the Junk Character instead of french character. SO I guess we need to find some way that when JS function takes the value of textbox it shuold not take the junk characters but it should read it as french character. Do you have any idea what can be done?

It's not a junk character, it's the url/i encoded form of the letter "é".


alert(decodeURI("r%E9sultat"))

You should be able to decode the string in the jsp, try this:
http://www.roseindia.net/jsp/jsp-decode.shtml

SE123

It's not a junk character, it's the url/i encoded form of the letter "é".
alert(decodeURI("r%E9sultat"))
You should be able to decode the string in the jsp, try this:
http://www.roseindia.net/jsp/jsp-decode.shtml

Thanks for your response, I have tried the option mentioned above, but I am still getting the same problem.

thatfish

It looks like the correctly url encoded string is being sent to the jsp page. So I would look at the application and jsp page.

e.g. Is there any configuration setting on the application that may need updating to to allow utf-8 encoding/decoding ?

SE123

It looks like the correctly url encoded string is being sent to the jsp page. So I would look at the application and jsp page.

e.g. Is there any configuration setting on the application that may need updating to to allow utf-8 encoding/decoding ?

I have tried one more option I have set

in server.xml of our tomcat container.

But it also does not work for us. Below is the JSP code which we have used in our application:

<%@ page language="java" contentType="text/JSON" %>
<%@ page import="com.Utility.*" %>
<%@ page import="java.net.URLDecoder"%>
<%@ page import="org.json.*" %>
<%

String keyword = request.getParameter("q");
keyword = URLDecoder.decode(keyword, "UTF-8");
System.out.println(" ******* Keyword q is "+keyword);
String path = application.getRealPath("/");

InternalGuidedSearch util = new InternalGuidedSearch();
JSONObject jsonResponse = util.getJSONData(keyword,path);
%>
<%=jsonResponse%>

The jsp is called from the component where an input field is given the value of input field is taken by JS and also encoded the value of that field by using escape("value") function. Then it submit the request to JSP page after appending the encoded parameter i.e.

http://www.dev.com/Search.jsp?f=0,1..._FRq=r%E9sultat

From above link it is clearly understandable that keyword is encoded properly from JS but when the same parameter we print on console we get the value as
"rÃ©sultat"

Do you require any more information?

thatfish

Is your console configured to render utf-8 characters ?

SE123

Is your console configured to render utf-8 characters ?

Actually, we are using Console to just cross check, our main concern is that we are sending these parameters to third party and based on these parameters we get the response from them but we can easily see that the URL which is forming and hitting their server is containing the Junk Characters instead of French characters.

thatfish

If I am understanding the issue correctly getting your console output is the key debugging line which you need to focus on.

Not really much more I can add. I believe the issue is with the application in its configuration or code. The code you've shown looks OK to me.

Possible gotcha is are you double-decoding ?
i.e does the getParameter method already decode url encoded entities and then the URLDecoder tries to decode again
I'm grasping at straws really