Some tokens are not replaced in preview?

Hi,

TS 7.1 @Win2k3,

I have a livesite-page with some tokens in the output. If I preview this page some tokens (url_prefix, edit_live_page) are replaced but MOST tokens (page-scope, post_component, a custom one) are NOT replaced.

What is happening here?

Find more posts tagged with

Comments

AlexC

Any exceptions on startup of server (server log) or during preview (preview log)? Any token config changes in the spring files?

Can you attach the 'view source' as a start.

RonaldV

Alex,

there is nothing special in the logs. I have raised the logging to debug and then this is shown:

2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'COMPONENT' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableComponent'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'AJAX_URL' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableAjaxUrl'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'EDIT_LIVE_PAGE' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableEditLivePage'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'MODEL' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableModel'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'EX_MODEL' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableModelEx'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'IF_MODEL' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableModelIf'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'EX_IF_MODEL' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableModelIfEx'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'CONTEXT' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableContext'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'EX_CONTEXT' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableContextEx'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'CONVERT' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableConvert'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'PAGE_LINK' to 'class com.interwoven.livesite.runtime.page.PageTokenVariablePageLink'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'PAGE_SCOPE' to 'class com.interwoven.livesite.runtime.page.PageTokenVariablePageScope'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'EX_PAGE_SCOPE' to 'class com.interwoven.livesite.runtime.page.PageTokenVariablePageScopeEx'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'SUBMIT_URL' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableSubmitUrl'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'URL_ALIAS' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableUrlAlias'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'URL_PREFIX' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableUrlPrefix'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'OPTIMOST_HEADER' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableOptimostHeader'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'OPTIMOST_FOOTER' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableOptimostFooter'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'PRE_COMPONENT' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableComponentPre'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'POST_COMPONENT' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableComponentPost'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'LIVESITE_ANALYTICS' to 'class com.interwoven.livesite.runtime.page.PageTokenVariableLivesiteAnalytics'
2010-07-13 09:38:36,363 [main] DEBUG com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering page token 'CUSTOM_TOKEN' to 'class com.bgl.livesite.tokens.CustomToken'

Here is the 'view html source':

[HTML]<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />home
body
{
margin:0;

}

.centerComponents
{
margin:auto;
text-align:left;
}

#element1
{
width:810px;
}

#c1278502533837
{
width:800px;
min-height:600px;
height:auto !important;
height:600px;
margin:10px 0 0 10px;
display:inline;
float:left;
}

<meta name="keywords" content="" /><meta name="description" content="" /><meta name="vpath" content="//localhost/default/main/livesite-cs/WORKAREA/ronald/sites/RonaldDemo/home.page" />

My token value: /iw/cci/meta/no-injection/iw-mount/default/main/livesite-cs/WORKAREA/ronald/ en

Custom token: $CUSTOM_TOKEN[]

XSL tokens: /iw/cci/meta/no-injection/iw-mount/default/main/livesite-cs/WORKAREA/ronald/, $CUSTOM_TOKEN[], $POST_COMPONENT, , $PAGE_SCOPE

My content is:
$CUSTOM_TOKEN Mijn eerste pagina, $POST_COMPONENT, , $PAGE_SCOPE
Mijn token in content: [$CUSTOM_TOKEN[] /iw/cci/meta/no-injection/iw-mount/default/main/livesite-cs/WORKAREA/ronald/
Mijn sample: $SAMPLE_TOKEN

(Xslt=version: 1.0)

2.0fd
C:\Interwoven\TeamSite\tools\java\lib\tools.jar;C:\Interwoven\TeamSite\servletd\bin\bootstrap.jar
1.1 or higher
C:\Interwoven\TeamSite\tools\java\jre\lib\ext;C:\WINDOWS\Sun\Java\lib\ext
serializer.jar present-unknown-version
C:\Interwoven\TeamSite\tools\java\jre\lib\endorsed\serializer.jar
C:\Interwoven\TeamSite\tools\java\jre\lib\endorsed\xalan.jar
xercesImpl.jar WARNING.present-unknown-version
C:\Interwoven\TeamSite\tools\java\jre\lib\endorsed\xercesImpl.jar
xml-apis.jar present-unknown-version
C:\Interwoven\TeamSite\tools\java\jre\lib\endorsed\xml-apis.jar
Xerces-J 2.8.1
not-present
Xalan Java 2.7.0
not-present
not-present
1.6.0_12
2.0
not-present
C:\Interwoven\TeamSite\tools\java\jre\lib\endorsed\serializer.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\endorsed\xalan.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\endorsed\xercesImpl.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\endorsed\xml-apis.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\resources.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\rt.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\sunrsasign.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\jsse.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\jce.jar;C:\Interwoven\TeamSite\tools\java\jre\lib\charsets.jar;C:\Interwoven\TeamSite\tools\java\jre\classes
2.0
Xalan Java 2.7.0

Xml:

$CUSTOM_TOKEN Mijn eerste pagina, $POST_COMPONENT, , $PAGE_SCOPE
Mijn token in content: [$CUSTOM_TOKEN[] /iw/cci/meta/no-injection/iw-mount/default/main/livesite-cs/WORKAREA/ronald/
Mijn sample: $SAMPLE_TOKEN
 
 

[host] = [localhost:8080]
[accept-language] = [en-us,en;q=0.8,fr;q=0.5,fr-fr;q=0.3]
[x-forwarded-for] = [10.173.152.129]
[accept] = [text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8]
[x-forwarded-scheme] = [http]
[x-forwarded-host] = [10.173.152.102]
[user-agent] = [Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.9.2.6) Gecko/20100625 Firefox/3.6.6]
[max-forwards] = [10]
[accept-charset] = [ISO-8859-1,utf-8;q=0.7,*;q=0.7]
[cookie] = [iw_user=Administrator; iw_which_ui=; iw_domain=VMTSDEV; IWAUTH=52616e646f6d495602061517f5709991e326d3ca75a368aee8158e44300ef0ecd3d514b90d08c57eb0d54e2d495dd40b411096a6ceea7fbc23c30d0a32f2c0ce857640e3b61a2587]
[accept-encoding] = [gzip,deflate]
[referer] = [http://10.173.152.102/iw-cc/command/iw.group.preview_file?vpath=//localhost/default/main/livesite-cs/WORKAREA/ronald/sites/RonaldDemo/home.page]
[x-forwarded-server] = [localhost]

home

[/HTML]

AlexC

You have tokens above such as $PAGE_SCOPE which are in an invalid form (missing parameter delimiters and parameters).

$PAGE_SCOPE[key] is valid, $PAGE_SCOPE by itself is not and will be echo'd back as is. This page token does a map lookup and without a key the system assumes it's not a page token but rather some use text.

All page tokens are in a form of $PAGE_SCOPE[...] or $CONTEXT{...}, the only token that is singular is $URL_PREFIX and even that is legacy behavior and $URL_PREFIX[relative path] is preferred.

RonaldV

Alex,

thank you. All 'old-fashoined' tokens are now replaced. However the 'ComponentPost' and the custom-tokens that I have added through 'rendering-resource-config' are not replaced.

Do they need parameters as well?
How can I trace what goes wrong here?

BTW, the preferred way of using url-prefix is not mentioned in the latest (e.g. 7.1) manual.

AlexC

By default all tokens require some delimiters like $TOKEN[] or $TOKEN{} and only URL_PREFIX has custom code to make it an exception, if the tokens were written based on PageTokenVariable base class they require the delimiters.

RonaldV

Alex,

somehow my custom-token are not replaced.

In the logs they are registered:

2010-07-21 09:42:02,036 [main] DEBUG  com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering  page token 'CUSTOM_TOKEN' to 'class com.bgl.livesite.tokens.CustomToken'
2010-07-21 09:42:02,036 [main] DEBUG  com.interwoven.livesite.runtime.page.PageTokenFactory () - Registering  page token 'SAMPLE_TOKEN' to 'class  com.interwoven.livesite.external.runtime.example.PageTokenVariableSample'

but without result (from html-source):

[HTML]
My token value: /iw/cci/meta/no-injection/iw-mount/default/main/livesite-cs/WORKAREA/ronald/ en

Custom token: $CUSTOM_TOKEN[]

XSL tokens: /iw/cci/meta/no-injection/iw-mount/default/main/livesite-cs/WORKAREA/ronald/, $CUSTOM_TOKEN{}, $POST_COMPONENT, ,

My content is:
$CUSTOM_TOKEN Mijn eerste pagina, $POST_COMPONENT, , 
Mijn token in content: $CUSTOM_TOKEN{} /iw/cci/meta/no-injection/iw-mount/default/main/livesite-cs/WORKAREA/ronald/, $CUSTOM_TOKEN[]
Mijn sample: $SAMPLE_TOKEN[], $SAMPLE_TOKEN{}
 
 

[/HTML]

As you can see, I tried every possible delimiter. :-)

How to debug this?

AlexC

Can you attach the code for the custom token code please.

Also provide a parameter something like $SAMPLE_TOKEN[foo]

RonaldV

Alex,

adding a parameter to the token call makes no difference.

Below is the source code but please notice that the example class that comes with LS does not work either. Also note that I have added some extra (unneeded) code below in order to add some extra logging.



package com.bgl.livesite.tokens;

import com.interwoven.livesite.runtime.impl.BaseRequestContext;
import com.interwoven.livesite.runtime.page.PageTokenVariable;
import java.io.*;
import java.util.*;

public class CustomToken extends PageTokenVariable
{

 public CustomToken()
 {
  mLogger.info("rove init");
  try{
   // Create file 
   FileWriter fstream = new FileWriter("c:\\customtoken.txt");
   BufferedWriter out = new BufferedWriter(fstream);

   java.util.Date now = new java.util.Date();
   out.write("Init: " + now.toString());
   //Close the output stream
   out.close();
  }catch (Exception e){//Catch exception if any
   System.err.println("Error: " + e.getMessage());
  }
 }

 public static void main(String[] args) {
  try{
   // Create file 
   FileWriter fstream = new FileWriter("c:\\customtoken.txt");
   BufferedWriter out = new BufferedWriter(fstream);

   java.util.Date now = new java.util.Date();
   out.write("Init: " + now.toString());
   //Close the output stream
   out.close();
   System.out.println("Done");
  }catch (Exception e){//Catch exception if any
   System.err.println("Error: " + e.getMessage());
  }

 }

 public void init(BaseRequestContext context)
 {
  super.init(context);
  mLogger.info("rove init");
 }

 public void preRender(BaseRequestContext context)
 {
  super.preRender(context);
  mLogger.debug("rove pre-render");
 }

 public void render(PrintWriter writer, BaseRequestContext context)
  throws Exception
 {
  writer.print((new StringBuilder()).append("$").append(mTokenName).append(" has been replaced with this text").toString());
  mLogger.debug("rove render");
  //throw new Exception("Dump me!");
 }

 private static final long serialVersionUID = 1L;
 public static final String NAME = "CUSTOM_TOKEN";
 public static final String TOKEN = "$CUSTOM_TOKEN";
}

AlexC

Since you have logger statements for debug, can you attach the contents of the log in DEBUG mode for the whole time it is rendering the page, I want to see what the log has about detecting this token and handling it, all that should be logged in debug mode. Please post the contents of livesite.preview.log if using preview for this and servlet_d.out as well.

RonaldV

Alex,

I was on a 2 week holiday, hence the delay: see attachment.

AlexC

The livesite.preview.log is empty. Are you previewing this page? If so, did you enable DEBUG for the iw-preview context? (webapps/iw-preview/WEB-INF/classes/log4j.xml and set com.interwoven.livesite level to DEBUG).

RonaldV

Alex,

from your info I now understand that there is a second 'rendering-resource-config.xml' located under webapps\iw-preview. When I add the token declaration here the tokens are replaced. So this now works. Thanks.

Next question now is: what is the supported location to add these custom-token entries so that it will be included in the build.bat process?

AlexC

The way to add it would be to have spring config in livesite_customer/resources/customer-*-resource.xml that contains the definition for livesite.PageTokenFactory copied from rendering-resource-config.xml and then comment out the original one and use the custom one in the livesite_customer directory. This is one way. Another is to have a custom class that instanciates the livesite.PageTokenFactory bean and then call factory.setToken("MYTOKEN", "com.somepath.MyTokenClass") and that will add your custom class for a token to a token name.

RonaldV

Ok, thank you for all the info.

One more thing: why is all this stuff not included in the manual? I believe Iwov should not release this stuff before the manual is updated to reflect this.

AlexC

It will be in the latest manual, we were short on doc people and few things did not get in unfortunately. Our current doc team is up to speed and going forward will have a lot more comprehensive manuals.