SearchQuery sublist is not returning all the results

Hi all, I have a very strange problem. The size of the IPagingResult of a SearchQuery is not the same of the results returned by the subList method.

Explanation:

IPagingList result = searchQuery.execute();int results = result.size();List subList = result.subList(results-20, results);

In some cases the subList is empty, how could this be possible?? What could be the problem??

Thanks to everybody contributing!

Find more posts tagged with

Comments

Jesse_Estum

Looks like a coding problem? SeeJavaDoc. You probably want something more like this:

IPagingList result = searchQuery.execute();
int results = result.size();
int startPos = results > 20 ? results-20 : 0;
List subList = result.subList(startPos, results-1);

From:   "eLink Entry:Discussion Group - Web Experience Management" <v7webcontentmanagement@elinkkc.opentext.com>
To:   "eLink Recipient"<devnull@elinkkc.opentext.com>
Date:   04/27/2011 05:51 AM
Subject:    SearchQuerysublist is not returning all the results

SearchQuerysublist is not returning all the results

Posted by david_garciagonzalez@ieci.es(Garc?a Gonz?lez, David) On 2011/04/27 06:43

Hi all, I have a very strange problem. The size of theIPagingResult of a SearchQuery is not the same of the results returnedby the subList method.

Explanation:

IPagingList result = searchQuery.execute(); int results = result.size(); List subList = result.subList(results-20, results);

In some cases the subList is empty, how could this be possible??What could be the problem??

Thanks to everybody contributing!

[To post a comment, use the normal replyfunction]
Forum:	DiscussionGroup - Web Experience Management
Livelink Server:	knowledge-wlweb01

David_GarcAa_GonzAlez

Yes, but it was an example, the real case is that results.size() returns 900, but if i try results.subList(851,900), it only returns 10, instead of 50.

It is very strange, the subList method from element 860 to 900 does not return any element.

What could be the problem?

David_Stiles

Have you tried, just as an experiment, what happens if you callresult.asList()? Does the returned List have 900 elements?

From: eLink Entry:Discussion Group - Web Experience Management[mailto:v7webcontentmanagement@elinkkc.opentext.com]
Sent: Wednesday, April 27, 2011 9:24 AM
To: eLink Recipient
Subject: Re SearchQuery sublist is not returning all the results

Re SearchQuery sublist is not returning all the results

Posted by david_garciagonzalez@ieci.es (García González, David) On 2011/04/27 10:18

Yes, but it was an example, the real case is that results.size() returns 900, but if i try results.subList(851,900), it only returns 10, instead of 50.

It is very strange, the subList method from element 860 to 900 does not return any element.

What could be the problem?

[To post a comment, use the normal reply function]
Topic:	SearchQuery sublist is not returning all the results
Forum:	Discussion Group - Web Experience Management
Livelink Server:	knowledge-wlweb01

David_GarcAa_GonzAlez

Yes, but it throws an exception because the amount of records (900):

Nested exception is:java.rmi.RemoteException: EJB Exception: ; nested exception is:        java.lang.StackOverflowError:        at weblogic.ejb20.internal.EJBRuntimeUtils.throwRemoteException(EJBRuntimeUtils.java:102)        at weblogic.ejb20.internal.BaseEJBHome.handleSystemException(BaseEJBHome.java:296)        at weblogic.ejb20.internal.BaseEJBObject.postInvoke(BaseEJBObject.java:284)        at weblogic.ejb20.internal.StatelessEJBObject.postInvoke(StatelessEJBObject.java:168)        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl.invokeAsList(RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl.java:110)        at com.vignette.as.client.javabean.RemotablePagingList.asList(RemotablePagingList.java:195)        at com.vignette.as.server.logic.search.SearchResults.loadObjectsFromMOVCMRef(SearchResults.java:272)        at com.vignette.as.server.logic.search.SearchResults.getSearchResults(SearchResults.java:203)        at com.vignette.as.server.logic.search.SearchResults.getSearchResults(SearchResults.java:120)        at com.vignette.as.server.logic.search.SearchResultPagingList.subList(SearchResultPagingList.java:85)        at com.vignette.as.client.javabean.PagingList.subList(PagingList.java:126)        at com.vignette.as.server.logic.common.RemotablePagingListDispatcherOpsLogic.invokeSubList(RemotablePagingListDispatcherOpsLogic.java:92)        at com.vignette.as.server.logic.common.RemotablePagingListDispatcherOpsLogicGen.invokeSubList(RemotablePagingListDispatcherOpsLogicGen.java:448)        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean.invokeSubList(RemotablePagingListDispatcherOpsBean.java:611)        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl.invokeSubList(RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl.java:154)        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl_WLSkel.invoke(Unknown Source)        at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:166)        at weblogic.rmi.cluster.ReplicaAwareRemoteRef.invoke(ReplicaAwareRemoteRef.java:290)        at weblogic.rmi.cluster.ReplicaAwareRemoteRef.invoke(ReplicaAwareRemoteRef.java:248)        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl_816_WLStub.invokeSubList(Unknown Source)        at com.vignette.as.client.javabean.RemotablePagingList.subList(RemotablePagingList.java:153)        at es.pa.cms.integrationservice.utils.view.ReportParser.generateServicesForSiteReport(ReportParser.java:486)        at jsp_servlet._informes.__servicesreport._jspService(__servicesreport.java:305)        at weblogic.servlet.jsp.JspBase.service(JspBase.java:33)        at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:1077)        at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:465)        at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:348)        at weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:330)        at com.vignette.as.ui.common.util.ContextUtils.dispatch(ContextUtils.java:249)        at com.vignette.as.ui.common.taglib.VgnDispatchTag.doStartTag(VgnDispatchTag.java:123)        at jsp_servlet._secure._common._session.__dispatch._jspService(__dispatch.java:184)        at weblogic.servlet.jsp.JspBase.service(JspBase.java:33)        at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:1077)Caused by: java.lang.StackOverflowError:        at java.util.Vector.elements(Vector.java:294)        at com.vignette.exolab.castor.jdo.oql.ParseTreeNode.children(ParseTreeNode.java:162)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:543)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

David_Stiles

Perhaps I’m confused, but from this stack it seems evident thatyou haven’t called IPagingList.asList() on the result IPagingList you’re gettingback from searchQuery.execute(). I don’t think this exception will occur if youcall asList(). The evidence I’m referring to from this stack is:

at com.vignette.as.client.javabean.RemotablePagingList.subList(RemotablePagingList.java:153)

at es.pa.cms.integrationservice.utils.view.ReportParser.generateServicesForSiteReport(ReportParser.java:486)

I’m suspicious that the index handling of subList() for thisparticular IPagingList implementation is defective and I’m hoping that knowing theresults of asList() will help determine if it is.

From: eLink Entry:Discussion Group - Web Experience Management[mailto:v7webcontentmanagement@elinkkc.opentext.com]
Sent: Wednesday, April 27, 2011 11:05 AM
To: eLink Recipient
Subject: RE Re SearchQuery sublist is not returning all the results

RE Re SearchQuery sublist is not returning all the results

Posted by david_garciagonzalez@ieci.es (García González, David) On 2011/04/27 12:00

Yes, but it throws an exception because the amount of records (900):

Nested exception is:

java.rmi.RemoteException: EJB Exception: ; nested exception is:

        java.lang.StackOverflowError:

        at weblogic.ejb20.internal.EJBRuntimeUtils.throwRemoteException(EJBRuntimeUtils.java:102)

        at weblogic.ejb20.internal.BaseEJBHome.handleSystemException(BaseEJBHome.java:296)

        at weblogic.ejb20.internal.BaseEJBObject.postInvoke(BaseEJBObject.java:284)

        at weblogic.ejb20.internal.StatelessEJBObject.postInvoke(StatelessEJBObject.java:168)

        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl.invokeAsList(RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl.java:110)

        at com.vignette.as.client.javabean.RemotablePagingList.asList(RemotablePagingList.java:195)

        at com.vignette.as.server.logic.search.SearchResults.loadObjectsFromMOVCMRef(SearchResults.java:272)

        at com.vignette.as.server.logic.search.SearchResults.getSearchResults(SearchResults.java:203)

        at com.vignette.as.server.logic.search.SearchResults.getSearchResults(SearchResults.java:120)

        at com.vignette.as.server.logic.search.SearchResultPagingList.subList(SearchResultPagingList.java:85)

        at com.vignette.as.client.javabean.PagingList.subList(PagingList.java:126)

        at com.vignette.as.server.logic.common.RemotablePagingListDispatcherOpsLogic.invokeSubList(RemotablePagingListDispatcherOpsLogic.java:92)

        at com.vignette.as.server.logic.common.RemotablePagingListDispatcherOpsLogicGen.invokeSubList(RemotablePagingListDispatcherOpsLogicGen.java:448)

        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean.invokeSubList(RemotablePagingListDispatcherOpsBean.java:611)

        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl.invokeSubList(RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl.java:154)

        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl_WLSkel.invoke(Unknown Source)

        at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:166)

        at weblogic.rmi.cluster.ReplicaAwareRemoteRef.invoke(ReplicaAwareRemoteRef.java:290)

        at weblogic.rmi.cluster.ReplicaAwareRemoteRef.invoke(ReplicaAwareRemoteRef.java:248)

        at com.vignette.as.server.ejb.RemotablePagingListDispatcherOpsBean_pme4c0_EOImpl_816_WLStub.invokeSubList(Unknown Source)

        at com.vignette.as.client.javabean.RemotablePagingList.subList(RemotablePagingList.java:153)

        at es.pa.cms.integrationservice.utils.view.ReportParser.generateServicesForSiteReport(ReportParser.java:486)

        at jsp_servlet._informes.__servicesreport._jspService(__servicesreport.java:305)

        at weblogic.servlet.jsp.JspBase.service(JspBase.java:33)

        at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:1077)

        at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:465)

        at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:348)

        at weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:330)

        at com.vignette.as.ui.common.util.ContextUtils.dispatch(ContextUtils.java:249)

        at com.vignette.as.ui.common.taglib.VgnDispatchTag.doStartTag(VgnDispatchTag.java:123)

        at jsp_servlet._secure._common._session.__dispatch._jspService(__dispatch.java:184)

        at weblogic.servlet.jsp.JspBase.service(JspBase.java:33)

        at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:1077)

Caused by: java.lang.StackOverflowError:

        at java.util.Vector.elements(Vector.java:294)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeNode.children(ParseTreeNode.java:162)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:543)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

        at com.vignette.exolab.castor.jdo.oql.ParseTreeWalker.checkWhereClause(ParseTreeWalker.java:544)

[To post a comment, use the normal reply function]
Topic:	SearchQuery sublist is not returning all the results
Forum:	Discussion Group - Web Experience Management
Livelink Server:	knowledge-wlweb01

David_GarcAa_GonzAlez

It throws the same exception calling

results.subList(1,900)

the same, that calling

results.asList()

It finally throw this final exception:

Caused by: java.lang.StackOverflowError:         at java.util.Vector.elements(Vector.java:294)         at com.vignette.exolab.castor.jdo.oql.ParseTreeNode.children(ParseTreeNode.java:162)

It is very strange.

David_GarcAa_GonzAlez

Finally, the solution was do the query as follows:

IPagingList results= searchQuery.execute(RequestParameters.getImmutableInstanceTopRelationOnly())realSize=results.asList().size();

With the RequestParameters.getImmutableTInstanceTopRelationOnly() it does not throw any exception.

But the first time it executes results.asList() it lasts 20 seconds, the second one, it lasts 2 seconds.

Why is the difference between the first and the second call?