Discussions
Categories
Groups
Community Home
Categories
INTERNAL ENABLEMENT
POPULAR
PUBLIC CLOUD
PRIVATE CLOUD
Quick Links
MY LINKS
HELPFUL TIPS
Back to website
Home
Intelligence (Analytics)
Issue handling large script dataset in Birt
anees.shaik
<p>Hi</p><p> </p><p>we are running into memory issue when we are trying to pull 700k records using scripted-dataset and same number of records are easily getting pulled using jdbc-dataset. </p><p> </p><p>Need help understanding how birt handles scripted dataset from jdbc dataset and how can scripted dataset be fine tuned to access huge record.</p><p> </p><p>Thanks</p><p> </p>
Find more posts tagged with
Comments
kclark
<p>Is it locking up or are you getting any error messages?</p>
anees.shaik
<p>Yes, it is locking up and server memory is reaching 12 GB and Java heap hovers from 4 to 6 GB. Does BIRT uses any memory which is not part of the java HEAP ? Also It looks like the memory is not reclaimed.</p><p> </p><p>This was the only report runing on the server. We have checked the logs and it looks like the BIRT did generate the tmp files successfully.</p><p> </p><p>We did run another report with sql data source that had about the same number of records on the same server and it ran successfully.</p><p> </p><p>Here is our server stats:</p><p>Available memory: 15 GB</p><p>Heap: 12 GB</p>
anees.shaik
<p>Hi Clark.. Let me know if any further details required.</p><p> </p><p>Thanks</p>
Yaytay
I've also had performance problems with large (100k rows) scripted data sets.
I got around it by moving to jdbc.
Something you could try is using a java event handler instead of javascript - I don't know whether that'll make any difference, but it does cut a chunk out of the processing.