Discussions
Categories
Groups
Community Home
Categories
INTERNAL ENABLEMENT
POPULAR
PUBLIC CLOUD
PRIVATE CLOUD
Quick Links
MY LINKS
HELPFUL TIPS
Back to website
Home
Intelligence (Analytics)
problem with large data in birt reports
mvenkat
<p>i have arround 4gb of data to export. but i have got an exception "out of memory".than i tried to increase my tomcat server configuration upto 3gb.still i got the same exception. i tried to increase my server configuration but my tomcat is not supporting to increase more than that. Am i need to change my report design...??. please suggest any solution.my data contaions 10million records.is birt support this much of data...?</p>
Find more posts tagged with
Comments
GLO_FR
<p>Why are you creating a new topic ?</p><p>Is it a different issue than this one ?</p><p><a data-ipb='nomediaparse' href='
http://www.birt-exchange.org/forum/index.php?/topic/30419-out-of-memory-exception-with-large-amount-of-data/'>http://www.birt-exchange.org/forum/index.php?/topic/30419-out-of-memory-exception-with-large-amount-of-data/</a></p>
;
mvenkat
<p>yes,, but i didn't get proper information. please tell does birt support this much data to export.......?</p>
GLO_FR
<p>BIRT haven't any problem with high volume of data.</p><p> </p><p>In your data set, are you filtering your data or are you using parameters ?</p>
mvenkat
<p>no, i am not filtering data , and i am not using any parameters. </p>
GLO_FR
<p>I've just tested it with 12 000 000 rows in a simple report with one group, on my laptop (MSSQL database).</p><p>I confirm, no problem with high volume of data.</p><p> </p><p>Are you doing something "special" in your report (grouping, scripting...) ?</p>
mvenkat
<p>thats good but , i have each row contains 50 columns and each column contains 50 charaters length . will it work.......?.i am using postgresql data base.</p>
GLO_FR
<p>Do you really need so much data? in terms of column</p>
mvenkat
<p>yes,,, it's my client requirement</p>
GLO_FR
<p>Hi,
I've made the same kind of test with a postgres database and it still works fine with the default configuration.
<strong>Birt Report Designer Pro 3.7.2 / Postgres 8.4.5</strong>
Sure, my table has just 3 columns (string 25 / String 25 / Integer / date) but it contains 12,000,000 lines.
If you can't increase more the memory, try to retrieve less volume of data : les columns (if possible) and trim your string.
In theory, your data are</p><p>(50 x 50)x10 000 000 = 25,000,000,000 bytes</p><p>=> 25Gb... that's pretty much !</p><p>Also, if you're doing in memory treatment (sorting, grouping, aggregation....) try to push them as much as possible to the database.
Those are the only solutions I have for the moment</p>