nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

XML Data Source Optimization

linucksrox

Hi, 
 
I'm struggling to get data in from large XML data sources having to wait sometimes 5 or 10 minutes for a report to generate because of nested tables, etc. Is there any way to script a data set to use an XML data source and programatically iterate through sub elements as needed, instead of nesting entire tables? For example, if I have a customer which may have multiple emails and addresses, the XML is currently 
<pre class='_prettyXprint _lang-auto _linenums:0'>
<customer>
<first_name>
<last_name>
<addresses>
<address>
<address_1>
<address_2>
<city>
...
<address>
...
</addresses>
<emails>
<email>emailaddress@gmail.com</email>
<email>another_address@gmail.com</email>
...
</emails>
</pre>
Right now I have to iterate through emails as one data set/table, addresses as another data set/table, and then have an outer table with the top level customer information, which takes quite a while to parse through about a 20 MB file. 
I'd like to program the fetch method of the data set to automatically iterate through each address/email as they appear. Is this possible? Do I have to script a data source as well? How do you script a data source to pull in the exact same XML data?

Find more posts tagged with

Comments

kclark

One possible optimization you could try is to flatten the patterns, it should speed things up. 
 
For example look at this XML 
<pre class='_prettyXprint _lang-auto _linenums:0'>
<person>
<firstname>Kris</firstname>
<lastname>Clark</lastname>
</person>
</pre>
 
Could be expressed as 
<pre class='_prettyXprint _lang-auto _linenums:0'>
<person firstname="Kris" lastname="Clark"/>
</pre>
 
Since it's flat the parsing is usually faster. Though I don't know how practical this would be for you since you already have a 20MB XML file. 
 
You can also try progressive rendering, <a class='bbc_url' href='http://www.birt-exchange.org/org/devshare/deploying-birt-reports/259-birt-progressive-viewing-during-render/'>here's the devshare</a> it'll show the first page of the report while the rest is still rendering.