[Monetdb-developers] Large XML instances with MonetDB/XQuery 4.38.5

Christian Grün christian.gruen at gmail.com
Fri Oct 1 21:35:26 CEST 2010


To continue… Do you have some information on the current theoretical
limits for storing XML instances in MonetDB/XQuery?

Thanks,
Christian



On Fri, Oct 1, 2010 at 7:13 PM, Christian Grün
<christian.gruen at gmail.com> wrote:
> Hi everyone,
>
> is it still possible to shred large XML instances with MonetDB/XQuery,
> or do I need more memory for shredding? I was just trying to the 1GB
> instance of XMark with WinXP 32Bit and 2GB RAM, and this is what I
> got:
>
> MonetDB>shred_doc("1gb.xml", "xmark");
> #GDKmmap(536870912) fails, try to free up space [memory in use=36143780,virtual
> memory in use=1015480320]
> #GDKmmap(536870912) result [mem=26016940,vm=1005387776]
> !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0 at 0.
> !ERROR: [shred_url]: first error was:
> !ERROR: HEAPextend: failed to extend to 536870912 for 06\632theap
> !ERROR: shredBAT_append_str: APPEND-STR[_prop_text]( follow murders prov shoes p
> resent eager delivered defy bend viol here marquis powers complexion pillar cran
> ts agate ), BUNappend fails
> !ERROR: CMDshred_url: operation failed.
>
> pf:add-doc(...) produces the same output; the XML document itself is
> well-formed.
>
> Thanks,
> Christian
>




More information about the developers-list mailing list