[Monetdb-developers] Large XML instances with MonetDB/XQuery 4.38.5

Christian Grün christian.gruen at gmail.com
Fri Oct 1 19:13:53 CEST 2010


Hi everyone,

is it still possible to shred large XML instances with MonetDB/XQuery,
or do I need more memory for shredding? I was just trying to the 1GB
instance of XMark with WinXP 32Bit and 2GB RAM, and this is what I
got:

MonetDB>shred_doc("1gb.xml", "xmark");
#GDKmmap(536870912) fails, try to free up space [memory in use=36143780,virtual
memory in use=1015480320]
#GDKmmap(536870912) result [mem=26016940,vm=1005387776]
!ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0 at 0.
!ERROR: [shred_url]: first error was:
!ERROR: HEAPextend: failed to extend to 536870912 for 06\632theap
!ERROR: shredBAT_append_str: APPEND-STR[_prop_text]( follow murders prov shoes p
resent eager delivered defy bend viol here marquis powers complexion pillar cran
ts agate ), BUNappend fails
!ERROR: CMDshred_url: operation failed.

pf:add-doc(...) produces the same output; the XML document itself is
well-formed.

Thanks,
Christian




More information about the developers-list mailing list