[Monetdb-developers] Could not create hash table for key test

Stefan Manegold Stefan.Manegold at cwi.nl
Sun Nov 23 11:19:24 CET 2008


On Sun, Nov 23, 2008 at 02:04:09AM +0100, Stefan de Konink wrote:
>   #GDKmalloc(14777222432) fail => BBPtrim(enter) 
> usage[mem=14840896,vm=27527806976]
> #BBPTRIM_ENTER: memsize=14840896,vmsize=27527806976
> #BBPTRIM: memtarget=4611686018427387904 vmtarget=0
> #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976
> #GDKmalloc(14777222432) fail => BBPtrim(ready) 
> usage[mem=11538120,vm=27527806976]
> #BATpropcheck: BAT tmp_1260(-688): could not allocate hash table for key 
> test
> #GDKmalloc(14777222432) fail => BBPtrim(enter) 
> usage[mem=11537664,vm=27527806976]
> #BBPTRIM_ENTER: memsize=11537664,vmsize=27527806976
> #BBPTRIM: memtarget=4611686018427387904 vmtarget=0
> #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976
> #GDKmalloc(14777222432) fail => BBPtrim(ready) 
> usage[mem=10416208,vm=27527806976]
> #BATpropcheck: BAT tmp_1135(-605): could not allocate hash table for key 
> test
> MAPI  = monetdb at localhost:50000
> QUERY = COPY 773410980 RECORDS INTO node_tags from 
> '/mnt/data2/csv/node_tags.csv' USING DELIMITERS ',', '\n', '''';
> ERROR = !MALException: GDKmallocmax: failed for 1892320544 bytes
>          !ERROR: GDKload: failed name=12/1252, ext=thash
>          !ERROR: GDKmallocmax: failed for 1892320544 bytes
>          !ERROR: GDKload: failed name=12/1253, ext=thash
> 
> What kind of voodoo is this?
> 
> I'm trying to import a 42GB csv file using copy into, on a native 
> system, 2GB of memory, 4GB of swap. Latest CVS version, this time 
> compiled for CoreDuo, without debuging, with optimise.

>From the trace above, I comclude that MonetDB is unable to allocate a 14GB
chunk --- first (obvious) questions to ask and answer: 
Is your CoreDuo (or Core2Duo?) a 64-bit CPU?
If so, are you running a 64-bit OS (which?)?
If so, are you using a 64-bit build of MonetDB?
If so, is your MonetDB configured with 64-bit or 32-bit OIDs?

The output of
	`mserver5 --version`
should answer most of these questions ...

Stefan

> 
> Stefan
> 
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Monetdb-developers mailing list
> Monetdb-developers at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/monetdb-developers
> 

-- 
| Dr. Stefan Manegold | mailto:Stefan.Manegold at cwi.nl |
| CWI,  P.O.Box 94079 | http://www.cwi.nl/~manegold/  |
| 1090 GB Amsterdam   | Tel.: +31 (20) 592-4212       |
| The Netherlands     | Fax : +31 (20) 592-4312       |




More information about the developers-list mailing list