Peter Boncz wrote:
Hi Stefan (the non-german .de one)
session.
I also recall that in case of the Skyserver TB dataset, key checking was disabled to to similar problems.
No. The key checking was initially turned off, because the hash table (32-bit) could not well cope with the 13.000.000.000 tuples in the table, causing lengthly hash collisions chains. It took a day....to handle the request. Work is in progress to speed this up using a straightforward clustering on the built-in hash. The preliminary code has been checked in.
PS The likely cause for the problem is a shortage of swap space. Increasing your swap file size (with a few 10s of GB) should be a workaround for the problem.
The swap space set aside for Skyserver was 128G
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers