[MonetDB-users] Error on Queries 4.x of Star Schema Benchmark
Hello,
I'm testing MonetDB with Star Schema Benchmark on a Linux Ubuntu box. I'm able to run all queries except 4.1, 4.2 and 4.3 I've tested with Scale Factor of 1, 5 and 10, and with 1, 3 and 7Gb RAM, and in all situations I gets this error:
java.sql.SQLException: MALException:algebra.join:GDK reported error. ERROR: HEAPextend: failed to extend to 954941288 for 15/1560tail at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2208) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1967) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:434) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:347) at nl.cwi.monetdb.jdbc.MonetStatement.executeQuery(MonetStatement.java:451) at test.Main.test(Main.java:188) at test.Main.main(Main.java:158)
With 1 Gb of RAM it could be lack of memory but not with 7Gb and a SF of 1. Any idea why this occours? Thanks.
Rui Anastácio
On 19-02-2010 15:03:52 +0000, Rui Anastácio wrote:
Hello,
I'm testing MonetDB with Star Schema Benchmark on a Linux Ubuntu box. I'm able to run all queries except 4.1, 4.2 and 4.3 I've tested with Scale Factor of 1, 5 and 10, and with 1, 3 and 7Gb RAM, and in all situations I gets this error:
can you report the output of mserver5 --version please?
Here it is:
rui@Thor:~$ mserver5 --version MonetDB server v5.16.4 (32-bit), based on kernel v1.34.4 (32-bit oids) Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Configured for prefix: /usr Libraries: libpcre: 7.8 2008-09-05 (compiled with 7.8) openssl: OpenSSL 0.9.8g 19 Oct 2007 (compiled with OpenSSL 0.9.8g 19 Oct 2007) libxml2: 2.7.5 (compiled with 2.7.5) Compiled by: root@ubuntu-karmic-32 (i486-pc-linux-gnu) Compilation: gcc -O2 -Wall -O2 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize Linking : /usr/bin/ld -Wl,-Bsymbolic-functions
Fabian Groffen wrote:
On 19-02-2010 15:03:52 +0000, Rui Anastácio wrote:
Hello,
I'm testing MonetDB with Star Schema Benchmark on a Linux Ubuntu box. I'm able to run all queries except 4.1, 4.2 and 4.3 I've tested with Scale Factor of 1, 5 and 10, and with 1, 3 and 7Gb RAM, and in all situations I gets this error:
can you report the output of mserver5 --version please?
Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 19-02-2010 15:32:44 +0000, Rui Anastácio wrote:
Here it is:
rui@Thor:~$ mserver5 --version MonetDB server v5.16.4 (32-bit), based on kernel v1.34.4 (32-bit oids)
You use the 32-bits version of MonetDB, which means you can have 7GB in your system, but you can't use them.
You better install 64-bits Ubuntu (amd64/x86_64), and install a 64-bits version of MonetDB.
That might be a problem, but It really uses the 7Gb because I have updated the kernel. The test results and the free memory shows this. Even so, with 3 Gb and SF 1 should it give the same error? Should it use virtual memory if necessary?
Rui
Fabian Groffen wrote:
On 19-02-2010 15:32:44 +0000, Rui Anastácio wrote:
Here it is:
rui@Thor:~$ mserver5 --version MonetDB server v5.16.4 (32-bit), based on kernel v1.34.4 (32-bit oids)
You use the 32-bits version of MonetDB, which means you can have 7GB in your system, but you can't use them.
You better install 64-bits Ubuntu (amd64/x86_64), and install a 64-bits version of MonetDB.
Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On Fri, Feb 19, 2010 at 04:07:21PM +0000, Rui Anastácio wrote:
That might be a problem, but It really uses the 7Gb because I have updated the kernel. The test results and the free memory shows this. Even so, with 3 Gb and SF 1 should it give the same error? Should it use virtual memory if necessary?
the point is that a 32-bit process can only address a 32-bit address space, i.e., 4 GB at the very most, this includes physical and virtual memory.
Stefan
Rui
Fabian Groffen wrote:
On 19-02-2010 15:32:44 +0000, Rui Anastácio wrote:
Here it is:
rui@Thor:~$ mserver5 --version MonetDB server v5.16.4 (32-bit), based on kernel v1.34.4 (32-bit oids)
You use the 32-bits version of MonetDB, which means you can have 7GB in your system, but you can't use them.
You better install 64-bits Ubuntu (amd64/x86_64), and install a 64-bits version of MonetDB.
Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
I have installed Ububtu Server and MonetDB amd64. Tried to run query 4.1 with 8Gb RAM, but it run out of Memory and killed the the process.
**** output of 'free' while runnig the query: total used free shared buffers cached Mem: 8196740 8145732 51008 0 412 5816 -/+ buffers/cache: 8139504 57236 Swap: 3301316 3299028 2288
**** output of mserver5 --version MonetDB server v5.16.4 (64-bit), based on kernel v1.34.4 (64-bit oids) Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Configured for prefix: /usr Libraries: libpcre: 7.8 2008-09-05 (compiled with 7.8) openssl: OpenSSL 0.9.8g 19 Oct 2007 (compiled with OpenSSL 0.9.8g 19 Oct 2007) libxml2: 2.7.5 (compiled with 2.7.5) Compiled by: root@ubuntu-karmic-64 (x86_64-pc-linux-gnu) Compilation: gcc -O2 -Wall -O2 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize Linking : ld -IPA -m elf_x86_64 -Wl,-Bsymbolic-functions
*** The error was Out of memory. Process Kill Action: Readline Server disconnection
Anyone manage to run this query?
Regards Rui Anastácio
Stefan Manegold wrote:
On Fri, Feb 19, 2010 at 04:07:21PM +0000, Rui Anastácio wrote:
That might be a problem, but It really uses the 7Gb because I have updated the kernel. The test results and the free memory shows this. Even so, with 3 Gb and SF 1 should it give the same error? Should it use virtual memory if necessary?
the point is that a 32-bit process can only address a 32-bit address space, i.e., 4 GB at the very most, this includes physical and virtual memory.
Stefan
Rui
Fabian Groffen wrote:
On 19-02-2010 15:32:44 +0000, Rui Anastácio wrote:
Here it is:
rui@Thor:~$ mserver5 --version MonetDB server v5.16.4 (32-bit), based on kernel v1.34.4 (32-bit oids)
You use the 32-bits version of MonetDB, which means you can have 7GB in your system, but you can't use them.
You better install 64-bits Ubuntu (amd64/x86_64), and install a 64-bits version of MonetDB.
Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
I have installed Ububtu Server and MonetDB amd64. Tried to run query 4.1 with 8Gb RAM, but it run out of Memory and killed the the process.
**** output of 'free' while runnig the query: total used free shared buffers cached Mem: 8196740 8145732 51008 0 412 5816 -/+ buffers/cache: 8139504 57236 Swap: 3301316 3299028 2288
**** output of mserver5 --version MonetDB server v5.16.4 (64-bit), based on kernel v1.34.4 (64-bit oids) Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Configured for prefix: /usr Libraries: libpcre: 7.8 2008-09-05 (compiled with 7.8) openssl: OpenSSL 0.9.8g 19 Oct 2007 (compiled with OpenSSL 0.9.8g 19 Oct 2007) libxml2: 2.7.5 (compiled with 2.7.5) Compiled by: root@ubuntu-karmic-64 (x86_64-pc-linux-gnu) Compilation: gcc -O2 -Wall -O2 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize Linking : ld -IPA -m elf_x86_64 -Wl,-Bsymbolic-functions
*** The error was Out of memory. Process Kill Action: Readline Server disconnection
Anyone manage to run this query?
Regards Rui Anastácio
Stefan Manegold wrote:
On Fri, Feb 19, 2010 at 04:07:21PM +0000, Rui Anastácio wrote:
That might be a problem, but It really uses the 7Gb because I have updated the kernel. The test results and the free memory shows this. Even so, with 3 Gb and SF 1 should it give the same error? Should it use virtual memory if necessary?
the point is that a 32-bit process can only address a 32-bit address space, i.e., 4 GB at the very most, this includes physical and virtual memory.
Stefan
Rui
Fabian Groffen wrote:
On 19-02-2010 15:32:44 +0000, Rui Anastácio wrote:
Here it is:
rui@Thor:~$ mserver5 --version MonetDB server v5.16.4 (32-bit), based on kernel v1.34.4 (32-bit oids)
You use the 32-bits version of MonetDB, which means you can have 7GB in your system, but you can't use them.
You better install 64-bits Ubuntu (amd64/x86_64), and install a 64-bits version of MonetDB.
Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
participants (3)
-
Fabian Groffen -
Rui Anastácio -
Stefan Manegold