users-list December 2012

users-list@monetdb.org

22 participants
23 discussions

by Percy Wegmann

Dear MonetDB Team, We're starting to exercise our MonetDB installation more heavily now and I've run into a strange issue where I get an occasional "COMMIT: failed" message. It seems that the conditions required to produce this are: - Concurrently inserting into two different tables - At the same time, issuing a SELECT COUNT(*) against either of those tables I've logged a bug with more detailed information, including a Java test case: http://bugs.monetdb.org/show_bug.cgi?id=3210 I'm only just starting my investigation, but I suspect that COUNT(*) may be the culprit, since other selects like SELECT * don't seem to have this problem. Does this ring any bells? Are there any special optimizations for COUNT(*) that bypass the underlying BAT and/or have side effects on some shared table somewhere that could be causing a concurrency violation? Thanks, -- Percy Wegmann +1 512 637 8500 ext 148 _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 6 months

c3p0 ConnectionTester socket read stuck after SQLException

by Tapomay Dey

Please find the thread dump below. Running MonetDB Database Server v1.6 (Oct2012-SP1). Compiled from MonetDB-11.13.5 src distribution. C3P0 version: 0.9.1.2. Also tried with 0.9.2. Occurs only after SQLException sometimes: INSERT INTO xyz : table xyz doesn't exist. Otherwise it works great. Also tried setting c3p0's preferredQuery for ConnectionTester to "select 1;". Problem persists. Name: pool-15-thread-2 State: RUNNABLE Total blocked: 0 Total waited: 1 Stack trace: java.net.SocketInputStream.socketRead0(Native Method) java.net.SocketInputStream.read(SocketInputStream.java:150) java.net.SocketInputStream.read(SocketInputStream.java:121) java.io.BufferedInputStream.fill(BufferedInputStream.java:235) java.io.BufferedInputStream.read1(BufferedInputStream.java:275) java.io.BufferedInputStream.read(BufferedInputStream.java:334) - locked java.io.BufferedInputStream@5cec5796 nl.cwi.monetdb.mcl.net.MapiSocket$BlockInputStream._read(MapiSocket.java:846) nl.cwi.monetdb.mcl.net.MapiSocket$BlockInputStream.readBlock(MapiSocket.java:895) nl.cwi.monetdb.mcl.net.MapiSocket$BlockInputStream.read(MapiSocket.java:965) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) - locked java.io.InputStreamReader@206a6883 java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:154) java.io.BufferedReader.readLine(BufferedReader.java:317) - locked java.io.InputStreamReader@206a6883 java.io.BufferedReader.readLine(BufferedReader.java:382) nl.cwi.monetdb.mcl.io.BufferedMCLReader.readLine(BufferedMCLReader.java:119) nl.cwi.monetdb.mcl.io.BufferedMCLReader.waitForPrompt(BufferedMCLReader.java:196) - locked nl.cwi.monetdb.mcl.io.BufferedMCLReader@29f38115 nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2296) - locked nl.cwi.monetdb.mcl.net.MapiSocket@319f9f37 nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:2274) nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:508) nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:349) nl.cwi.monetdb.jdbc.MonetStatement.executeQuery(MonetStatement.java:525) com.mchange.v2.c3p0.impl.DefaultConnectionTester.activeCheckConnection(DefaultConnectionTester.java:73) com.mchange.v2.c3p0.impl.DefaultConnectionTester.statusOnException(DefaultConnectionTester.java:143) com.mchange.v2.c3p0.AbstractConnectionTester.statusOnException(AbstractConnectionTester.java:82) com.mchange.v2.c3p0.impl.NewPooledConnection.handleThrowable(NewPooledConnection.java:437) - locked com.mchange.v2.c3p0.impl.NewPooledConnection@3340302c com.mchange.v2.c3p0.impl.NewProxyStatement.executeUpdate(NewProxyStatement.java:78) com.sokrati.moneta.mclient.JdbcMonetdbClient.executeUpdate(JdbcMonetdbClient.java:154) com.sokrati.moneta.multiplexer.MonetdbClientCallable.call(MonetdbClientCallable.java:46) com.sokrati.moneta.multiplexer.MonetdbClientCallable.call(MonetdbClientCallable.java:1) java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) java.util.concurrent.FutureTask.run(FutureTask.java:166) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) java.lang.Thread.run(Thread.java:722) Regards, Tapomay. _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 6 months

failed to fork mserver: database 'lwg' started up, but failed to open up a communication channel

by Przemyslaw Wroblewski

hello, I'm trying to evaluate monetdb but I've failed at the beginning of the tutorial: http://www.monetdb.org/Documentation/monetdbd When I'm trying ot start up database I've got following: $ monetdb start lwg starting database 'lwg'... FAILED start: starting 'lwg' failed: database 'lwg' started up, but failed to open up a communication channel and in merovingian.log: 2012-12-27 16:43:26 MSG merovingian[29552]: startup of database under maintenance 'lwg' forced 2012-12-27 16:43:26 MSG merovingian[29552]: starting database 'lwg', up min/avg/max: 1s/1s/1s, crash average: 0.00 0.00 0.00 (1-1=0) 2012-12-27 16:43:27 MSG merovingian[29552]: sending process 9489 (database 'lwg') the TERM signal 2012-12-27 16:43:27 MSG lwg[9489]: arguments: /usr/bin/mserver5 --set gdk_dbfarm=/var/lib/monetdb --dbname=lwg --set merovingian_uri=mapi:monetdb://przemtest1:50000/lwg --set mapi_open=false --set mapi_port=0 --set mapi_usock=/var/lib/monetdb/lwg/.mapi.sock --set monet_vault_key=/var/lib/monetdb/lwg/.vaultkey --set gdk_nr_threads=8 --set max_clients=64 --set sql_optimizer=default_pipe --set monet_daemon=yes 2012-12-27 16:43:27 MSG lwg[9489]: # MonetDB 5 server v11.13.7 "Oct2012-SP2" 2012-12-27 16:43:27 MSG lwg[9489]: # Serving database 'lwg', using 8 threads 2012-12-27 16:43:27 MSG lwg[9489]: # Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked 2012-12-27 16:43:27 MSG lwg[9489]: # Found 23.591 GiB available main-memory. 2012-12-27 16:43:27 MSG lwg[9489]: # Copyright (c) 1993-July 2008 CWI. 2012-12-27 16:43:27 MSG lwg[9489]: # Copyright (c) August 2008-2012 MonetDB B.V., all rights reserved 2012-12-27 16:43:27 MSG lwg[9489]: # Visit http://www.monetdb.org/ for further information 2012-12-27 16:43:27 MSG lwg[9489]: !TypeException:batcalc.rank_grp[3]:object code for command sql.rank_grp missing 2012-12-27 16:43:27 MSG lwg[9489]: !TypeException:batcalc.rank_grp[1]:object code for command sql.rank missing 2012-12-27 16:43:27 MSG lwg[9489]: !TypeException:batcalc.dense_rank_grp[3]:object code for command sql.dense_rank_grp missing 2012-12-27 16:43:27 MSG lwg[9489]: !TypeException:batcalc.dense_rank_grp[1]:object code for command sql.dense_rank missing 2012-12-27 16:43:27 MSG lwg[9489]: !TypeException:aggr.median[7]:object code for command sql.middle missing 2012-12-27 16:43:27 MSG lwg[9489]: #WARNING: LoaderException:loadLibrary:Loading error could not locate library lsst (from within file 'lsst') 2012-12-27 16:43:27 MSG lwg[9489]: !TypeException:user.main[1240]:object code for command sql.prelude missing 2012-12-27 16:43:27 MSG lwg[9489]: !TypeException:user.main[1240]:'sql.prelude' undefined in: _1240:void := sql.prelude() 2012-12-27 16:43:27 MSG merovingian[29552]: database 'lwg' (9489) has exited with exit status 0 2012-12-27 16:43:27 MSG merovingian[29552]: database 'lwg' has shut down 2012-12-27 16:43:27 ERR control[29552]: (local): failed to fork mserver: database 'lwg' started up, but failed to open up a communication channel I'm on 64bit debian 6.0.4 in vserver container. It looks like exactly as http://bugs.monetdb.org/show_bug.cgi?id=3134 but I've latest version which should this bug already fixed. best regards Przemek _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 7 months

Fwd: Enhance Performance

by Arjun Harish

I am bench-marking monetDB against some other databases. I have a system with intel i-7 processor, 32GB Ram and 2 TB Harddisk on a Ubuntu 12.10 system. I have a data work load of 700 GB in monetdb now. How can i enhance the performance and speed up the querying process. Any Suggestions would we welcome and please reply in detail. I am a newbie to Monetdb. Arjun Data Scientist -- Arjun Harish Nadh Data Scientist Flutura Business Solutions Pvt. Ltd. +919972736428 arjun.harish(a)fluturasolutions.com _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 7 months

MonetDB Update: some problems while updating

by Miguel Ping

Hi all, We tried to update monetdb to the latest version, but encountered some problems. The prev version is working just fine. We're using Debian, and installed from the debs. See the log below. lsb_release -a No LSB modules are available. Distributor ID: Debian Description: Debian GNU/Linux 6.0.4 (squeeze) Release: 6.0.4 Codename: squeeze ... 2012-12-26 11:43:42 MSG kpi_v1[13255]: # MonetDB 5 server v11.13.7 "Oct2012-SP2" 2012-12-26 11:43:42 MSG kpi_v1[13255]: # Serving database 'kpi_v1', using 24 threads 2012-12-26 11:43:42 MSG kpi_v1[13255]: # Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked 2012-12-26 11:43:42 MSG kpi_v1[13255]: # Found 23.587 GiB available main-memory. 2012-12-26 11:43:42 MSG kpi_v1[13255]: # Copyright (c) 1993-July 2008 CWI. 2012-12-26 11:43:42 MSG kpi_v1[13255]: # Copyright (c) August 2008-2012 MonetDB B.V., all rights reserved 2012-12-26 11:43:42 MSG kpi_v1[13255]: # Visithttp://www.monetdb.org/ for further information 2012-12-26 11:43:42 MSG kpi_v1[13255]: !TypeException:batcalc.rank_grp[3]:object code for command sql.rank_grp missing 2012-12-26 11:43:42 MSG kpi_v1[13255]: !TypeException:batcalc.rank_grp[1]:object code for command sql.rank missing 2012-12-26 11:43:42 MSG kpi_v1[13255]: !TypeException:batcalc.dense_rank_grp[3]:object code for command sql.dense_rank_grp missing 2012-12-26 11:43:42 MSG kpi_v1[13255]: !TypeException:batcalc.dense_rank_grp[1]:object code for command sql.dense_rank missing 2012-12-26 11:43:42 MSG kpi_v1[13255]: !TypeException:aggr.median[7]:object code for command sql.middle missing 2012-12-26 11:43:42 MSG kpi_v1[13255]: #WARNING: LoaderException:loadLibrary:Loading error could not locate library lsst (from within file 'lsst') 2012-12-26 11:43:42 MSG kpi_v1[13255]: !TypeException:user.main[1240]:object code for command sql.prelude missing 2012-12-26 11:43:42 MSG kpi_v1[13255]: !TypeException:user.main[1240]:'sql.prelude' undefined in: _1240:void := sql.prelude() 2012-12-26 11:43:42 MSG merovingian[13238]: database 'kpi_v1' (13255) has exited with exit status 0 2012-12-26 11:43:42 MSG merovingian[13238]: database 'kpi_v1' has shut down 2012-12-26 11:43:42 ERR control[13238]: (local): failed to fork mserver: database 'kpi_v1' started up, but failed to open up a communication channel Thanks _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 7 months

UDF compilation

by Miguel Ping

What are the steps required to include additional .c and .h files in compiling user-defined functions? It was a long time since I used autotools and such; it seems to me that I would need to change the monetdb configuration files in order to regenerate the Makefile.* files within the UDF dir. My problem is that I require alot of code for my UDF, and right now I'm copy/paste'ing code to udf.c and udf.h; it would be easier to include additional .h and .c files for UDF compilation. Thanks _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 7 months

Announcement: New Oct2012-SP2 Bugfix release of MonetDB suite

by Sjoerd Mullender

The MonetDB team at CWI/MonetDB BV is pleased to announce the Oct2012-SP2 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Oct 2012-SP2 bugfix release SQL * Fixed crash when performing an INSERT on a table with string-like column defaulting to NULL and omitting that column from VALUES, bug #3168 Java Module * Implemented type map support of Connection to allow custom mapping of UDTs to Java classes. By default the INET and URL UDTs are now mapped to nl.cwi.monetdb.jdbc.types.{INET,URL}. Most notably, ResultSet.getObject() and PreparedStatement.setObject() deal with the type map. * Fixed a problem in PreparedStatement where the prepared statement's ResultSetMetaData (on its columns to be produced) incorrectly threw exceptions about non existing columns. Bug #3192 Bug Fixes * 2291: small doubles end up as NULL after arithmetic * 2579: SQL: incorrect cast from double to int * 2659: tuples INTERSECT vs count (... INTERSECT ...) differs * 2805: row_number doesn't work in complex query * 2886: warning: Catalog parameter '' ignored * 2977: timestamp minus date results in program error * 2978: now() + 1 results in illegal argument * 2999: Up-cast from SQL drops order information? * 3048: algebra.join undefined when using multiple arithmetic operations in SQL where-clause * 3124: insert into table with two foreign keys crashes mserver5 * 3136: Memleak (in querycache?) while querying * 3143: Type resolution error in SQL procedural code * 3163: mserver5 crashes with large number of concurrent clients * 3168: crash when insert varchar/char/clob with default NULL * 3169: php driver uses call-time pass-by-reference * 3173: SQL queries with limit and offset clauses are unable to use bind parameters for either * 3181: Join query returns zero results when there is an index on the tables * 3185: inconsistency between documentation and implementation of command line options * 3186: case evaluted to early * 3188: Storage of client history * 3189: Overflow in calculation * 3190: When subtracting two columns of type "timestamp", no results are returned * 3191: rel_optimizer.c:5596: _rel_optimizer: Assertion `0' failed. * 3192: "No such column with index" error if CASE in SELECT clause * 3199: Inconspicuous sequence of prepare, execute, commit and close produces error * 3205: Inet datatype handling inconsistent between int, cast( as inet) and string _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 7 months

OLTP Benchmark on Monetdb

by Hassan, Ahmad

Hi Team, I am trying to run TPC-C benchmark provided by opensource oltpbenchmark (http://oltpbenchmark.com) on MonetDB. But I am getting JDBC Exception while loading the data set: java.sql.BatchUpdateException: Error(s) occurred while executing the batch, see next SQLExceptions for details at nl.cwi.monetdb.jdbc.MonetStatement.executeBatch(MonetStatement.java:209) Exception in thread "main" java.lang.ArithmeticException: / by zero at com.oltpbenchmark.benchmarks.tpcc.TPCCLoader.load(TPCCLoader.java:1857) Please can you let me know any TPC-C benchmark implementation that is compatible with monetdb? Thanks. Kind Regards, Ahmad _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 7 months

MonetDB compiling with CLANG/LLVM

by Hassan, Ahmad

Hi, I want to ask if someone has tried compiling MonetDB with Clang/LLVM compiler? I intend to compile MonetDB with LLVM for analysing the query execution at runtime. Does someone know the changes in the build process required for building Monetdb with clang/llvm? Thanks. Cheers, Ahmad _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 7 months

Unable to execute prepared statements with a large number of parameters (say over 140 or so)

by Percy Wegmann

I couldn't find any existing bugs that cover this, so I logged a new one: http://bugs.monetdb.org/show_bug.cgi?id=3208 This is kind of a show-stopper for me right now, so I'm hoping that someone might have some idea where to start looking for a solution. I'm debugging sql_scenario.c right now, but it'll take me some time to get familiar with the code. Cheers, -- Percy Wegmann +1 512 637 8500 ext 148 _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

9 years, 7 months

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

users-list December 2012