March 2017 - users-list

weird mserver startup failure on windows
by Anthony Damico 16 Mar '17

16 Mar '17

hi, i am trying to test something with this version of mserver on windows: http://monetdb.cwi.nl/testweb/web/63169:4438fea68169/MonetDB5-SQL-Installer… it installed fine, but when i load up an mserver session, it says: # MonetDB 5 server v11.26.0 "default-4438fea68169" # Serving database 'demo', using 8 threads # Compiled for x86_64-pc-winnt/64bit # Found 15.914 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2017 MonetDB B.V., all rights reserved # Visit http://www.monetdb.org/ for further information !SyntaxException:parseError: !LoaderException:loadLibrary:Loading error failed to open library pyapi (from within file 'C:\Program Files\MonetDB\MonetDB5\lib\monetdb5\lib_pyapi.dll'): The specified module could not be found. !SyntaxException:parseError: !<identifier> expected > and then if i click on the window, it disappears. if i try to connect to an mserver session through MonetDB.R, the mserver window repeats these two lines forever: # SQL catalog created, loading sql scripts once # loading sql script: 09_like.sql here's a screenshot: http://tinypic.com/r/s6rtjd/9 any ideas about what i should try? maybe installing python? but i've never had to do so before, so maybe i'm doing something else dumb.. thanks!

2 3

Checking for a table's existence from a Python connection. (mapi ? sql?)
by Omri Schwarz 13 Mar '17

13 Mar '17

Hi, all. I’m trying to add a MonetDB interface to VoltTron, a Python based server for building and energy management systems. To that end I have to be able to use some of the mclient commands from it, for example, to check if a table exists (\d ), from Python. IIUC, monetdb.mapi.Connection objects should enable me to do that, but I have no idea how. A second question is about performance. The existing databse schema for this product looks like this in MonetDB: CREATE TABLE "voc"."data_test" ( "ts" TIMESTAMP(3) NOT NULL, "topic_id" INTEGER NOT NULL, "value_string" CHARACTER LARGE OBJECT NOT NULL, CONSTRAINT "data_test_topic_id_ts_unique" UNIQUE ("topic_id", "ts") ); There’s a time stamp and topic ID, and SELECT queries are almost always for a narrow range in time, and a small set of topic IDs (usually a set of one). The “value_string” is there because values in the topics can range in type, but are almost always floats. Can I expect MonetDB’s performance to be good For this use case? Or should I force the value_string to a float?

2 1

monetdb to remote monetdbd makes fun of me
by Roberto Cornacchia 09 Mar '17

09 Mar '17

I'm running a dbfarm on a remote server serverX The dbfarm has been created this way (passphrase changed): monetdbd create /var/lib/monetdb/dbfarm monetdbd set control=yes /var/lib/monetdb/dbfarm monetdbd set port=50000 /var/lib/monetdb/dbfarm monetdbd set listenaddr=0.0.0.0 /var/lib/monetdb/dbfarm monetdbd set passphrase=roberto /var/lib/monetdb/dbfarm Port 50000 is open. >From another machine on the same subnet, I request a status: $ monetdb -hserverX -p50000 -Proberto status status: =OK It does connect (using a different port gives a connection refused). However, it just acknowledges the command, without performing it. Whatever command I try, it behaves the same: $ monetdb -hserverX -p50000 -Proberto create x create: =OK $ monetdb -hserverX -p50000 -Proberto create x create: =OK Notice that the second one should have failed. This confirms that the commands are not executed at all. I have had this issue for a long time, it's nothing new. I just never asked before, because I normally solve it with ssh tunneling a port and using it locally. In this case, I cannot use this. Am I missing something, or is it a bug? Roberto

2 2

on windows, is it possible to limit the amount of RAM available to mserver.exe?
by Anthony Damico 04 Mar '17

04 Mar '17

https://www.monetdb.org/Documentation/mserver5-man-page makes it look like i should be able to do this, but i have tried a few different things and none of them have worked. in the mserver window, i just want this line to be reduced to 50MB or something very small. # Found 15.913 GiB available main-memory. mserver window: # MonetDB 5 server v11.25.5 "Dec2016-SP1" # Serving database 'mydb', using 8 threads # Compiled for x86_64-pc-winnt/64bit # Found 15.913 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2017 MonetDB B.V., all rights reserved # Visit http://www.monetdb.org/ for further information # Listening for connection requests on mapi:monetdb://127.0.0.1:50001/ # MonetDB/SQL module loaded here's what my database.bat file looks like: @echo off setlocal set MONETDB=C:\Program Files\MonetDB\MonetDB5 set PATH=%MONETDB%\bin;%MONETDB%\lib;%MONETDB%\lib\MonetDB5;%PATH% "%MONETDB%\bin\mserver5.exe" --daemon=yes --set "prefix=%MONETDB%" --set "exec_prefix=%MONETDB%" "--dbpath=C:\Users\damico\AppData\Local\Temp\RtmpgBoQzw\mydb" %* --set mapi_port=50001 if ERRORLEVEL 1 pause endlocal thanks!

1 0

merovingian.log too verbose?
by Roberto Cornacchia 03 Mar '17

03 Mar '17

Is there a way to make monetdbd a bit quieter? In a setting with many connections, it quickly becomes several GB of this: 2016-03-01 10:25:03 MSG merovingian[94243]: proxying client localhost:52272 for database 'xxx' to mapi:monetdb:///var/lib/monetdb/dbfarms/yyy/xxx/.mapi.sock?database=xxx 2016-03-01 10:25:03 MSG merovingian[94243]: target connection is on local UNIX domain socket, passing on filedescriptor instead of proxying

2 4

Announcement: New Dec2016-SP2 Bugfix release of MonetDB suite
by Sjoerd Mullender 03 Mar '17

03 Mar '17

The MonetDB team at CWI/MonetDB BV is pleased to announce the Dec2016-SP2 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Dec 2016-SP2 bugfix release Bug Fixes * 4034: argnames array in rapi.c has fixed length (that was too short) * 6080: mserver5: rel_bin.c:2391: rel2bin_project: Assertion `0' failed. * 6081: Segmentation fault (core dumped) * 6082: group.subgroup is undefined if group by is used on an expression involving only constants * 6111: Maximum number of digits for hge decimal is listed as 39 in sys.types. Should be 38 as DECIMAL(39) is not supported. * 6112: Crash upgrading Jul2015->Jun2016 * 6130: Query rewriter crashes on a NULL pointer when having a correlated subquery * 6133: A crash occurs when preparing an INSERT on joined tables during the query semantic phase * 6141: Getting an error message regarding a non-GROUP-BY column rather than an unknown identifier * 6177: Server crashes * 6186: Null casting causes no results (silent server crash?) * 6189: Removing a NOT NULL constraint from a PKey column should NOT be allowed * 6190: CASE query crashes database * 6191: MT_msync failed with "Cannot allocate memory" * 6192: Numeric column stores wrong values after adding large numbers * 6193: converting to a smaller precision (fewer or no decimals after decimal point) should round/truncate consistently * 6194: splitpart returns truncated last part if it contains non ascii caracters * 6195: Cast from huge decimal type to smaller returns wrong results * 6196: Database crashes after generate_series query * 6198: COALESCE could be more optimized * 6201: MonetDB completely giving up on certain queries - no error and no result * 6202: querying a table with an ordered index on string/varchar column crashes server and makes server unrestartable! * 6203: copy into: Failed to import table Leftover data 'False' * 6205: Integer addition overflow * 6206: casting strings with more than one trailing zero ('0') to decimal goes wrong * 6209: Aggregation over complex OR expressions produce wrong results * 6210: Upgrading a database from Jun2015 or older crashes the server * 6213: SQLsmith causes server to crash * 6217: Segfault in rel_optimizer (sqlsmith) * 6218: grouped quantiles with all null group causes following groups to return null * 6224: mal_parser: cannot refer to types containing an underscore

1 0

monetdb.org system maintenance
by Sjoerd Mullender 01 Mar '17

01 Mar '17

Tomorrow, March 2, we will be upgrading the hardware for the system on which all monetdb.org infrastructure runs. Expect some downtime. -- Sjoerd Mullender

1 0

monetdb cluster
by 张馨匀 01 Mar '17

01 Mar '17

Hi all, Do you have any idea about the query throughput regarding monetdb cluster, is it slow? I created the monetdb cluster using remote table, when I do query, it's really slow, about 3sec/query. Do you know how to improve this? Or MonetDB can actually do better than this? And How? Thank you

3 2