users-list September 2015

users-list@monetdb.org

25 participants
29 discussions

by Vijay Krishna

How to find all running processes and their statuses in MonetDB?? I found this... https://www.monetdb.org/Documentation/Cookbooks/SQLrecipes/monitor But I couldn't get this work... I ran a query (which took some 20 seconds to complete) in a window and connected the same database in another terminal and ran "select * from sys.queue" (several times during those 20 seconds) but I could get only this... sql>select * from sys.queue; +-------+---------+----------------------------+----------------------------+----------+---------+------------+--------------------------+ | qtag | user | started | estimate | progress | status | tag | query | +=======+=========+============================+============================+==========+=========+============+==========================+ | 27339 | monetdb | 2015-08-13 05:35:40.000000 | null | null | running | 12532134@0 | select * from sys.queue; | +-------+---------+----------------------------+----------------------------+----------+---------+------------+--------------------------+ I am using Oct-2014 version of monetdb on CentOS... Is there a way to find all running processes and their statuses in MonetDB?? Thanks & Regards, Vijayakrishna.P. Mobile : (+91) 9500402305.

6 years, 3 months

overloaded ram on windows

by Anthony Damico

hi, this is just a general request for the awesome folks at cwi: could you give some serious thought to optimizing ram usage on windows? this happens to me a lot, i end up just leaving these big joins to run overnight-- http://s30.postimg.org/saeo9ca7l/overloaded.png happy to write up some r-driven reproducible examples if there's willingness to combat these bottlenecks. thanks as always from your biggest fan.

6 years, 9 months

Transactions

by Doug Service

We use MonetDB extensively in an internal system we are developing. We initially had issues getting transactions working so we put it off to make progress in other areas. However we are at the point now were we need to have transactions working. The mapi documentation ( https://www.monetdb.org/Documentation/Manuals/SQLreference/Programming/MAPI) says the following about auto commit. MapiMsg mapi_setAutocommit(Mapi mid, int autocommit) Set the autocommit flag (default is on). This only has an effect when the language is SQL. In that case, the server commits after each statement sent to the server. I infered from this statement that using transactions requires setting auto commit to false. However, when I did that I received the following error when I tried to use transactions. MSERVER(25001!START TRANSACTION: cannot start a transaction within a transaction) If I did not disable auto commit, I did not receive any errors when using transactions, but I did not know if the transaction were actually working. After using hg to enlist in the MonetDb code and searching for the error I found this. str SQLtransaction2(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) { mvc *sql = NULL; str msg; (void) stk; (void) pci; if ((msg = getSQLContext(cntxt, mb, &sql, NULL)) != NULL) return msg; if ((msg = checkSQLContext(cntxt)) != NULL) return msg; if (sql->session->auto_commit == 0) throw(SQL, "sql.trans", "25001!START TRANSACTION: cannot start a transaction within a transaction"); if (sql->session->active) { RECYCLEdrop(cntxt); mvc_rollback(sql, 0, NULL); } sql->session->auto_commit = 0; sql->session->ac_on_commit = 1; sql->session->level = 0; (void) mvc_trans(sql); return msg; } which leads me to believe that one should not disable auto commit to use transaction as it appears to be auto disabled by the transaction code. My questions are: 1) Is the correct method of using transactions in MonetDb to leave the auto commit flag alone and just issue START TRANSACTION;, COMMIT;, and ROLLBACK; as needed? 2) If the answer to (1) is yes, is disabling auto commit, issuing updates, and then re enabling auto commit like a transaction? Doug Service

6 years, 9 months

How to install tachograph?

by Xu,Wenjian

Hi all, I have installed the latest Jul2015 release, and I would like to use the latest tools tachograph to determine the progress of query execution. But I do not know how to install it. My system is ubuntu 14.04. I have tried to use *sudo apt-get install monetdb-tools* but failed to locate the package *monetdb-tools*. Any idea would be helpful. Thanks. Best, XU Wenjian

6 years, 9 months

UUIDs in MonetDB

by Doug Service

The documentation at https://www.monetdb.org/Documentation/Manuals/SQLreference/UUItype indicates that a UUID type is supported in MonetDB and gives the example select uuid(); +--------------------------------------+ | uuid | +======================================+ | 65950c76-a2f6-4543-660a-b849cf5f2453 | +--------------------------------------+ which appears to output from mclient. When I try the same with mclient I receive auto commit mode: on sql>select uuid(); SELECT: no such operator 'uuid' mapi.h only shows support for the following types #define MAPI_AUTO 0 /* automatic type detection */#define MAPI_TINY 1#define MAPI_UTINY 2#define MAPI_SHORT 3#define MAPI_USHORT 4#define MAPI_INT 5#define MAPI_UINT 6#define MAPI_LONG 7#define MAPI_ULONG 8#define MAPI_LONGLONG 9#define MAPI_ULONGLONG 10#define MAPI_CHAR 11#define MAPI_VARCHAR 12#define MAPI_FLOAT 13#define MAPI_DOUBLE 14#define MAPI_DATE 15#define MAPI_TIME 16#define MAPI_DATETIME 17#define MAPI_NUMERIC 18 Is it possible to get MonetDB to generate UUIDs and how is the type supported in mapi. Thanks Doug Service

6 years, 10 months

COPY INTO string attribute containing single quote, succeed in Jan2014-SP2, fail in Jul2015

by Constantine Feng

Dear all, I am trying to bulk load the TPC-DS database benchmark into MonetDB. One of the data file "customer.csv" contains data in this format: 27|AAAAAAAALBAAAAAA|111621|835|16096|2450611|2450581|Dr.|Shawn|Prather|N|7|3|1972|PUERTO RICO||Shawn.Prather(a)8BusRYegn6.org|2452353 28|AAAAAAAAMBAAAAAA|889961|897|183480|2452615|2452585|Miss|Edith|Hernandez|Y|17|8|1959|CÔTE D'IVOIRE||Edith.Hernandez(a)BNHL0k.com|2452631 Note in the second row, there is a string attribute containing a single quote. And I use the below command to load it: COPY INTO customer from 'path/to/customer.csv' USING DELIMITERS '|','\n' NULL AS ''; I have two machines with two installations: one installed last year via Ubuntu apt-get, "monetdb version" shows "MonetDB Database Server Toolkit v1.1 (Jan2014-SP2)" the other recently follows the instructions here: https://www.monetdb.org/downloads/deb/ (Ubuntu), "MonetDB Database Server Toolkit v1.1 (Jul2015)" Somehow the loading succeeded in the former but failed in the latter. Is it due to some version difference? How can I fix it? Error: field 15 expecting varchar(15) 'CÔTE D'IVOIRE' Thanks in advance. - Neo

6 years, 10 months

Strange characters with ODBC driver

by Dennis Pallett

Hi all, We're trying to use MonetDB together with SAP Business Objects using the ODBC driver but we're getting some strange results when using the table browser. The names of the schema's seem to be all mangled up (see attached screenshot). Any ideas what might be wrong? It works fine with the JDBC driver btw. Any advantages/disadvantages with both drivers? Best regards, Dennis Pallett

6 years, 10 months

Version vs release naming schemes

by Eyal Rozenberg

What's the relation between the Month+Year release naming scheme (e.g. Jul2015, Oct2014-SP2) and the numeric versions (e.g. 11.19.9)? The website has a release history page: https://www.monetdb.org/Documentation/UserGuide/ReleaseNotes But I haven't found a page discussing the numeric version numbers. I'm not even sure the X.Y.Z format means version.subversion.subsubversion ... Eyal

6 years, 10 months

Jul2015 not availbale for debian Wheezy

by imad hajj chahine

Hi, I am trying to upgrade my installation on debian from 11.19 to 11.21, i cant find the Jul2015 in the https://www.monetdb.org/downloads/deb/dists/wheezy/monetdb/binary-amd64/ and the apt-get is pointing to the 11.19.15 version, any idea how to get the latest release. Thank you

6 years, 10 months

Issue importing certain character combinations

by andy.barlow＠datum360.com

I filed a bug earlier, the gist of which is below but perhaps there is some setting or flag I am missing when importing? If your import file contains a number of character combinations, such as \560, \561, \700 and probably lots of others, the copy into fails with a message like: Failed to import table line 5 field 1 'varchar(20)' expected in 'FIVE\700' Reproducible: Always Steps to Reproduce: 1. create table test (test varchar(20)); 2. create a load file test.txt with the following: ONE TWO THREE FOUR FIVE\700 3. copy into test from 'test.txt' using delimiters '\t','\n'; 4. fails with message: Failed to import table line 5 field 1 'varchar(20)' expected in 'FIVE\700' Actual Results: Failed to import table line 5 field 1 'varchar(20)' expected in 'FIVE\700' Expected Results: should import OK, the character combinations are valid Andy Barlow Datum360

6 years, 10 months

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

users-list September 2015