March 2013 - users-list

[MonetDB-users] Proofreading your professional documents
by Richard Hounslow 24 Feb '24

24 Feb '24

Dear Professor/Lecturer Please excuse us for contacting you directly. We are offering an efficient service to help you ensure your academic and professional work is written in perfect English. We will check the grammar and style of your work and return it to you to meet your requirements and deadlines. Proof-Reading-Service.com can provide you with a professional proofreading service at a very reasonable rate. All our proofreaders are highly qualified native English speakers. Many work as leading academics in their fields and all have extensive experience of proofreading to the highest standards. If you are interested in our service, please take a look at our website: www.proof-reading-service.com All you have to do is send us your document as a word attachment with the deadline and we will guarantee delivery of a perfectly written document to give you complete confidence when you submit your work. The fee is worked out on a flat rate (£6.95 per thousand words or 0.695 pence per word), so you know exactly how much the proofreading will cost in advance. Once we have received your document(s) we will confirm the word count, the price and the deadline. If you have not heard from us within 2 hours during normal business hours after you have sent your work please resend it from a different email account or send the file to proofreadings(a)gmail.com. We look forward to hearing from you! Yours faithfully Proof-Reading-Service.com

2 2

select + group by expression alias from a view breaks connection
by Budulinku Dejmihrasku 29 Mar '13

29 Mar '13

Hi, i hit a strange problem when using alias for an expression in group by i run into this with a complex view containing multiple UNION ALL queries but after a while everything boiled down to a fairly simple test case that will always produce the error Welcome to mclient, the MonetDB/SQL interactive terminal (Feb2013-SP1) Database: MonetDB v11.15.3 (Feb2013-SP1), 'mapi:monetdb://lux-analytics:50000/zkdev1' Type \q to quit, \? for a list of available commands auto commit mode: on sql>CREATE VIEW mmtest_v AS SELECT date'2012-01-01' as period, 1 as quantity; operation successful (213.074ms) sql>SELECT extract(month from period) as m, count(1) as cnt FROM mmtest_v GROUP BY m; *Connection terminated* I am on Ubuntu 12.04.2 LTS As the alias in GROUP BY works in other cases i expect this is a bug - pls confirm and i will be happy to file it. BTW it looks like MonetDB has generally issues with selects from more complex views - i.e. views based on another view(s). In such cases the results do not match expectations or there is even an error. I can reproduce the problem but i only on quite large set of data (typically 20+ mil. records) and after some data manipulation got involved, so i cannot give a simple test case as above. Any idea how to pass such problem (when large data-set is involved) to the development team? Thanks in advance milan

3 3

RAM consumption of MonetDB
by Hassan, Ahmad 27 Mar '13

27 Mar '13

Hi Team, Please may I ask what main memory management strategy has been adopted for MonetDB in terms of memory utilization. For example I loaded the TPCH benchmark dataset in MonetDB (v11.13.5) with scale factor 40. The data on disk is 43Gb in size. But when I run the TPCH queries then the main memory used by mserver stays in the range of 0.5GB to 3GB. I was thinking that the monetDB would load the tables into memory because TPCH queries are doing joins over various tables but it seems that monetdb loads only small subset of the complete dataset. Please can someone explain what is going in the background and why I always see 0.5GB to 3GB memory resident size of mserver process even for dataset of size 43G and if this is the normal expected behaviour of monetdb? The farm size on disk is: farms/f1/db1/bat# du . -hs 48G . Thanks. Kind Regards, Ahmad

3 5

Re: Quickstart Guide
by Stefan Manegold 20 Mar '13

20 Mar '13

Sterling, Thanks for notifing! Could you please file a bug report via http://bugs.monetdb.org/ ? Thanks! Stefan Sterling Paramore <gnilrets(a)gmail.com> wrote: The link at http://www.monetdb.org/Downloads/Tutorial is broken and I don't see any way to contact the creators of the web page. How can I get information about how to install MonetDB? Thanks, Sterling

4 4

Re: Quickstart Guide
by Stefan Manegold 20 Mar '13

20 Mar '13

Sterling, did you start the monetdb daemon (monetdbd), first? See also http://www.monetdb.org/Documentation/monetdbd Stefan Sterling Paramore <gnilrets(a)gmail.com> wrote: Thanks, but I'm not terribly interested in building from source. These installation instructions seem to end after it's compiled. I downloaded the binaries for OS X and put them in /usr/local/monetdb, and added /usr/local/monetdb/bin to my PATH. I found http://www.monetdb.org/Documentation/Tutorial (which is maybe supposed to be the same thing as the broken link?) But when I try the first step, I get the following error: [- opt -] monetdb create /opt/monetdb monetdb: cannot find a control socket, use -h and/or -p Google was not helpful. Any ideas? Thanks, Sterling On Tue, Mar 19, 2013 at 6:52 PM, Hassan, Ahmad <ahmad.hassan(a)sap.com> wrote: > HI Sterling,**** > > ** ** > > Installation from source can be seen at: > http://www.monetdb.org/wiki/MonetDB:Building_from_sources**** > > ** ** > > Cheers, Ahmad**** > > ** ** > > *From:* users-list-bounces+ahmad.hassan=sap.com(a)monetdb.org [mailto: > users-list-bounces+ahmad.hassan=sap.com(a)monetdb.org] *On Behalf Of *Sterling > Paramore > *Sent:* 20 March 2013 01:49 > *To:* users-list(a)monetdb.org > *Subject:* Quickstart Guide**** > > ** ** > > The link at http://www.monetdb.org/Downloads/Tutorial is broken and I > don't see any way to contact the creators of the web page. How can I get > information about how to install MonetDB?**** > > ** ** > > Thanks,**** > > Sterling**** > > _______________________________________________ > users-list mailing list > users-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/users-list > >

1 0

Quickstart Guide
by Sterling Paramore 20 Mar '13

20 Mar '13

The link at http://www.monetdb.org/Downloads/Tutorial is broken and I don't see any way to contact the creators of the web page. How can I get information about how to install MonetDB? Thanks, Sterling

2 2

Performance of PHP client > fetching rows
by Richard Siebeling 18 Mar '13

18 Mar '13

Hi, I querying my database using a script in PHP and returning the result as a JSON (so that it can be retrieved in Javascript). However I notice that querying the database (sending the query to the database) takes about half the time if takes PHP to retrieve the rows (row by row using monetdb_fetch_object). In the documentation I see that the MAPI interface has a fetch_all_rows function, however I can't find this function in the PHP library. In the Python example I see that you are also using a cursor.fetchall() procedure. What is the best way to approach this problem > querying the database and returning all rows as a JSON object Is PHP the way to go (it is the easiest for me, since I know that), if it is, what is the best way or should I consider another language like Python or maybe Java to implement this function? Below I list the PHP code I see that send the query ($q_statement) to the database and formulating the JSON: // Measure time $time_end = microtime(true); $execution_time = ($time_end - $time_start); //dividing with 60 will give the execution time in minutes other wise seconds error_log($execution_time.'sec - Formulate query'); $time_start = microtime(true); $db = monetdb_connect($lang = "sql", $host = "127.0.0.1", $port = "50000" , $username = "monetdb", $password = "monetdb", $database = "social" ) or die(monetdb_last_error()); $res = monetdb_query($db, monetdb_escape_string($q_statement)); // Measure time $time_end = microtime(true); $execution_time = ($time_end - $time_start); //dividing with 60 will give the execution time in minutes other wise seconds error_log($execution_time.'sec - Query database'); $time_start = microtime(true); /* Iterate over the result set returning rows as objects */ while ( $row = monetdb_fetch_object($res) ) { $rows[] = $row; } echo json_encode($rows); // Measure time $time_end = microtime(true); $execution_time = ($time_end - $time_start); //dividing with 60 will give the execution time in minutes other wise seconds $total_execution_time = ($time_end - $initial_start); error_log($execution_time.'sec - Return records'); error_log($total_execution_time.'sec - Total time'); $time_start = microtime(true); thanks in advance, Richard

2 1

Single Quotes VS Double Quotes
by Diethard Steiner 17 Mar '13

17 Mar '13

Hi, I ran into a problem when setting up a user with single quotes: sql>CREATE USER 'tpch' WITH PASSWORD 'tpch' NAME 'TPC-H Admin' SCHEMA 'sys'; syntax error, unexpected STRING in: "create user 'tpch'" Then I followed exactly the quatation style of the voc example and it worked: sql>CREATE USER "tpch" WITH PASSWORD 'tpch' NAME 'TPC-H Admin' SCHEMA "sys"; operation successful (3.663ms) So now with user and schema enclosed in double quotes, password and name in single quotes, it worked. This inconsistent usage of single and double quotes seems a bit strange to me. Should I file a bug report for this? Or is there a specific reason for this? As a final test I enclosed all values in double quotes: sql>CREATE USER "test2" WITH PASSWORD "test2" NAME "Test User 2" SCHEMA "sys"; syntax error, unexpected IDENT, expecting STRING in: "create user "test2" with password "test2"" Thanks, Diethard

2 2

Extract quarter from date
by Diethard Steiner 17 Mar '13

17 Mar '13

Hi, When I run this: SELECT DISTINCT(EXTRACT(QUARTER FROM o_orderdate)) FROM orders; I get following error: Error: syntax error, unexpected IDENT in: "select distinct(extract(quarter" SQLState: 42000 ErrorCode: 0 Is Quarter not supported or is this a bug? Extract Year, month, day are all working fine. Environment: RHEL (Amazon Linux), Latest version of MonetDB compiled from source code. Thanks, Diethard

4 6

Connecting Tableau to MonetDB
by Pedro Salgueiro 15 Mar '13

15 Mar '13

Hi, I am trying to connect Tableau to a MonetDB instance which is running in a linux machine, using the ODBC MonetDB driver. Tableau manages to connect to MonetDB and is able to list the tables, but then it fails with the following error while performing any Analysis: [MonetDB][ODBC Driver 11.13.9] Invalid identifier 'none:product:nk' > I tried two versions of the ODBC, the latest and Oct2012-SP, but the problem is present in both versions. It's worth pointing that I am able to use the same MonetDB with the JDBC with no problems. <http://dev.monetdb.org/downloads/Windows/Oct2012-SP3/> While googling for this particular problem, I found the following mail in the mailing list: http://mail.monetdb.org/pipermail/users-list/2011-November/005248.html Has there been any developments in this field? Best regards, Pedro Salgueiro

2 1

standard deviation in SQL
by Anshuman Kumar 15 Mar '13

15 Mar '13

Hi, I'm trying to find an aggregate function to find standard deviation. Does monetDB support such a function? For example:- to find the average of the selected values we can use- Select AVG(age) from students where grade = 4; I was taking the help of google and found this link- http://old.nabble.com/users-list-Digest,-Vol-3,-Issue-8-td34660082.html Then I tried the solution given by Percy Wegmann in the above link. After that when I run this query- Select STDEV(age) from students where grade = 4; [Age being a column of type double AND I get similar kind of error for int] I get this error - TypeException:user.s1_1[21]:'aggr.stddev' undefined in: _33:any := aggr.stddev(_ 32:bat[:oid,:dbl]) program contains errors I need to have this function working in order to be able to use MonetDB. Kindly help. Regards, Anshuman

3 4

stddev function disappeared?
by Anthony Damico 14 Mar '13

14 Mar '13

Hello, I'm trying to run some old code with a recent upgrade of MonetDB and the standard deviation function appears to have disappeared. I'm running MonetDB on Windows. This issue was previously discussed and resolved in this thread: http://old.nabble.com/users-list-Digest%2C-Vol-3%2C-Issue-8-tt34660082.html… I could re-open this bug report if appropriate? http://bugs.monetdb.org/show_bug.cgi?id=2454#c18 My server specs are below, and the actual commands below that. Thank you!!! # MonetDB 5 server v11.15.1 "Feb2013" # Serving database 'bsapuf', using 8 threads # Compiled for x86_64-pc-winnt/64bit with 64bit OIDs dynamically linked # Found 7.860 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2013 MonetDB B.V., all rights reserved # Visit http://www.monetdb.org/ for further information # Listening for connection requests on mapi:monetdb://127.0.0.1:50003/ # MonetDB/JAQL module loaded # MonetDB/SQL module loaded > c:\Program Files\MonetDB\MonetDB5>mclient -p 50003 "bsapuf" user(win32):monetdb password: Welcome to mclient, the MonetDB/SQL interactive terminal (Feb2013) Database: MonetDB v11.15.1 (Feb2013), 'bsapuf' Type \q to quit, \? for a list of available commands auto commit mode: on sql>select sum( hha_pmt_amt ) from hha08; +-----------+ | L1 | +===========+ | 675676300 | +-----------+ 1 tuple (2.311ms) sql>select sum( hha_pmt_amt ), avg( hha_pmt_amt ) from hha08; +-----------+--------------------------+ | L1 | L2 | +===========+==========================+ | 675676300 | 5412.8151310993435 | +-----------+--------------------------+ 1 tuple (63.559ms) sql>select sum( hha_pmt_amt ), median( hha_pmt_amt ) from hha08; +-----------+------+ | L1 | L2 | +===========+======+ | 675676300 | 3500 | +-----------+------+ 1 tuple (9.601ms) sql>select sum( hha_pmt_amt ), stddev( hha_pmt_amt ) from hha08; SELECT: no such unary operator 'stddev(int)' sql>select sum( hha_pmt_amt ), sd( hha_pmt_amt ) from hha08; SELECT: no such unary operator 'sd(int)' sql>select sum( hha_pmt_amt ), sddev( hha_pmt_amt ) from hha08; SELECT: no such unary operator 'sddev(int)' sql>select sum( hha_pmt_amt ), var( hha_pmt_amt ) from hha08; SELECT: no such unary operator 'var(int)' sql>select sum( hha_pmt_amt ), variance( hha_pmt_amt ) from hha08; SELECT: no such unary operator 'variance(int)' sql>select sum( hha_pmt_amt ), stdevp( hha_pmt_amt ) from hha08; SELECT: no such unary operator 'stdevp(int)' sql>

3 4

SQL function for getting the last inserted ID
by Gijs Molenaar 12 Mar '13

12 Mar '13

Hi, A typical question that is probably asked before, but I can't find an answer in the archives or in the doc. Is there a SQL function for getting the last inserted ID for a auto increment or serial field? PostgreSQL has lastval(). I know it is returned in the query result, but I need to have the value inside a SQL function. Also I know that if you manually create a sequence for ID generation you can get the next value with: SELECT NEXT VALUE FOR seq_freq INTO freqid; But we are trying to keep our queries as generic as possible (close to impossible, but still) hence we want to use the SERIAL type. Or is there a way to find out what is the name of the sequence made when giving a SERIAL type to a column? thanks, -- Gijs Molenaar http://www.astro.uva.nl/people/gijs-molenaar/

3 3

Insertion problem for large number of columns
by Shajon 12 Mar '13

12 Mar '13

Dear Monet Team, Today I was trying to insert data in MonetDB using " insert into ." command through jdbc from my application but the server is crashing & no data is inserting. That table has 25 columns and I am passing all values. Thanks Shajon

5 6

Questions
by Bouslah Ahmed 10 Mar '13

10 Mar '13

Hi, I am a university student and I use MonetDB. I have two questions to ask you regarding loading data using mclient: 1 - Is it possible to load multiple csv files into multiple tables in one query? For exemple i have five csv files and five tables and I want to use a single command line instead of five mclient -u us1 -d demo -s " COPY INTO DWDATE FROM STDIN USING DELIMITERS '|','\n'" - <F:\2Go\DATE.tbl mclient -u us1 -d demo -s " COPY INTO CUSTOMER FROM STDIN USING DELIMITERS '|','\n'" - <F:\2Go\CUSTOMER.tbl mclient -u us1 -d demo -s " COPY INTO SUPPLIER FROM STDIN USING DELIMITERS '|','\n'" - <F:\2Go\SUPPLIER.tbl mclient -u us1 -d demo -s " COPY INTO PART FROM STDIN USING DELIMITERS '|','\n'" - <F:\2Go\PART.tbl mclient -u us1 -d demo -s " COPY INTO LINEORDER FROM STDIN USING DELIMITERS '|','\n'" -<F:\2Go\LINEORDER.tbl 2 - Is it possible to enter the password in the request as well as user and database name? This will save me introduce each time the password For exemple mclient -u us1 -d demo -s " COPY INTO DWDATE FROM STDIN USING DELIMITERS '|','\n'" - <F:\2Go\DATE.tbl <PassWord> thank you.

1 0

Parse dates in CSV file, CSV vault
by Aubrey Barnard 10 Mar '13

10 Mar '13

MonetDB Users, Is YYYY-MM-DD the only date format that can be parsed and read from a CSV with the COPY command? Or can the format be specified? On a related note, is the CSV vault feature ready for use (Feb2013 version)? The mailing list implies it is not ready and there is nothing in the release notes. If it is ready, how do I set it up? Thanks much for helping me get my data loaded. Aubrey Barnard

2 1

RE: Installation on Ubuntu 12.10 Quantal
by Duncan Garmonsway 10 Mar '13

10 Mar '13

Thanks, that worked. Didn't realise I was still such a noob... Cheers, Duncan On 10 March 2013 00:00, <users-list-request(a)monetdb.org> wrote: > Send users-list mailing list submissions to > users-list(a)monetdb.org > > To subscribe or unsubscribe via the World Wide Web, visit > http://mail.monetdb.org/mailman/listinfo/users-list > or, via email, send a message with subject or body 'help' to > users-list-request(a)monetdb.org > > You can reach the person managing the list at > users-list-owner(a)monetdb.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of users-list digest..." > > > Today's Topics: > > 1. INSERT INTO ... SELECT * FROM ... OFFSET X seems to leave > destination table in an inconsistent state (Percy Wegmann) > 2. Re: INSERT INTO ... SELECT * FROM ... OFFSET X seems to leave > destination table in an inconsistent state (Martin Kersten) > 3. Installation on Ubuntu 12.10 Quantal (Duncan Garmonsway) > 4. Re: Installation on Ubuntu 12.10 Quantal (Brandon Jackson) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 8 Mar 2013 10:22:53 -0600 > From: Percy Wegmann <percy(a)clicksecurity.com> > To: Communication channel for MonetDB users <users-list(a)monetdb.org> > Subject: INSERT INTO ... SELECT * FROM ... OFFSET X seems to leave > destination table in an inconsistent state > Message-ID: > < > CADpZG+Scab3V8u_isKziJobUgCYO4BEmkCWMB8iOD-pjggTWQQ(a)mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Dear Monet Team, > > Today I ran into an issue with copying data between tables. I've tried it > on 11.13.7 and 11.13.9 with the same results. What I find is that when > including an OFFSET clause in my source query, the destination table ends > up in a weird state. > > I've logged a bug for it - http://bugs.monetdb.org/show_bug.cgi?id=3249 > > I'm using the workaround of ordering my data and using a LIMIT instead of > an OFFSET, which seems to work. Just wanted to let you know. > > Thanks, > Percy >

1 0

Installation on Ubuntu 12.10 Quantal
by Duncan Garmonsway 09 Mar '13

09 Mar '13

Hello, After installation I am getting the error: $ monetdbd create ~/monetdb/ monetdbd: error while loading shared libraries: libstream.so.3: cannot open shared object file: No such file or directory But the library (and the symlink to it) are right here: $ ls -l /usr/local/lib | grep libstream -rwxr-xr-x 1 root root 943 Mar 9 14:23 libstream.la lrwxrwxrwx 1 root root 18 Mar 9 14:23 libstream.so -> libstream.so.3.1.5 lrwxrwxrwx 1 root root 18 Mar 9 14:23 libstream.so.3 -> libstream.so.3.1.5 -rwxr-xr-x 1 root root 107879 Mar 9 14:23 libstream.so.3.1.5 And there were no errors reported during any of ./configure sudo make sudo make install My installation script was: sudo apt-get install libxml2-dev bison ant flex unixODBC-dev # download and unpack source wget http://dev.monetdb.org/downloads/sources/Latest/MonetDB-11.15.3.tar.xz tar -xvf MonetDB-11.15.3.tar.xz # install cd MonetDB-11.15.3 ./configure sudo make sudo make install Help much appreciated, Duncan

2 1

INSERT INTO ... SELECT * FROM ... OFFSET X seems to leave destination table in an inconsistent state
by Percy Wegmann 08 Mar '13

08 Mar '13

Dear Monet Team, Today I ran into an issue with copying data between tables. I've tried it on 11.13.7 and 11.13.9 with the same results. What I find is that when including an OFFSET clause in my source query, the destination table ends up in a weird state. I've logged a bug for it - http://bugs.monetdb.org/show_bug.cgi?id=3249 I'm using the workaround of ordering my data and using a LIMIT instead of an OFFSET, which seems to work. Just wanted to let you know. Thanks, Percy

2 1

Announcement: New Feb2013-SP1 Bugfix release of MonetDB suite
by Sjoerd Mullender 07 Mar '13

07 Mar '13

The MonetDB team at CWI/MonetDB BV is pleased to announce the Feb2013-SP1 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Feb 2013-SP1 bugfix release Bug Fixes * 3228: Python client - mapi.Connection.__getbyes should throw exception when 0 bytes received from socket * 3229: GRANT does not work for UPDATE * 3230: GRANT SELECT priveleges not set in SQL FUNCTIONs * 3233: getting a crash of server with segmentation fault on SLES 11 64 SP2 * 3235: MapiPP.pm unquote '0' as 'undef' * 3236: mclient \d produces no output * 3237: Assertion on BATgroup_internal * 3241: SEGFAULT on string processing when using optimizer.reduce()

1 0