January 2013 - users-list

Unsigned integers
by Eduardo Oliveira 23 Jan '13

23 Jan '13

Hello, I would like to know if MonetDb supports unsigned integer, i couldn't find anything on documentation. I tried to created a table with unsigned int and i get an error. Thank you, -- *Eduardo Oliveira * *IT* ***Email:* eduardo.oliveira(a)adclick.pt *Web: *www.adclickint.com **<http://www.adclickint.com/> * * <http://www.adclickint.com/> <http://www.adclickint.com/>

2 1

Announcement: New Oct2012-SP3 Bugfix release of MonetDB suite
by Sjoerd Mullender 22 Jan '13

22 Jan '13

The MonetDB team at CWI/MonetDB BV is pleased to announce the Oct2012-SP3 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Oct 2012-SP3 bugfix release Bug Fixes * 2291: small doubles end up as NULL after arithmetic * 2579: SQL: incorrect cast from double to int * 2659: tuples INTERSECT vs count (... INTERSECT ...) differs * 2805: row_number doesn't work in complex query * 2886: warning: Catalog parameter '' ignored * 2977: timestamp minus date results in program error * 2978: now() + 1 results in illegal argument * 2999: Up-cast from SQL drops order information? * 3048: algebra.join undefined when using multiple arithmetic operations in SQL where-clause * 3124: insert into table with two foreign keys crashes mserver5 * 3136: Memleak (in querycache?) while querying * 3143: Type resolution error in SQL procedural code * 3163: mserver5 crashes with large number of concurrent clients * 3168: crash when insert varchar/char/clob with default NULL * 3169: php driver uses call-time pass-by-reference * 3173: SQL queries with limit and offset clauses are unable to use bind parameters for either * 3176: Same query and different results * 3181: Join query returns zero results when there is an index on the tables * 3185: inconsistency between documentation and implementation of command line options * 3186: case evaluted to early * 3188: Storage of client history * 3189: Overflow in calculation * 3190: When subtracting two columns of type "timestamp", no results are returned * 3191: rel_optimizer.c:5596: _rel_optimizer: Assertion `0' failed. * 3192: "No such column with index" error if CASE in SELECT clause * 3199: Inconspicuous sequence of prepare, execute, commit and close produces error * 3205: Inet datatype handling inconsistent between int, cast( as inet) and string * 3208: Unable to execute prepared statements with a large number of arguments * 3209: exp_bin: Assertion `0' failed * 3212: Query cache does not work properly

1 0

SQL function as non-privileged user
by Tapomay Dey 21 Jan '13

21 Jan '13

I have created a separate schema and user as follows: echo "CREATE USER \"tapomay\" WITH PASSWORD '~!@#$' NAME 'Ext User' SCHEMA \"sys\";" | mclient -d my_db echo "CREATE SCHEMA \"test_schema\" AUTHORIZATION \"tapomay\";" | mclient -d my_db echo "ALTER USER \"tapomay\" SET SCHEMA \"test_schema\";" | mclient -d my_db When logged in as "tapomay", I am able to execute curdate() but can't execute date_to_str(). I can run date_to_str() when logged in as the super user monetdb. There could be many other such utility functions. How do I enable all of them for the new user "tapomay". Regards, Tapomay.

2 1

BAT Data structures of a Schema
by Hassan, Ahmad 21 Jan '13

21 Jan '13

Hi Martin, I have the following list of tables in database schema: sql>\d TABLE sys.customer TABLE sys.lineitem TABLE sys.nation TABLE sys.orders TABLE sys.part TABLE sys.partsupp TABLE sys.region TABLE sys.supplier Please can you point me to the C code file(s) that hold the BAT objects for each column of the above tables please? I want to debug and analyse specifically that part of the code region that declares, initialises and maintains the list of BAT structures for the tables. The following query is providing the information about the tables and I am assuming that this query also access this information from all the individual BAT structures of a database schema. select * from storage() where "table" = 'lineitem'; Secondly, Is it possible to list of get the list of all the BAT structures (Column BATS and Delta BATs) in the running database please? Thanks. Kind Regards, Ahmad

4 6

Inconsistency in data selection. count*
by Tapomay Dey 21 Jan '13

21 Jan '13

select count(*) from table; Results: 168466 rows select count(*) from table where column=0; Results: 168466 rows select count(*) from table where column<>0; Results: 168466 rows When I do a "select column from table where client_id=0 limit 5;" I see correct non-zero values in the result although the selection condition is that the column value must be 0. I put the data on another instance/machine - I don't see this issue. Plz find a screenshot@ https://picasaweb.google.com/115470548136322675830/January212013?authuser=0… Another case: sql>select count(*) from table2 where column2=0; | 391326 | sql>select count(*) from table2 where column2<>0; | 141108 | sql>select count(*) from table2; | 399326 | sql>select column2 from table2 where column2=0 limit 5; +-----------+ | column2 | +===========+ | 53 | | 53 | | 53 | | 53 | | 53 | +-----------+ 5 tuples (156.631ms) Regards, Tapomay

1 0

Resource limits in MonetDB
by Charles Milutinovic 21 Jan '13

21 Jan '13

I am experimenting with using MonetDB for a project where the most natural implementation would involve ~100K tables (with the huge majority being near empty, a few incredibly massive) with approx. 10 columns each. MonetDB choked on this, with the following error: >!FATAL: BBPextend: trying to extend BAT pool beyond the limit (16384000) I am assuming that I hit this limit because of the extreme amount of tables. I am wondering if there are any other hard limits to be aware of in MonetDB that you could hit before hitting system limits.

3 2

FW: Monetdb on Solaris/Sparc: high system time problem
by Javier Picorel 21 Jan '13

21 Jan '13

Dear Martin, Thanks for your prompt reply. We have verified that the order in which the queries are executed doesn't affect the behavior of the query. The same problem arises at the same queries in any arbitrary order, which implies that it's related to the query itself. In addition, the queries' execution time and utilization are pretty deterministic. We have also verified that there is plenty of memory available and there are no other processes competing for resources (i.e., disk bandwidth, memory). We have used dtrace to profile what functions are being executed by MonetDB while being in the two phases (normal and problematic). In the normal phase, which lasts for a few tens of seconds and the behavior is what we see on Linux, MonetDB mainly access the following functions: - BUNfastins - re_match_no_ignore - strstr When MonetDB enters into that second (problematic) phase, the User/System time is 4% to 21% for a couple of minutes w/o any disk activity or swapping, MonetDB mainly accesses the following functions: - MT_sleep_ms - memset - __pollsys - _pollsys - _save_nv_regs - pselect - select Do these function names help you to understand the problematic behavior? Thanks in advance, Javier ________________________________ From: Martin Kersten <martin(a)monetdb.org<mailto:martin@monetdb.org>> Subject: Re: Monetdb on Solaris/Sparc: high system time problem Date: January 17, 2013 6:56:00 PM GMT+01:00 To: <users-list(a)monetdb.org<mailto:users-list@monetdb.org>> Reply-To: Communication channel for MonetDB users <users-list(a)monetdb.org<mailto:users-list@monetdb.org>> Dear Javier, Thank you for your report. It is hard to assess the consequences/impact of your particular setup. Your report suggests that something else was also running on your platform during this sequence, at that particular time. It could mean the MonetDB was fighting with another process over resources, i.e. memory and disk bandwidth. It could also indicate a thrashing kernel on shared kernel resources. If the system persists during repetitive runs under controlled system settings and it is immune to query order, then we might look further into the issue. regards, Martin On 1/17/13 3:44 PM, Javier Picorel wrote: Dear all, I'm running MonetDB (Dec2011-SP2) on Sparc Solaris 10 u9. I'm testing the TPC-H queries using SF10 and SF100 as the scale factors. My machine has 4 cores and 32GB of RAM and my farm is on a disk array. Unfortunately, there are some queries (e.g., Qry 7, 8, 9) that enters into phase in which the User/System time is 4% to 21% for a couple of minutes. Interestingly, the same issue doesn't show up on a Linux machine with a similar setup and the queries' system time is pretty low (<5%). Interestingly, vmstat output doesn't show any disk activity during the phase where the process is just in system, only there are high values on "re" and "mf" fields. There is no swapping going on ("po" and "pi" values are 0 in vmstat). These are the parameters of the DB: type default database shared default yes nthreads default 4 optpipe default_pipe master default no slave default <unknown> readonly default no nclients default 64 The way that I test the query is by running just one at a time. How can I mitigate this OS time? Thanks in advance, Javier _______________________________________________ users-list mailing list users-list(a)monetdb.org<mailto:users-list@monetdb.org> http://mail.monetdb.org/mailman/listinfo/users-list _______________________________________________ users-list mailing list users-list(a)monetdb.org<mailto:users-list@monetdb.org> http://mail.monetdb.org/mailman/listinfo/users-list

2 1

MonetDB under LLVM
by Hassan, Ahmad 18 Jan '13

18 Jan '13

Hi Team, Has anyone tried compiling/running MonetDB under LLVM/CLANG compiler framework please? Normally the use case is: 1) Produce set of llvm bitcode files *.bc from C code 2) Apply LLVM Pass to instrument *.bc files through llvm 'OPT' compiler tool 3) Link all *.bc files and produce executables of monetdb I am going to try monetdb under llvm. If anyone hasn't done it before then I may ask for the initial pointers to compile monedb under llvm instrumentation. Thanks. Kind Regards, Ahmad _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

5 8

Email archives for the forums
by Tapomay Dey 18 Jan '13

18 Jan '13

I don't see any forum archives since you switched from sourceforge. It's helpful to refer to other email threads. Is it there somewhere? I see the older one here: http://mail.monetdb.org/pipermail/developers-list/ and till 8th Jan '13 on sourceforge. Regards, Tapomay. _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

3 2

Monetdb on Solaris/Sparc: high system time problem
by Javier Picorel 17 Jan '13

17 Jan '13

Dear all, I'm running MonetDB (Dec2011-SP2) on Sparc Solaris 10 u9. I'm testing the TPC-H queries using SF10 and SF100 as the scale factors. My machine has 4 cores and 32GB of RAM and my farm is on a disk array. Unfortunately, there are some queries (e.g., Qry 7, 8, 9) that enters into phase in which the User/System time is 4% to 21% for a couple of minutes. Interestingly, the same issue doesn't show up on a Linux machine with a similar setup and the queries' system time is pretty low (<5%). Interestingly, vmstat output doesn't show any disk activity during the phase where the process is just in system, only there are high values on "re" and "mf" fields. There is no swapping going on ("po" and "pi" values are 0 in vmstat). These are the parameters of the DB: type default database shared default yes nthreads default 4 optpipe default_pipe master default no slave default <unknown> readonly default no nclients default 64 The way that I test the query is by running just one at a time. How can I mitigate this OS time? Thanks in advance, Javier _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

2 1