January 2016 - users-list

New syntax filter functions
by Roberto Cornacchia 08 Jan '16

08 Jan '16

Hi there, I'm a bit struggling with the syntax for filter function, after it changed from Oct2014 to Jul2015. I have looked at the release notes, but they don't seem to even mention this change of syntax. This used to work in Oct2014: create filter function maxlevenshtein(s1 string, s2 string, k int) external name str."distjoin_levenshtein"; select t.name, f.name from sys.tables t, sys.functions f where t.name maxlevenshtein(2) f.name; In Jul2015, if I look at Niels' comment in https://www.monetdb.org/bugzilla/show_bug.cgi?id=3702 , it should be something similar to select t.name, f.name from sys.tables t, sys.functions f where [t.name] maxlevenshtein [f.name, 2]; But this is still not right. How should it be? And should I change the SQL / MAL / C interface of the function as well? Thanks,

1 2

Monitoring MonetDB performance
by Alexander Gordt 07 Jan '16

07 Jan '16

Hello together, I’ve got a performance issue with my project, where the DB performance is going down for what ever reason. The activity monitor of OSX shows me the following numbers about the mserver5-process: The CPU usage is very low (15-25% of one core!), the IO traffic on my ssd is fair (about 10-40 MB/s), but the speed slows down. I’ve had a look in the merovingian.log, but there’s only the connection shown. For the first 5000 messages, the CPU usage of mserver5 was about 70-110% - why is it going down?… How could I analyze, why the database performance is going down? Is it possible, that there is an issue with the JDBC-driver, that the performance is decreasing? I attache a log file where you can see that the performance is quite good for some time, but then goes down for whatever reason. 18:40:46 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 15.711 seconds - totally inserted 5200 messages 18:40:46 [main] INFO ModelPersistenceTest - Starting Batch-Insert for of 200 message 18:41:03 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 17.189 seconds - totally inserted 5400 messages 18:41:03 [main] INFO ModelPersistenceTest - Starting Batch-Insert for of 200 message 18:41:27 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 23.834 seconds - totally inserted 5600 messages 18:41:27 [main] INFO ModelPersistenceTest - Starting Batch-Insert for of 200 message 18:42:19 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 52.13 seconds - totally inserted 5800 messages 18:42:19 [main] INFO ModelPersistenceTest - Starting Batch-Insert for of 200 message 18:43:09 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 49.892 seconds - totally inserted 6000 messages 18:43:09 [main] INFO ModelPersistenceTest - Starting Batch-Insert for of 200 message 18:43:59 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 49.786 seconds - totally inserted 6200 messages 18:43:59 [main] INFO ModelPersistenceTest - Starting Batch-Insert for of 200 message 18:45:31 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 92.389 seconds - totally inserted 6400 messages 18:45:31 [main] INFO ModelPersistenceTest - Starting Batch-Insert for of 200 message 18:47:26 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 114.412 seconds - totally inserted 6600 messages 18:47:26 [main] INFO ModelPersistenceTest - Starting Batch-Insert for of 200 message 18:49:24 [main] INFO ModelPersistenceTest - Finished BatchInsert of 200 message in 118.324 seconds - totally inserted 6800 messages One message results in 10-50 insert statements in different tables and the 200 messages are processed in one transaction. The absolute performance isn’t nice, but that is another topic – I’ve read about "copy into“ and that kind of stuff – but that gonna be part in a later optimization. I tried to find out, if there is a long running process, but „select * from sys.queue;“ didn’t show me anything of interest – the result shows only this select. Is there a way to gather some statistics about executed queries and their runtime? Or about blocking resources… Thanks in advance for bringing any light in the black box :) Best regards, Alex

1 1

About JDBC Driver
by Luciano Sasso 07 Jan '16

07 Jan '16

Steps for error: 1- In testing with java client and JDBC 2:19, an error occurs when saving decimal field, for example the value 11:23 is recorded as 13. 2- When I run the same test with the 2.8 driver, saves normally and correct. Not only is the 2.19 driver, all above 2.8 is that same mistake. My Java client is Pentaho Data Integration, My MonetDB is JUL2015-SPI I go zip package test, and send fo tests. Att, -- Luciano Sasso Vieira Data Scientist & Solutions Architect luciano(a)gsgroup.com.br <http://www.gsgroup.com.br> | tel: 17 3353-0833 | cel: 17 99706-9335 www.gsgroup.com.br <http://www.gsgroup.com.br> --- Este email foi escaneado pelo Avast antivírus. https://www.avast.com/antivirus

2 1

About database crack
by chenkaijiang＠bigknow.com.cn 06 Jan '16

06 Jan '16

Hi, all, I find that in Oct2010 branch (http://dev.monetdb.org/hg/MonetDB/shortlog/Oct2010), it looks like that the database cracking technology has been implemented. But looks like that it wasn't merged into the latest release (Jul2015), right? Why not merge this into the latest release? Is there any plan to merge it in the future?

3 3

MonetDBLite error in R
by Iain Wallace 06 Jan '16

06 Jan '16

hi all, I was wondering if anybody could suggest how to debug this error: Server says 'GDKerror:!ERROR: BATsetaccess: tmp_3505 has -1 views I am trying to do a simple join using dplyr sample%>%left_join(interaction_pairs) The tables appear to be working correctly as I can collect them and use them in R properly interaction_pairs<-collect(interaction_pairs) Thanks Iain

2 1

invalid credentials using mserver5
by Xu,Wenjian 06 Jan '16

06 Jan '16

Hi all, Normally I am using *monetdbd*+"mclient" combination to use MonetDB. Now, since I want to see the debug info in each gdk operator, I have to use *mserver5*. I do as follows (JULY2015-SP1+ubuntu14.04): Step1: $ mserver5 --dbpath=${HOME}/[my_dbpath] --daemon=yes --algorithms Step2: In another console: $ mclient -d [dbname] -u monetdb password: monetdb It replies: InvalidCredentialsException:checkCredentials:invalid credentials for user 'monetdb' However, user:monetdb, pwd:monetdb is the default one and I can use it successfully in *monetdbd*+"mclient" combination. Any idea? Thanks, XU Wenjian

2 1

Jdbc Driver
by Luciano Sasso 05 Jan '16

05 Jan '16

Hi, Its error "https://www.monetdb.org/bugzilla/show_bug.cgi?id=3561", persist in version 2.19, exists most new version with bug fix ? -- Luciano Sasso Vieira Data Scientist & Solutions Architect luciano(a)gsgroup.com.br <http://www.gsgroup.com.br> | tel: 17 3353-0833 | cel: 17 99706-9335 www.gsgroup.com.br <http://www.gsgroup.com.br> --- Este email foi escaneado pelo Avast antivírus. https://www.avast.com/antivirus

2 1

Dropping foreign key constraint
by Alexander Gordt 04 Jan '16

04 Jan '16

Hello together, I’m very new to MonetDB, so please be gracious :) I’m trying to drop a foreign key, what should be a very simple task – but I didn’t manage to do it. The following statement ran successfully – as the result says – but the foreign key is still there: alter table visit drop constraint visit_configuration_id_fkey; I also tried this – but this command is not supported?? alter table visit drop foreign key visit_configuration_id_fkey; An error occurred when executing the SQL command: alter table visit drop foreign key visit_configuration_id_fkey syntax error, unexpected FOREIGN in: "alter table visit drop foreign" [SQL State=42000] Execution time: 0.01s 1 statement failed. Best regards and thanks for any hints, Alex

2 4

could == be aliased to the = operator? or will that break things?
by Anthony Damico 04 Jan '16

04 Jan '16

hello, just an idea-- if monetdb gets a flood of new R users over the next year, they might get thrown off by things breaking when they use a double-equals sign (example below).. sqlite accepts the double-equals as a single equals. thanks > dbGetQuery(db,'select count(distinct mycolumn) from mytable where yr=2003') L1 1 334343 > dbGetQuery(db,'select count(distinct mycolumn) from mytable where yr==2003') Error in .local(conn, statement, ...) : Unable to execute statement 'select count(distinct mycolumn) from mytable where yr==2003'. Server says 'syntax error, unexpected '=' in: "select count(distinct mycolumn) from mytable where yr=="' [#42000]. >

1 0