March 2008 - users-list

[MonetDB-users] COPY INTO using a schema fails
by McKennirey.Matthew 21 Mar '08

21 Mar '08

I was wondering if the COPY command does not support schemas? CREATE TABLE test ( column1 VARCHAR(32), column2 VARCHAR(32) ); COPY INTO test FROM '/location/file.csv' USING DELIMITERS ',', '\n'; works fine CREATE SCHEMA abc; CREATE TABLE abc.test ( column1 VARCHAR(32), column2 VARCHAR(32) ); COPY INTO abc.test FROM '/location/file.csv' USING DELIMITERS ',', '\n'; fails with !SQLException:sql:table test not found !SQLException:importTable:failed to import table INSERT into abc.test VALUES(one,two) works fine

2 1

[MonetDB-users] Sending an XML document via JDBC
by Richard Eckart 19 Mar '08

19 Mar '08

Hi again, is there some way to send a XML document to the server through the JDBC connection? That is (because of the <enter> problem on OS X) I need to have my MonetDB/XQuery server running on a remote machine and I want to load an XML document locally and store it on the machine via JDBC. The 'pf:add-doc()' functions do not really help be since the only connection over to the remote machine is the MonetDB connection. Setting up a facility for MonetDB to 'call back to' to fetch the XML document via http would be overkill. Also, the XML-DB API does no longer exist, does it? Cheers, Richard

2 1

[MonetDB-users] MonetDB Error Message
by Michael Schmidt 17 Mar '08

17 Mar '08

Hi, I am trying to run the following SQL query on the lates nightly build: SELECT T1.subject AS inproc, T2.object AS author, T3.object AS booktitle, T4.object AS title, T5.object AS proc, T6.object AS ee, T7.object AS page, T8.object AS URL, T9.object AS yr, AB.object AS abstract FROM Triples T1 JOIN Triples T2 ON T1.subject=T2.subject JOIN Triples T3 ON T1.subject=T3.subject JOIN Triples T4 ON T1.subject=T4.subject JOIN Triples T5 ON T1.subject=T5.subject JOIN Triples T6 ON T1.subject=T6.subject JOIN Triples T7 ON T1.subject=T7.subject JOIN Triples T8 ON T1.subject=T8.subject JOIN Triples T9 ON T1.subject=T9.subject LEFT JOIN ( SELECT * FROM Triples T10 WHERE T10.property='bench:abstract' ) AB ON T1.subject=AB.subject WHERE T1.property='rdf:type' AND T2.property='dc:creator' AND T3.property='bench:booktitle' AND T4.property='dc:title' AND T5.property='dcterms:partOf' AND T6.property='rdfs:seeAlso' AND T7.property='swrc:pages' AND T8.property='foaf:homepage' AND T9.property='dcterms:issued' AND T1.object='bench:Inproceedings' ORDER BY T9.object; on a single table "Triples(subject VARCHAR(50),predicate VARCHAR(20),object VARCHAR(20000))" with only 1000 entries. This query results in the following error message: ##GDKmmap(702808064) fail => BBPtrim(enter) usage[mem=101947960,vm=1505614392] # #mallinfo.arena = 11571200 ##mallinfo.ordblks = 1177 ##mallinfo.smblks = 102 ##mallinfo.hblkhd = 94076928 ##mallinfo.hblks = 12 ##mallinfo.usmblks = 0 ##mallinfo.fsmblks = 4080 ##mallinfo.uordblks = 9619432 ##mallinfo.fordblks = 1951768 ##BBPTRIM_ENTER: memsize=101947960,vmsize=1505614392 ##BBPTRIM: memtarget=0 vmtarget=1073741824 ##TRIMSCAN: mem=0 vm=1, start=1, limit=1 ##TRIMSCAN: 63756* 0=tmp_1462 (#0) ##TRIMSCAN: 63887* 1=tmp_1472 (#0) ##TRIMSCAN: 64223* 2=tmp_1473 (#0) ##TRIMSCAN: 64286* 3=tmp_1477 (#0) ##TRIMSCAN: 64301* 4=tmp_1500 (#0) ##TRIMSCAN: 64362* 5=tmp_1501 (#0) ##TRIMSCAN: 64438* 6=tmp_1502 (#0) ##TRIMSCAN: 64447* 7=tmp_1505 (#0) [...] // many many more entries of this form ##TRIMSCAN: 63994 235=tmp_2275 (#455647) ##TRIMSCAN: 63998 236=tmp_2304 (#3980331) ##TRIMSCAN: 64002 237=tmp_2305 (#3980331) ##TRIMSCAN: end at 1 (size=1234) ##TRIMSELECT: dirty = 0 ##TRIMSELECT: candidate=tmp_1462 BAT*=0x848fc28 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51285,63756,-2147419892) ##TRIMSELECT: keep tmp_1462 [228,0] bytes [228,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1472 BAT*=0x84964f8 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51294,63887,-2147419761) ##TRIMSELECT: keep tmp_1472 [228,0] bytes [228,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1473 BAT*=0x8496b18 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51313,64223,-2147419425) ##TRIMSELECT: keep tmp_1473 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1477 BAT*=0x84a6770 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51321,64286,-2147419362) ##TRIMSELECT: keep tmp_1477 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1500 BAT*=0x84a6d20 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51323,64301,-2147419347) ##TRIMSELECT: keep tmp_1500 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1501 BAT*=0x84a7318 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51325,64362,-2147419286) ##TRIMSELECT: keep tmp_1501 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1502 BAT*=0x84a7920 [...] // many many more entries of this form ##TRIMSELECT: candidate=tmp_2234 BAT*=0x871d5b0 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63975,63975,63975) ##TRIMSELECT: delete tmp_2234 from trimlist (does not match trim needs) ##TRIMSELECT: candidate=tmp_2235 BAT*=0x871e7e8 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63976,63976,63976) ##TRIMSELECT: delete tmp_2235 from trimlist (does not match trim needs) ##TRIMSELECT: candidate=tmp_2236 BAT*=0x871fa20 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63977,63977,63977) ##TRIMSELECT: delete tmp_2236 from trimlist (does not match trim needs) ##TRIMSELECT: end ##BBPTRIM: no more unload candidates! ##BBPTRIM_EXIT: memsize=11583488,vmsize=1505614392 ##GDKmmap(702808064) fail => BBPtrim(ready) usage[mem=101947960,vm=1505614392] # #mallinfo.arena = 11571200 ##mallinfo.ordblks = 1177 ##mallinfo.smblks = 102 ##mallinfo.hblkhd = 94076928 ##mallinfo.hblks = 12 ##mallinfo.usmblks = 0 ##mallinfo.fsmblks = 4080 ##mallinfo.uordblks = 9619432 Seems like a memory allocation problem to me. Any ideas what the problem could be? Best Regards, Michael

2 1

[MonetDB-users] Trouble connecting
by Richard Eckart 16 Mar '08

16 Mar '08

Hi everybody, I am completely new to MonetDB and have just compiled the latest SuperBall release on OS X. I set mapi_open to true in the config file /etc/monetdb5.conf because for some reason MonetDB would not use "localhost" but the machine name of my box as an address to listen on. I had to manually add that to /etc/hosts in order for it to refer to 127.0.0.1 at least. Maybe an OS X oddity. I start the merovingian process which seems to run fine. After that the only time I can connect successfully to a database using mclient (or any other client) is the first time I try to connect (if it works at all). For example ./mclient -lsql --database demo !InvalidCredentialsException:checkCredentials:Invalid credentials for user 'monetdb' Sometimes it would work just once but the second time with the same command line I would not be able to log in. The merovingian.log does not seem to contain any helpful messages. Any hints would be very helpful as currently I can not use MonetDB at all. Cheers, Richard

3 8

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by McKennirey.Matthew 14 Mar '08

14 Mar '08

2 1

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by McKennirey.Matthew 14 Mar '08

14 Mar '08

2 1

[MonetDB-users] Can not allocate memory, MonetDB5
by forte712 14 Mar '08

14 Mar '08

Hi I've just downloaded a new version of MonetDB a few days ago and started testing it.. I tried inserting a 2.6G data file (12 columns, 32 million rows) and it works fine. But when I added 4 more columns of data to that data file (of type bigint, bringing the file size up to 3.9G), it fails saying !SQLException:importTable:failed to import table !ERROR: GDKload: cannot mmap(): name=20/2023, ext=tail.priv !OS: Cannot allocate memory !ERROR: GDKload failed: name=20/2023, ext=tail.priv I tried searching for similar problem, but only found it for older versions of MonetDB. Is this still an issue in the current version? Thank you. -- View this message in context: http://www.nabble.com/Can-not-allocate-memory%2C-MonetDB5-tp16019364p160193… Sent from the monetdb-users mailing list archive at Nabble.com.

4 4

[MonetDB-users] Table space/size
by Iftikharn 13 Mar '08

13 Mar '08

Hi How to check that how much space a particular table has taken or what is the current size of a given tables in bytes etc. Because I am interested in writing a trigger when a particular table reaches a given size then the oldest of all rows, based on a time attribute should be deleted (I like to do it without counting the rows). Regards, Iftikhar -- View this message in context: http://www.nabble.com/Table-space-size-tp16040486p16040486.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Developing in MAL!
by Erik Holstad 13 Mar '08

13 Mar '08

Hi, I'm new to MonetDB, but are looking to develop my own interface towards the database, not using SQL, but just sticking with MAL or if possible C and just want to know what my options are? Is it, for example, possible to load you own MAL-files into the client, just for a test run or do you have to type in the commands line by line? And on the server side, how to you setup your own modules and libraries? Regards Erik Holstad

5 24

[MonetDB-users] JDBC insert performance
by chinarinde 11 Mar '08

11 Mar '08

Hi all, I am new to monetDB and ran into the following problem (I'll try to be as verbose as I can, perhaps it helps helping me): I've installed MonetDB server 5.0.0, clients and commons 1.18.2 and sql 2.18.2 on Ubuntu Feisty. Then I've taken the JDBC example which is available online and modified it to be able to insert data into a test database. More specifically I'm using prepared statements and executeBatch() together with the monetdb-1.6 JDBC driver. Which is quite successful until about 5 million records are inserted - afterwards the speed of the inserts drops dramatically. I've experimented with different batch sizes (10000 records seems to work ok), and I've tried to understand the chapter about memory tuning for MonetDB (not sure yet about how to use mem_cursize() though). In any case at first inserting 2 million records only takes about 5 minutes (measured with Javas System.timemillis), later on this time increases and the server gets rather unresponsive. I found only two posts concerning the speed of JDBC inserts (from January 2007 I think) and I would be interested if a solution or explanation has been found off-list. Thank you -- View this message in context: http://www.nabble.com/JDBC-insert-performance-tf4589411.html#a13100422 Sent from the monetdb-users mailing list archive at Nabble.com.

3 2