- users-list - monetdb.org

[MonetDB-users] MonetDB Bug-Etiquette
by Stefan Manegold 24 Nov '05

24 Nov '05

Dear MonetDB-users and -developers, bug reports and especially test script play a crucial role with maintaining and improving the stability and correct functioning of MonetDB. However, adding test scripts "a posteriori" as we did recently during the two "MonetDB-Bug-Days" (a third one is still to come before the end of this year!) is a very tedious and time-consuming task, especially since who ever is adding a test script first needs to get familiar with the details of the very bug report. Since both the user who submits a bug report and the developer(s) who take(s) care of fixing a bug are by definition very familiar with the details of a bug report, it seems more than obvious that they should share the task of adding a test script to the CVS repository while dealing with the respective bug, i.e., *before* closing the bug report. Ideally, the user/submitter provides the query or script that triggers the bug as well as the expected/correct output with his/her bug report. In case the user/submitter has CVS check-in privileges, he/she could add the test script to the CVS repository him-/herself. Otherwise, the developer/assignee should add the user's test script to the CVS repository. The test script helps both the developer/assignee and the user/submitter to monitor the status of the bug by running "Mtest[.py]" (cf., http://monetdb.cwi.nl/monet/src/testing/README) or by checking the TestWeb (http://monetdb.cwi.nl/Development/TestWeb/). To coordinate this procedure, I made a first draft for a "MonetDB Bug Etiquette", which you find attached to this mail. I'd be very pleased, if you could comment on this. Thank you all very much for your contribution to make MonetDB even better than it already is! Kind regards, Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

4 10

[MonetDB-users] MonetDB 10.000 downloads
by Martin Kersten 19 Nov '05

19 Nov '05

LS, It is my pleasure to announce that on Nov 19, 2005 around 23:00 GMT we reached the first 10.000 downloads of MonetDB packages (MonetDB+SQL+XQuery) available on Sourceforge. Let's go the 100.000 ! regards, Martin

1 0

[MonetDB-users] Still can't compile under FreeBSD
by Eugene Rogoza 31 Oct '05

31 Oct '05

Hello everybody, I can't compile MonetDB from sources no matter what I do. Even with the patch from Marcel. I've been trying to compile the MonetDB-4.8.2 sources as well as CVS version. What I get is attached below. Could someone point out the exact steps to compile this stuff on FreeBSD 5.3? I would be very grateful. Eugene root@inspiron:~/MonetDB-4.8.2/FreeBSD> gmake cd .. && /usr/local/bin/bash /root/MonetDB-4.8.2/conf/missing --run aclocal-1.9 /usr/X11R6/share/aclocal/xmms.m4:17: warning: underquoted definition of XMMS_TEST_VERSION run info '(automake)Extending aclocal' or see http://sources.redhat.com/automake/automake.html#Extending-aclocal /usr/X11R6/share/aclocal/xmms.m4:62: warning: underquoted definition of AM_PATH_XMMS /usr/X11R6/share/aclocal/oaf.m4:4: warning: underquoted definition of AM_PATH_OAF /usr/X11R6/share/aclocal/libglade.m4:7: warning: underquoted definition of AM_PATH_LIBGLADE /usr/X11R6/share/aclocal/libart.m4:11: warning: underquoted definition of AM_PATH_LIBART /usr/X11R6/share/aclocal/imlib.m4:9: warning: underquoted definition of AM_PATH_IMLIB /usr/X11R6/share/aclocal/imlib.m4:167: warning: underquoted definition of AM_PATH_GDK_IMLIB /usr/X11R6/share/aclocal/gtk.m4:7: warning: underquoted definition of AM_PATH_GTK /usr/X11R6/share/aclocal/gdk-pixbuf.m4:12: warning: underquoted definition of AM_PATH_GDK_PIXBUF /usr/X11R6/share/aclocal/gconf-1.m4:4: warning: underquoted definition of AM_PATH_GCONF /usr/X11R6/share/aclocal/gconf-1.m4:71: warning: underquoted definition of AM_GCONF_SOURCE aclocal:configure.in:74: warning: macro `AM_MONETDB_COMPILER' not found in library aclocal:configure.in:75: warning: macro `AM_MONETDB_TOOLS' not found in library aclocal:configure.in:76: warning: macro `AM_MONETDB_OPTIONS' not found in library aclocal:configure.in:77: warning: macro `AM_MONETDB_LIBS' not found in library cd .. && /usr/local/bin/bash /root/MonetDB-4.8.2/conf/missing --run autoconf configure.in:74: error: possibly undefined macro: AM_MONETDB_COMPILER If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. configure.in:75: error: possibly undefined macro: AM_MONETDB_TOOLS configure.in:76: error: possibly undefined macro: AM_MONETDB_OPTIONS configure.in:77: error: possibly undefined macro: AM_MONETDB_LIBS WARNING: `autoconf' is missing on your system. You should only need it if you modified `configure.in'. You might want to install the `Autoconf' and `GNU m4' packages. Grab them from any GNU archive site. /usr/local/bin/bash ./config.status --recheck running /usr/local/bin/bash ../configure --no-create --no-recursion checking build system type... i386-unknown-freebsd5.3 checking host system type... i386-unknown-freebsd5.3 checking target system type... i386-unknown-freebsd5.3 checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for gawk... gawk checking whether make sets $(MAKE)... yes ../configure: line 1898: syntax error near unexpected token `AM_MONETDB_TOOLS' ../configure: line 1898: `AM_MONETDB_TOOLS()' gmake: *** [config.status] Error 2

3 4

[MonetDB-users] FreeBSD compile patch
by Marcel Hamer 21 Oct '05

21 Oct '05

Hello, The following, very small, patch makes MonetDB compile without errors and warnings on a FreeBSD 5.4 system. I was able to succesfully compile and run MonetDB this way on FreeBSD. ----------------------------------------------------------------- +++ ./conf/monet.m4 Wed Oct 19 21:26:01 2005 @@ -236,6 +236,8 @@ yes-*-*) dnl defines that enable the features beyond C89 in the various dnl platforms. Here's what we found working so far... case "$gcc_ver-$host_os" in + *-freebsd*) + ;; *-cygwin*) dnl MonetDB/src/testing/Mtimeout.c fails to compile with dnl "--std=c99" as the compiler then refuses to recognize ------------------------------------------------------------------ Kind regards, Marcel Hamer

2 2

[MonetDB-users] mail Server
by Jone 21 Oct '05

21 Oct '05

Dear monetdb-users(a)lists.sourceforge.net: Bullet-Proof server: Fresh IPs 1024MB RAM P4 CPU 72GB SCSI Dedicated 100M fiber Unlimited Data Transfer Any software Based China US$599.00 per month May use the server for: Bulk web Hosting Direct Mail We also supply email list according to your order and sending out your message for you. Hope to service for you. Cheers! Jone Server Team kezunli666(a)sohu.com For.NoSend: MoreNot(a)yahoo.com

1 0

[MonetDB-users] Huge tables
by Andrei Martsinchyk 04 Oct '05

04 Oct '05

Hello, It seems MonetDB has problem with handling of huge tables (larger than amount of memory available). I tried to load large amount of data into a table using COPY command. I loaded same data (6 millions records, 700+MBytes) few times. Loading was successful two times, on third time server crushed. After crush I could not start the server again, it output messages !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. !FATAL: BBPinit: cannot properly process bat/BACKUP/. and exited. Removing of the database data directory did not help much - server output messages !ERROR:mvc_init: unable to create system tables !WARNING: BBPincref: range error 410 Couple minutes later it output !ERROR: BATSIGcrash: Mserver internal error (Segmentation fault), please restart . !ERROR: (One potential cause could be that your disk might be full...) Well, insufficient disk space could be a cause, before server crashed I had approximately 2GB free. But I have cleaned up 10 GB and problem persists. How can I troubleshoot and fix the server ? What are memory / disk space requirements when bulk loading data ? I tested with 32-bit system, 512 MB RAM + 1GB swap, Ubuntu Linux, MonetDB-4.9.3, nightly build dated September 30. -- Best regards, Andrei Martsinchyk mailto:andrei.martsinchyk@gmail.com

2 6

[MonetDB-users] Bulk load
by Andrei Martsinchyk 03 Oct '05

03 Oct '05

Hello, I am trying to pipe output from my application using bulk load. If application produced output like this: CREATE TABLE test (col1 int); COPY 3 RECORDS INTO "test" FROM stdin USING DELIMITERS '\t'; 1 2 NULL COMMIT; I could pipe it to MapiClient -lsql -umonetdb -Pmonetdb, it worked OK. But application does not know how many rows it will produce, until dump out all the records. When I tried to skip record count I got failed assertion error (a bug ?). Anyway, it would fail when encountered COMMIT; at the end. At the same time COPY without record count can load data from a file, but I do not want to put data into temp table and then do load because i want them run in parallel. Could you suggest a way to do the loading ? -- Best regards, Andrei Martsinchyk mailto:andrei.martsinchyk@gmail.com

1 1

[MonetDB-users] XQuery API and XLink/XUpdate support
by Alexandra Mart�nez 10 Sep '05

10 Sep '05

Hello all, I was wondering if there is any documentation about the API for XQuery (i.e., how to write xqueries from a Java program). Also, I am interested in using some features of XLink and XUpdate on top of my XML database. Is support for any of these in progress? Thanks in advance, Alexandra ______________________________________________________ Click here to donate to the Hurricane Katrina relief effort. http://store.yahoo.com/redcross-donate3/

3 2

[MonetDB-users] SQL: Update table from another table
by Andrei Martsinchyk 08 Sep '05

08 Sep '05

Hello All, Does SQL frontent support updating one table with data from another table ? More formally, if I have two tables create table t1 (id1 int, val1 varchar(255)); and create table t2 (id2 int, val2 varchar(255)); , can I execute statement like this (PostgreSQL syntax): update t1 set val1=val2 from t2 where id1=id2; ? Thanks in advance. -- Best regards, Andrei Martsinchyk mailto:andrei.martsinchyk@gmail.com

2 4

[MonetDB-users] "Large" document collection and MonetDB/XQuery
by Bastiaan Naber 05 Sep '05

05 Sep '05

We have been experimenting with the MonetDB/XQuery at our institure and we have some issues. We have loaded 727 XML documents into MonetDB with the shred_doc() command: shred_doc("{xml file 1}, "1") shred_doc("{xml file 2}, "2") etc... These files are small (4 a 5 kilobytes). When we query these files with the following query the result takes a long time to complete (2 minutes): for $i in ("0", "1", .... "727") return $i Can anyone explain why looping over 727 documents is so slow? We have collected all 727 XML documents into 1 XML file and loaded this in MonetDB and this is a lot faster. The test machine is a 2.8 GHz P4 with 1 GB of memory. Another isue is related to the size of the database on the harddisk. When we fist load the 727 XML documents into the database the database directory contains about 47.000 files and is 50 megabytes in size. When we have excuted a number of querys the size of this directory increases to 1.7 gigabytes!! Can anyone explain this behaviour? Is MonetDB generating somekind of dynamic indices? Thanks for your replys, Bastiaan Naber

3 2