June 2009 - users-list

[MonetDB-users] connecting to mserver
by Henrik Vendelbo 08 Jun '09

08 Jun '09

I've installed mserver in a fresh Ubuntu Jaunty running in vmware, but cannot seem to connect. At first I thought it was just because I hadn't opened port 50000 in iptables, but things are a bit odd even now that I have opened the port. within Ubuntu port 50000 only seems to be open on the lo interface, while on the eth0 interface it is closed. Can this be an issue with mserver or is it just my iptables conf that is screwed?

3 2

[MonetDB-users] CRT and GKLoad errors
by Florian Joßbächer 08 Jun '09

08 Jun '09

Hi, I am trying to run the Star Schema Benchmark with Scale Factor 10 on MonetDB and get the following errors while loading the tables from a csv. The GKLoad-Errors occur just once in a while, the CRT-error is reproducible. Every time I try to run SF10, the server crashes while loading the lineorder-table (SF10) - with SF1 everything works fine. I googled this issue but only found a hint deleting a registry-key which is not existing on my machine. What can I do? Best regards, Florian. "# MonetDB server v5.10.4, based on kernel v1.28.4 # Serving database 'ssb', using 1 thread # Compiled for i686-pc-win32/64bit with 32bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see D:\MonetDB5\etc\monetdb5.conf) # Listening for connection requests on mapi:monetdb://CS-MONETDB:50000/ # MonetDB/SQL module v2.28.4 loaded >!ERROR: GDKload: cannot read: name=65\6560, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3440) for sys_customer_custkey !ERROR: GDKload: cannot read: name=65\6547, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3431) for sys_customer_name !ERROR: GDKload: cannot read: name=65\6553, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3435) for sys_customer_address !ERROR: GDKload: cannot read: name=65\6554, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3436) for sys_customer_city !ERROR: GDKload: cannot read: name=65\6557, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3439) for sys_customer_nation !ERROR: GDKload: cannot read: name=66\6672, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3514) for sys_customer_region !ERROR: GDKload: cannot read: name=70\7067, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3639) for sys_customer_phone !ERROR: GDKload: cannot read: name=70\7070, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3640) for sys_customer_mktsegment runtime error R6031 - Attempt to initialize the CRT more than once. This indicates a bug in your application."

4 10

Re: [MonetDB-users] [Monetdb-developers] problems with starting the monetDB4xquery server
by Mtekel 07 Jun '09

07 Jun '09

Hello, I have carefully read the link you have sent me. Too bad comments are closed. I have now uninstalled my 20090424 version and installed the newest 20090530. However I still have problems running the server. The 2009 4 24 version wouldn't start even after loading all the modules by hand from the Mserver interactive commandline - nor the client or browser would connect. They would just hang, connecting forever. Now this works for the 05 30 version, but I can't use the web interface (which now works) for adding the files - I get a bug (I'm not sure If I am allowed to send attachements, so I'll include them in the next mail). Adding from commandline, mclient --language=xquery -I %1 -C WOcollection < %1 , where %1 is filename, works, but the collection name is %1 WOcollection (e.g. three different files end up in different collections instead of one). What is more interresting, if I try to run pf:add-doc("DATA_wo3.xml", "DATA_wo3.xml", "WOcollection", 1) from the client's interactive commandline, I get this error (no matter where the file really is): MAPI = monetdb@localhost:50000 QUERY = pf:add-doc("DATA_wo3.xml", "DATA_wo3.xml", "WOcollection", 1) ERROR = !ERROR: interpret: no matching MIL operator to 'ws_create(int)'. I have run procmon and created trace as described in the link, the file is attached (to the second mail). I hope this issue can be solved somehow, Best regards, Michael -----Original Message----- From: Ying Zhang [mailto:Y.Zhang@cwi.nl] Sent: 2. júna 2009 10:41 To: Mtekel Cc: monetdb-developers(a)lists.sourceforge.net Subject: Re: [Monetdb-developers] problems with starting the monetDB4xquery server Hello Michael, Thanks for using MonetDB, and sorry for the inconvenience! Your problem has been reported earlier. Unfortunately, we don't have a solution for this problem at this moment. However, there is a workaround, which seems to work according to other users. So please have a look at the following bug report (the workaround is in the report): http://sourceforge.net/tracker/index.php?func=detail&aid=2693363&group_id=56 967&atid=482468 Kind regards, Jennie On Mon, Jun 01, 2009 at 10:55:45AM +0200, Mtekel wrote: > Hello, > > I have problems starting the monetDB xquery server under windowsXP sp3. When > I click on the link in the start menu, dos window appears but then it closes > immediatelly and I can't see what's there (after pausing I can see only the > first 6 lines of the program output as described below, then after unpausing > it immediatelly quits and closes the window). If I run MXQserver.bat, or > Mserver.bat --dbinit="module(pathfinder);" I get only this: > > # MonetDB Server v4.28.4 > # based on GDK v1.28.4 > # Copyright (c) 1993-July 2008, CWI. All rights reserved. > # Copyright (c) August 2008-2009, MonetDB B.V.. All rights reserved. > # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. > # Visit http://monetdb.cwi.nl/ for further information. > # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah > > That's all. The server immediatelly ends. However If I run only Mserver.bat, > the server "runs" - I get the prompt, but for example I can't connect to the > web interface on the port 50000. > > Does anyone have any advice what to do? How to make it work? > Any advice appreciated, > > Best regards > > Michael > > > ---------------------------------------------------------------------------- -- > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp as they present alongside digital heavyweights like Barbarian > Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers

2 3

Re: [MonetDB-users] connection terminated
by Christoph Beekmans 05 Jun '09

05 Jun '09

> hi, > i started to have suddenly following problem with the M5Server. I can > start > the server and get the following screen which seems fine: > > # MonetDB server v5.10.2, based on kernel v1.28.2 > # Serving database 'demo', using 1 thread > # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked > # Copyright (c) 1993-July 2008 CWI. > # Copyright (c) August 2008- MonetDB B.V., all rights reserved > # Visit http://monetdb.cwi.nl/ for further information > #warning: please don't forget to set your vault key! > #(see C:\Program Files\MonetDB\MonetDB5\etc\monetdb5.conf) > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > # MonetDB/SQL module v2.28.2 loaded > > When i start the client I get following message and the server shuts down: > > Connection terminated > Press any key to continue . . . > > I have tried to reinstall monetDb but it does not help. can anyone > point me > into the right direction? > Thanks Hi, i have the same problem. It started after i sent a query refering to the geom module. Maybe someone has an idea? Thanks

1 0

[MonetDB-users] Announcement: New feature release of MonetDB suite
by Sjoerd Mullender 05 Jun '09

05 Jun '09

The MonetDB team at CWI/MonetDB BV are pleased to announce the new "May2009" feature release of the MonetDB suite of programs. This is a feature release, however it is is (mostly) backward compatible with the previous releases (Nov2008 and Feb2009). The two slight incompatibilities are: - The way string data is stored was changed for 64-bit architectures with 32-bit OIDs. There is however an automatic conversion on startup of the server. The biggest problem is, you can't go back to an older version once the new version has run. This incompatibility affects only the Windows 64 bit build (the other 64 bit builds use 64-bit OIDs). - The default location of the write-ahead log (WAL) has changed. This is relevant for both MonetDB5/SQL and MonetDB4/XQuery on all platforms. When the server first starts on an existing database, it will notice that the WAL is missing and will refuse to continue with a message which indicates where the WAL is now expected. You can either use a command line option to tell the server where the WAL is, or you can manually move the WAL to the new location. This latter option is done automatically on Windows when you use the Start menu to start the server. More information on the new release (and the above mentioned incompatibilities) is available at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/May2009/>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

2 1

[MonetDB-users] May 2009 Windows binaries - no Python bindings
by Pawel Lewicki 05 Jun '09

05 Jun '09

Hi, Would it be possible to get compiled Windows Python bindings? They are missing in installer and previous version is not compatible with recent server. Paweł Lewicki

2 1

Re: [MonetDB-users] [Monetdb-developers] problems with starting the monetDB4xquery server + ATTACHEMENTS
by Mtekel 04 Jun '09

04 Jun '09

This mail contains attached files I described in the previous one... Michael -----Original Message----- From: Ying Zhang [mailto:Y.Zhang@cwi.nl] Sent: 2. júna 2009 10:41 To: Mtekel Cc: monetdb-developers(a)lists.sourceforge.net Subject: Re: [Monetdb-developers] problems with starting the monetDB4xquery server Hello Michael, Thanks for using MonetDB, and sorry for the inconvenience! Your problem has been reported earlier. Unfortunately, we don't have a solution for this problem at this moment. However, there is a workaround, which seems to work according to other users. So please have a look at the following bug report (the workaround is in the report): http://sourceforge.net/tracker/index.php?func=detail&aid=2693363&group_id=56 967&atid=482468 Kind regards, Jennie On Mon, Jun 01, 2009 at 10:55:45AM +0200, Mtekel wrote: > Hello, > > I have problems starting the monetDB xquery server under windowsXP sp3. When > I click on the link in the start menu, dos window appears but then it closes > immediatelly and I can't see what's there (after pausing I can see only the > first 6 lines of the program output as described below, then after unpausing > it immediatelly quits and closes the window). If I run MXQserver.bat, or > Mserver.bat --dbinit="module(pathfinder);" I get only this: > > # MonetDB Server v4.28.4 > # based on GDK v1.28.4 > # Copyright (c) 1993-July 2008, CWI. All rights reserved. > # Copyright (c) August 2008-2009, MonetDB B.V.. All rights reserved. > # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. > # Visit http://monetdb.cwi.nl/ for further information. > # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah > > That's all. The server immediatelly ends. However If I run only Mserver.bat, > the server "runs" - I get the prompt, but for example I can't connect to the > web interface on the port 50000. > > Does anyone have any advice what to do? How to make it work? > Any advice appreciated, > > Best regards > > Michael > > > ---------------------------------------------------------------------------- -- > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp as they present alongside digital heavyweights like Barbarian > Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers

1 0

[MonetDB-users] Best way to lookup a varchar field?
by Henri Asseily 04 Jun '09

04 Jun '09

Hi, I've got a very simple table structure in SQL, with a non-unique varchar field and a few other fields including a CLOB. I found that it's abnormally slow to filter the varchar field with an 'IN' statement and simply return the CLOB. i.e.: select clob from x where varchar in ('a','b','c') With a couple million rows, the query is in multiple seconds if the results are around a couple thousand rows. Is there something I'm doing wrong? I should be just the varchar BAT filter, then join on the CLOB BAT. Should I manually assign the varchars to integers in another table and use ints on this table? That would be surprising... Thanks. H

2 1

[MonetDB-users] Memory Allocation errors
by Rob Wickert 04 Jun '09

04 Jun '09

Hi all, I've been testing MonetDB and I've been getting strange memory allocation errors while running large 'group by' queries. From a dataset of around 60GB, I'm running 'group by' queries against it to test for speed. Queries of the sort: select keyword, count(*) as c from raw_data group by keyword order by c desc limit 100; What's happening is that it will trundle along ok for a while, generally consuming all the available memory (98%) on 3GB box. But after a while I get these messages on the server: # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.28.4 loaded >#GDKmmap(10412883968) fails, try to free up space [memory in use=72431192,virtual memory in use=71134150656] #GDKmmap(10412883968) result [mem=71387384,vm=71134150656] #GDKvmalloc(10412883984) fails, try to free up space [memory in use=71386904,virtual memory in use=71134150656] #GDKvmalloc(10412883984) result [mem=71130480,vm=71134150656] !ERROR: HEAPalloc: Insufficient space for HEAP of 10412883968 bytes. Also while checking top it will reports a much large RES size than physical memory. E.g. (250% for %MEM). I haven't changed any out of the box settings. Is there a minimum memory size that MonetDB requires to play nice? Is there anywhere I can go to limit the amount of memory MonetDB requires? The version I'm using is: mserver5 --version MonetDB server v5.10.4 (64-bit), based on kernel v1.28.4 (64-bit oids) Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Configured for prefix: /usr Libraries: libpcre: 6.6 06-Feb-2006 (compiled with 6.6) openssl: OpenSSL 0.9.8e-rhel5 01 Jul 2008 (compiled with OpenSSL 0.9.8e-fips-rhel5 01 Jul 2008) libxml2: 2.6.26 (compiled with 2.6.26) Compiled by: mockbuild(a)surya.karan.org Compilation: gcc -O2 -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize Linking : ld -IPA -m elf_x86_64 Cheers

2 3

[MonetDB-users] LIKE queries failing
by Rob Wickert 04 Jun '09

04 Jun '09

Hi all, I'm having problems with MonetDB5 while performing LIKE queries against it. Normal queries work fine, but anything with a LIKE in it gets this response: sql> select * from raw_data where keyword like 'apple%' limit 1; !MALException:batcalc.str:can not create bat 0 tuples Any ideas? This is the version of mserver5 I'm using: MonetDB server v5.10.4 (64-bit), based on kernel v1.28.4 (64-bit oids) Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Configured for prefix: /usr Libraries: libpcre: 6.6 06-Feb-2006 (compiled with 6.6) openssl: OpenSSL 0.9.8e-rhel5 01 Jul 2008 (compiled with OpenSSL 0.9.8e-fips-rhel5 01 Jul 2008) libxml2: 2.6.26 (compiled with 2.6.26) Compiled by: mockbuild(a)surya.karan.org Compilation: gcc -O2 -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize Linking : ld -IPA -m elf_x86_64 Cheers

2 1