May 2007 - users-list

[MonetDB-users] other than to quit smoking.
by Odette Spears 21 May '07

21 May '07

GPSI Announces Market Attack Into $1 Trillion Market! Global Payment Solutions Symbol: GPSI Price: $0.03 GPSI announced its plans to address the huge influx of immigrant workers into the US that need banking solutions that they otherwise would not qualify for. This market is expected to represent over $1 Trillion dollars to be managed by 2008. GPSI provides viable solutions to this market. This is hot, read the news and watch for more Monday! Get on GPSI first thing Monday! The obvious step forward is to attempt to greatly extend healthy life spans in mice by preventing mitochondrial damage, repairing it as it occurs, or making it irrelevant. " Projects like this demonstrate that real progress has been made in stem cell basics. other than to quit smoking. The obvious step forward is to attempt to greatly extend healthy life spans in mice by preventing mitochondrial damage, repairing it as it occurs, or making it irrelevant. " Projects like this demonstrate that real progress has been made in stem cell basics. other than to quit smoking.

1 0

[MonetDB-users] Syntax in Query causes a Server Crash - Critical
by Venks 21 May '07

21 May '07

Hi, The following query has a syntax issue. But instead of reporting the syntax error, the server crashes. select count(*) from (select col2, count(*) as row_count from data_1to10 group by col2 order by row_count desc, col1) sq I have attached a PERL script which can be used to generate the required data for testing. I have also attached a table definition script and the load script. Please use the attached PERL script to generate the data as follows: ./massrecs.pl > <filename> You will need to edit the "test_load_tables.sql" script to update the filename according to the name given. Please let me know if you are unable to execute the test for any reason. Thanks, - Venkatesh

2 1

[MonetDB-users] M5 SQL load data with "copy into" behaviour and 32 bits limitation
by Franco Guidoli 20 May '07

20 May '07

Hi all: I'm testing MonetDB5 to know if it's suitable for an OLAP project. I have to load a bit more than 11.5 million rows into one table, and I get the following results (I'm working on a Windows 2000 Professional 32 bits box with 1GB RAM and Monet v5.0.0_beta1_2): - when I try to load all the data in a single "copy into", mserver crashes at a certain point. - when I try to load the data in 100K chunks with several "copy into" into the same sql session, the server crashes at 7.8 million rows, and when I try to load the rest of the data it gets loaded, but the first 7.8 million rows get corrupt and the rest get ok. - when I load the data in 100K chunks in 5 different times (2.6 million rows each time) everything gets ok; after every 2.6 million I disconnect from sql client and shutdown the server, so when I restart the server and connect from sql client all the logs get persistent (thanks to Niels Nes to explain simply that logs get persistent after a server restart and when a sql session starts). So, initially I thought that MonetDB couldn't load that amount of data in a 32 bits box, but after all it can, because at last the data was successfully loaded. Is there a limitation with the "copy into"? Is there a way to achieve this process without restarting the server and sql sessions? I've read some threads about 32 bits limitation, but I don't know for sure how to calculate the maximum rows I can have into a single table. In my case, the table has a 147 bytes length using the following sizes in data types: smallint --> 2 bytes int --> 4 bytes char(2) --> 2 bytes the limitation would be 2GB / 147 bytes --> 14.608.732 rows ? I've assumed this after what I've read, but please let me know if I'm doing a wrong calculation. Thanks in advance, Franco -- View this message in context: http://www.nabble.com/M5-SQL-load-data-with-%22copy-into%22-behaviour-and-3… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] latest build cannot connect from remote client
by Colin Foss 17 May '07

17 May '07

I installed MonetDB5 using monetdb-install.sh. I d/l'ed the script today. The binaries compiled fine but I am unable to connect from a different computer besides the host. i.e. mserver5 running on serverA, client running on desktopB. desktopB> MapiClient -l sql -h serverA -umonetdb MapiClient never returns. In another window I ran netstat and can see the connection from desktopB to serverA on the correct port (50000). Using 'telnet serverA 50000' I can see mserver5 responding with: 46:avuaOb0v:mserver:7:SHA1,MD5,crypt,plain:3412 Any ideas?

3 4

[MonetDB-users] Query Bug
by Venks 16 May '07

16 May '07

Hi, The following query works for the first time: WITH t AS ( SELECT * FROM tables ) SELECT * FROM t If I execute the query again, it gives the following error: Variable 't' allready declared If I change the alias from "t" to "t2" it works for the first time and then gives the error on second execution. Please look into this and correct this bug. Thanks, - Venkatesh

1 0

[MonetDB-users] GDK Error on a query joining non-key columns
by Venks 16 May '07

16 May '07

Hi, I get the following error: MALException:algebra.join:GDKerror ERROR: GDKload failed: name=02/45/24557, ext=buns.priv while executing the following query: select count(*) from ( select 1 from data_1to10 a, data_10to20 b where a.col2 = b.col2 ) sq I have attached a PERL script which is used to generate the required data for testing. I have also attached a table definition script and the load script. Please use the attached PERL script to generate the data as follows: ./massrecs.pl > <filename> After generating the first file, you will need to update the PERL script to change the numbers in the for loop, so that the next 20 million rows from 10,000,001 to 20,000,000 are generated. You will also need to edit the "test_load_tables.sql" script to update the filename according to the name given. Please let me know if you are unable to execute the test for any reason. Thanks, - Venkatesh

1 0

[MonetDB-users] XRPC problem: too many parameters
by Makoto YUI 16 May '07

16 May '07

Hi, I caught an error (see attached file) at the remote method invocation of XRPC. While I'm not sure whether my query is correct or not, is there imitation of parameters in XRPC? The query and dataset used in the evaluation are put on here. http://db-www.naist.jp/~makoto-y/tmp/xrpc.tgz Thanks, Makoto YUI MAPI = monetdb@localhost:50000 QUERY = import module namespace test = "xrpc-test-function" at "/usr/share/MonetDB/xrpc/export/xrpc-mod.xq"; (: local database :) declare variable $blast-gb := fn:doc("blast-gb.xml")/result; declare variable $blast-uniprot := fn:doc("blast-uniprot.xml")/result; (: remote basebase :) declare variable $remote-endpoint := "xanadu.naist.jp"; let $gb_entry := (for $e in $blast-gb/BlastOutput let $hit := $e/BlastOutput_iterations/Iteration/Iteration_hits/Hit ERROR = !WARNING: doLoopLiftedRPC: error occurred during RPC call to "xanadu.naist.jp" !ERROR: CMDhttp_post: too many parameters. !ERROR: CMDhttp_post: operation failed. MAPI = monetdb@localhost:50000 QUERY = import module namespace test = "xrpc-test-function" at "/usr/share/MonetDB/xrpc/export/xrpc-mod.xq"; (: local database :) declare variable $blast-gb := fn:doc("blast-gb.xml")/result; declare variable $blast-uniprot := fn:doc("blast-uniprot.xml")/result; (: remote basebase :) declare variable $remote-endpoint := "xanadu.naist.jp"; let $gb_entry := (for $e in $blast-gb/BlastOutput let $hit := $e/BlastOutput_iterations/Iteration/Iteration_hits/Hit ERROR = !ERROR: doLoopLiftedRPC: execution failed at all destinations mapi_query_part:1705:import module namespace test = "xrpc-test-function" at "/usr/share/MonetDB/xrpc/export/xrpc-mod.xq"; (: local database :) declare variable $blast-gb := fn:doc("blast-gb.xml")/result; declare variable $blast-uniprot := fn:doc("blast-uniprot.xml")/result; (: remote basebase :) declare variable $remote-endpoint := "xanadu.naist.jp"; let $gb_entry := (for $e in $blast-gb/BlastOutput let $hit := $e/BlastOutput_iterations/Iteration/Iteration_hits/Hit where $hit/Hit_num = 1 and $hit/Hit_hsps/Hsp/Hsp_evalue/text() <= 1.0e-8 return $e), $uniprot_entry := (for $e in $blast-uniprot/BlastOutput let $hit := $e/BlastOutput_iterations/Iteration/Iteration_hits/Hit where $hit/Hit_num = 1 and $hit/Hit_hsps/Hsp/Hsp_evalue/text() <= 1.0e-8 return $e) where $gb_entry/BlastOutput_query-def/text() = $uniprot_entry/BlastOutput_query-def/text() return <result> { let $gb-hit := $gb_entry/BlastOutput_iterations/Iteration/Iteration_hits/Hit, $gb-key := $gb-hit/Hit_gb/text() return let $genbank-remote-entries := execute at {$remote-endpoint} { test:q1($gb-key) } for $remote_entry at $pos in $genbank-remote-entries let $gb_definition := $remote_entry/INSDSeq_definition, $gb_feature := $remote_entry/INSDSeq_feature-table/INSDFeature, $blast_evalue := $gb-hit[Hit_gb/text() = $remote_entry/INSDSeq_accession-version/text()]/Hit_hsps/Hsp/Hsp_evalue return <genbank num="{ $pos }">{ $blast_evalue, $gb_definition, $gb_feature } </genbank> } </result> fetch next block: start at:2 got next block: length:269 text:XRPC_Client_Serialisation: 626 microsec !WARNING: doLoopLiftedRPC: error occurred during RPC call to "xanadu.naist.jp" !ERROR: CMDhttp_post: too many parameters. !ERROR: CMDhttp_post: operation failed. !ERROR: doLoopLiftedRPC: execution failed at all destinations got complete block: text:XRPC_Client_Serialisation: 626 microsec !WARNING: doLoopLiftedRPC: error occurred during RPC call to "xanadu.naist.jp" !ERROR: CMDhttp_post: too many parameters. !ERROR: CMDhttp_post: operation failed. !ERROR: doLoopLiftedRPC: execution failed at all destinations read_line:XRPC_Client_Serialisation: 626 microsec allocating new result set XRPC_Client_Serialisation: 626 microsec got complete block: text:!WARNING: doLoopLiftedRPC: error occurred during RPC call to "xanadu.naist.jp" !ERROR: CMDhttp_post: too many parameters. !ERROR: CMDhttp_post: operation failed. !ERROR: doLoopLiftedRPC: execution failed at all destinations read_line:!WARNING: doLoopLiftedRPC: error occurred during RPC call to "xanadu.naist.jp" allocating new result set got complete block: text:!ERROR: CMDhttp_post: too many parameters. !ERROR: CMDhttp_post: operation failed. !ERROR: doLoopLiftedRPC: execution failed at all destinations read_line:!ERROR: CMDhttp_post: too many parameters. got complete block: text:!ERROR: CMDhttp_post: operation failed. !ERROR: doLoopLiftedRPC: execution failed at all destinations read_line:!ERROR: CMDhttp_post: operation failed. got complete block: text: !ERROR: doLoopLiftedRPC: execution failed at all destinations read_line: closing result set got complete block: text:!ERROR: doLoopLiftedRPC: execution failed at all destinations read_line:!ERROR: doLoopLiftedRPC: execution failed at all destinations allocating new result set fetch next block: start at:271 got next block: length:0 text: got complete block: text: read_line: closing result set closing result set Timer 1014.527 msec

1 0

[MonetDB-users] Persistent Stored Modules in MonetDB
by Venks 15 May '07

15 May '07

Is there any other documentation that I can get my hands on for understanding all the supported syntax for Persistent Stored Modules? The reference manual has nothing much and the examples as part of the MonetDB install are few. I am trying to find all the 4GL syntax that can be used while creating a persistent stored module. Thanks, - Venks

2 2

Re: [MonetDB-users] Cubulus OLAP tuning advice & first Monet benchmarks
by Martin Kersten 14 May '07

14 May '07

Would you be so kind to provide a "superball" ? MonetDB5-server in http://monetdb.cwi.nl/testing/projects/monetdb/Current/.DailyBuilds./ 0_latest/SourceTarBalls/ cannot be built on it's own.. In addition, on the Mac there is builtin readline (NetBSD: readline.h,v 1.11 2004/01/17) , and mclient does not use it. Headers: #include <readline/readline.h>, #include <readline/history.h> Libs: /usr/lib/libreadline.dylib Darwinports installed as dependency readline 5.0 : Headers: /opt/local/include/readline : chardefs.h history.h keymaps.h readline.h rlconf.h rlstdc.h rltypedefs.h tilde.h Libs: /opt/local/lib/libreadline.5.0.dylib /opt/local/lib/ libreadline.a /opt/local/lib/libreadline.5.dylib /opt/local/ lib/libreadline.dylib BR, Alex On May 13, 2007, at 9:21 PM, Martin Kersten wrote: > Hello, thanks to your report I was able to construct > a test case that uncovered an error in the decimal > conversion. I am not sure if this solves your > problem, but at least it avoids a series of errors. > > The problem occurred if you did not provide 4 decimal > digits. > > Added test decimal.SF-1718253 to BugTracker directory > > The updated version is in the head branch. > > Alexandru Toth wrote: >> Hello, >> Please advice on the rounding errors 73897488.0537 vs >> 74523898.6957. CREATE TABLE fact_cub ( >> figure decimal(10,4) DEFAULT NULL, >> dim_0 int DEFAULT NULL, >> dim_1 int DEFAULT NULL, >> dim_2 int DEFAULT NULL, >> dim_3 int DEFAULT NULL, >> dim_4 int DEFAULT NULL, >> dim_5 int DEFAULT NULL >> ) >> INSERT INTO fact_cub VALUES ('190.9420',4,49,39,17,3,2); >> INSERT INTO fact_cub VALUES ('998.9138',4,49,39,17,3,3); ...... >> As sanity check, the count(*) returns same number. >> sql>select count( figure ) from fact_cub where 4 <= dim_0 and >> dim_0 <= 15 and dim_4 = 2 and dim_5 = 2 and 57 <= dim_1 and dim_1 >> <= 64; >> % sys.fact_cub # table_name >> % count_no_nil_figure # name >> % int # type >> % 6 # length >> [ 149406 ] >> Timer 1611.294 msec >> sql>select 0, sum( figure ) from fact_cub where 4 <= dim_0 and >> dim_0 <= 15 and dim_4 = 2 and dim_5 = 2 and 57 <= dim_1 and dim_1 >> <= 64; >> % ., sys.fact_cub # table_name >> % single_value, sum_figure # name >> % smallint, decimal # type >> % 1, 12 # length >> [ 0, *73897488.0537 * ] >> Timer 1842.599 msec >> mysql> select count( figure ) from fact_cub where 4 <= dim_0 and >> dim_0 <= 15 and dim_4 = 2 and dim_5 = 2 and 57 <= dim_1 and dim_1 >> <= 64; >> +-----------------+ >> | count( figure ) | >> +-----------------+ >> | 149406 | >> +-----------------+ >> 1 row in set (13.59 sec) >> mysql> select 0, sum( figure ) from fact_cub where 4 <= dim_0 and >> dim_0 <= 15 and dim_4 = 2 and dim_5 = 2 and 57 <= dim_1 and dim_1 >> <= 64; >> +---+---------------+ >> | 0 | sum( figure ) | >> +---+---------------+ >> | 0 | *74523898.6957* | >> +---+---------------+ >> 1 row in set (7.45 sec) >> BR, Alexandru >> On May 13, 2007, at 4:26 PM, Martin Kersten wrote: >>> Alexandru Toth wrote: >>>> Hello, >>>> Replacing 2 comparisons with between is not necessarily faster >>>> in databases other than Monet. Proof (same 7 million rows table): >>> >>> We looked at the plans and noticed that indeed the optimizer missed >>> a point. It has been checked in the current trend. >>>> mysql> select 0, sum( figure ) from fact_cub where dim_0 between >>>> 4 and 15 and dim_4 = 2 and dim_5 = 2 and dim_1 between 57 and 64; >>>> +---+---------------+ >>>> | 0 | sum( figure ) | >>>> +---+---------------+ >>>> | 0 | 74523898.6957 | >>>> +---+---------------+ >>>> 1 row in set (13.14 sec) >>>> mysql> select 0, sum( figure ) from fact_cub where 4 <= dim_0 >>>> and dim_0 <= 15 and dim_4 = 2 and dim_5 = 2 and 57 <= dim_1 and >>>> dim_1 <= 64; >>>> +---+---------------+ >>>> | 0 | sum( figure ) | >>>> +---+---------------+ >>>> | 0 | 74523898.6957 | >>>> +---+---------------+ >>>> 1 row in set (7.51 sec) >>>> Replacing 2 comparisons with one logic AND might be faster, but >>>> SQL is not as readable >>>> Cheers, Alexandru >

2 1

[MonetDB-users] you are the man
by Wilbur Hammer 13 May '07

13 May '07

students of all ages. I can see in the next generation how implies that companies will have greater flexibility in regards soldier in a white cravat turns a key to launch the counter is a process of creativity and satisfaction of discovering new exemplified in the global economic system: European Economic photography, has too much basis in reality. It is about the way avant-garde will continually rear its unusual head where it's reacting to feedback from their surroundings. The premise behind my language. We are always partaking in our society to one In theory, our voice boxes would become non functional in a few artificial life. Computer generated living beings live and their industry, replication is rampant, to a certain degree, and hallucinogenic narcotics available in the market. People will substitute for the drugs I've never done though overloads do Without this communication network we may be thrown back into the can still be accessed in the traditional way, it can hang on your And frighten myself with the thought of my little ones burning vital information on disk. Even in this class, so many people a fascist government will experience greater control and order by place in the world at a cost comparable to a postage stamp. any artificial intelligence is our resilience, damage caused to a drawing by hand.These quickly redrawn views however, only remain As an Interior Design student I have noted what computer programs effects is astounding. New methods and techniques arise daily as an attempt, no matter how noble or heroic, to secure our freedom. is the idea of general purpose simulation, and went on to explain maker and memory storer. The one great advantage we have over

1 0