January 2009 - developers-list

[Monetdb-developers] MonetDb comparison Data Load
by Prometheus WillSurvive 19 Jan '09

19 Jan '09

Dear Developers-Users, First of all I would like to thanks all of your afforts to birng us these DB technologies and a platform for openly discussion. We are consulting big sized customers and deploying their data search technologies. Total size is around 1 petabytes daily . (total of our customers number ) . Their data size starts 1 TB (9.000.000.000 lines cvs) to 100 TB. so we have different size of customer base. We are looking opensource db solutions for a while due to lack of support and technological cumbersome of the current commercial solutions. We have 3 test customer now : 1-1 TB data dailiy read only purposes. 9.000.000.000 cvs file should be load to database . Data should be load to the database max 2 hours. after that comlex crm analitic queries. max 10 concurrent user/queries. database will be daily and wil not grow dailiy. so limit is 1 TB data load. 2-10 TB data daily. same as above .. 3-50 TB data stabil. will not grow. So we are looking for a solutions: *Fast data loading. How fast we load data to the MonetDB ? Is it could be multithreaded data loading possible ? *Is it possible to MPP ? can we add more server to share cpu resources and decrease the load time ? what is the best HW solution for above first customer ? Do we need still fat enterrprise servers or what ? We are also looking for InfoBright, Vertica and also Luciddb. VErtica is not opensource so out of the list. Infobright seems not giving its full power in the opensource.. Also we heard about the MonetDB X100 and interested. After 3 months succefully test we will support monetDB developer if its solved our problems. We can pay . Best Regards W.S

1 0

[Monetdb-developers] MonetDB Comparison and Power
by willsurvive 19 Jan '09

19 Jan '09

Dear Developers-Users, First of all I would like to thanks all of your afforts to birng us these DB technologies and a platform for openly discussion. We are consulting big sized customers and deploying their data search technologies. Total size is around 1 petabytes daily . (total of our customers number ) . Their data size starts 1 TB (9.000.000.000 lines cvs) to 100 TB. so we have different size of customer base. We are looking opensource db solutions for a while due to lack of support and technological cumbersome of the current commercial solutions. We have 3 test customer now : 1-1 TB data dailiy read only purposes. 9.000.000.000 cvs file should be load to database . Data should be load to the database max 2 hours. after that comlex crm analitic queries. max 10 concurrent user/queries. database will be daily and wil not grow dailiy. so limit is 1 TB data load. 2-10 TB data daily. same as above .. 3-50 TB data stabil. will not grow. So we are looking for a solutions: *Fast data loading. How fast we load data to the MonetDB ? Is it could be multithreaded data loading possible ? *Is it possible to MPP ? can we add more server to share cpu resources and decrease the load time ? what is the best HW solution for above first customer ? Do we need still fat enterrprise servers or what ? We are also looking for InfoBright, Vertica and also Luciddb. VErtica is not opensource so out of the list. Infobright seems not giving its full power in the opensource.. Also we heard about the MonetDB X100 and interested. After 3 months succefully test we will support monetDB developer if its solved our problems. We can pay . Best Regards W.S -- View this message in context: http://www.nabble.com/MonetDB-Comparison-and-Power-tp21541998p21541998.html Sent from the monetdb-developers mailing list archive at Nabble.com.

1 0

[Monetdb-developers] prepare for release
by Sjoerd Mullender 14 Jan '09

14 Jan '09

This is a heads-up. Next week I will create a new bug fix release, so please fix the last remaining bugs in the stable branch now. When the bug fix release has been done, I will create a new stable branch based on the development branch in preparation for the February feature release. This means that if there is anything that you want in that release, implement it now. Once the branch has been made, we will have a few weeks to stabilize the new stable branch before it is released. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime/xrpc/admin/Tests add_del_doc.xq.in, Nov2008, 1.1.4.3, 1.1.4.4 add_del_doc_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2 add_trusted.mil, Nov2008, 1.1.4.2, 1.1.4.3 backup_restore.xq.in, Nov2008, 1.1.4.5, 1.1.4.6 backup_restore_noxrpc.xq.in, Nov2008, 1.1.2.2, 1.1.2.3 db_env.xq.in, Nov2008, 1.1.4.2, 1.1.4.3 db_env_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2 db_stats.xq.in, Nov2008, 1.1.4.2, 1.1.4.3 db_stats_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2
by Sjoerd Mullender 12 Jan '09

12 Jan '09

On 2009-01-12 17:16, Ying Zhang wrote: > Sorry, forgot to mention: please don't propagate these changes to HEAD! I took care of that. > Thanks. > > Jennie > > > On Mon, Jan 12, 2009 at 04:01:02PM +0000, Ying Zhang wrote: >> Update of /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv10518 >> >> Modified Files: >> Tag: Nov2008 >> add_del_doc.xq.in add_del_doc_noxrpc.xq.in add_trusted.mil >> backup_restore.xq.in backup_restore_noxrpc.xq.in db_env.xq.in >> db_env_noxrpc.xq.in db_stats.xq.in db_stats_noxrpc.xq.in >> Log Message: >> - *.xq.in >> >> the xrpc http server is not available (yet) in RunMtest, hence, use the module >> file 'admin.xq'-s local path, instead of using its URL served by the xrpc http server. >> >> -add_trusted.mil >> >> allow 'admin.xq' to be executed >> >> >> >> U add_del_doc.xq.in >> Index: add_del_doc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_del_doc.xq.in,v >> retrieving revision 1.1.4.3 >> retrieving revision 1.1.4.4 >> diff -u -d -r1.1.4.3 -r1.1.4.4 >> --- add_del_doc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.4.3 >> +++ add_del_doc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.4 >> @@ -11,17 +11,17 @@ >> - adm:del-doc() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> (execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", >> "xmark1.xml", "xmark", 10)}, >> execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", >> "xmark2.xml", "xmark", 10)} >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-add>{ >> @@ -61,11 +61,11 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-del>{ >> >> U backup_restore_noxrpc.xq.in >> Index: backup_restore_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/backup_restore_noxrpc.xq.in,v >> retrieving revision 1.1.2.2 >> retrieving revision 1.1.2.3 >> diff -u -d -r1.1.2.2 -r1.1.2.3 >> --- backup_restore_noxrpc.xq.in 9 Jan 2009 14:40:24 -0000 1.1.2.2 >> +++ backup_restore_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.3 >> @@ -15,13 +15,13 @@ >> - adm:restore-col() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> -(adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> - adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> +(adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> + adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-before-backup>{ >> @@ -38,23 +38,23 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:backup("test") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-del>{ adm:collections() }</db-after-del> >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:restore("test", 10) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-after-restore>{ >> @@ -73,11 +73,11 @@ >> <> >> (: clean DB at the end of the test :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-cleanup> >> { adm:documents() } >> </db-after-cleanup> >> >> U db_env_noxrpc.xq.in >> Index: db_env_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_env_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- db_env_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ db_env_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $env in adm:db-env() >> return >> (text { "
 " }, >> >> U db_stats.xq.in >> Index: db_stats.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_stats.xq.in,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- db_stats.xq.in 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ db_stats.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $stat in execute at {"$HOST:$XRPCPORT"} {adm:db-stats()} >> return >> (text { "
 " }, >> >> U add_del_doc_noxrpc.xq.in >> Index: add_del_doc_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_del_doc_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- add_del_doc_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ add_del_doc_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -11,13 +11,13 @@ >> - adm:del-doc() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> -(adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> - adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> +(adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> + adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-add>{ >> @@ -57,11 +57,11 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-del>{ >> >> U db_stats_noxrpc.xq.in >> Index: db_stats_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_stats_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- db_stats_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ db_stats_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $stat in adm:db-stats() >> return >> (text { "
 " }, >> >> U db_env.xq.in >> Index: db_env.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_env.xq.in,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- db_env.xq.in 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ db_env.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $env in execute at {"$HOST:$XRPCPORT"} {adm:db-env()} >> return >> (text { "
 " }, >> >> U add_trusted.mil >> Index: add_trusted.mil >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_trusted.mil,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- add_trusted.mil 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ add_trusted.mil 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -2,12 +2,17 @@ >> module("unix"); >> >> var TSTSRCDIR := getenv("TSTSRCDIR"); >> +var TSTSRCBASE := getenv("TSTSRCBASE"); >> var TSTTRGDIR := getenv("TSTTRGDIR"); >> +var TSTTRGBASE := getenv("TSTTRGBASE"); >> var HOST := getenv("HOST"); >> var XRPCPORT := getenv("XRPCPORT"); >> >> add_xrpc_trusted(TSTSRCDIR); >> +add_xrpc_trusted(TSTSRCBASE); >> + >> add_xrpc_trusted(TSTTRGDIR); >> +add_xrpc_trusted(TSTTRGBASE); >> add_xrpc_trusted("http://"+HOST+":"+XRPCPORT); >> >> commit(); >> >> U backup_restore.xq.in >> Index: backup_restore.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/backup_restore.xq.in,v >> retrieving revision 1.1.4.5 >> retrieving revision 1.1.4.6 >> diff -u -d -r1.1.4.5 -r1.1.4.6 >> --- backup_restore.xq.in 9 Jan 2009 14:40:24 -0000 1.1.4.5 >> +++ backup_restore.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.6 >> @@ -15,17 +15,17 @@ >> - adm:restore-col() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> (execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", >> "xmark1.xml", "xmark", 10)}, >> execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", >> "xmark2.xml", "xmark", 10)} >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-before-backup>{ >> @@ -42,25 +42,25 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:backup("test")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-del>{ >> execute at {"$HOST:$XRPCPORT"} {adm:collections()} >> }</db-after-del> >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:restore("test", 10)} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-after-restore>{ >> @@ -79,11 +79,11 @@ >> <> >> (: clean DB at the end of the test :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-cleanup> >> { execute at {"$HOST:$XRPCPORT"} {adm:documents()} } >> </db-after-cleanup> >> >> >> ------------------------------------------------------------------------------ >> Check out the new SourceForge.net Marketplace. >> It is the best place to buy or sell services for >> just about anything Open Source. >> http://p.sf.net/sfu/Xq1LFB >> _______________________________________________ >> Monetdb-pf-checkins mailing list >> Monetdb-pf-checkins(a)lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/Tests usage.stable.out, , 1.19, 1.20 usageH.stable.out, , 1.49, 1.50
by Stefan Manegold 09 Jan '09

09 Jan '09

On Fri, Jan 09, 2009 at 09:50:35AM +0000, Jan Rittinger wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17274/Tests > > Modified Files: > usage.stable.out usageH.stable.out > Log Message: > -- Adjust help messages to the new copyright information. Just for info for you and for who ever will take care of updating the stable output accordingly in the Nov2008 release branch and then (not) propagating it to the development trunk (most probably Sjoerd or me ...): The copyright information has obviously also been updated in the Nov2008 release branch, and the stable output for the respective tests should be updated there as well --- propagating these updates *might* then cause (probably easily resolvable) conflicts as the stable output in the development trunk has just experienced two changes: new copyright and new usage info. Note, this is neither a critique nor a major problem, but just to share information that might help to reduce / prevent inconveniences, in particular with (semi-automa[tgn]ic) propagation of chnages from the latest release branch to the development trunk. (For the future, the "ideal" procedure would (have) be(en) to first update the copyright info in the stable output of the release branch, then propagate these changes, and then update / extend the usage info in the development trunk and update the stable output there accordingly. ;-)) Stefan > -- Extend help message 'pf -H' to list all available optimization phases. > > > U usageH.stable.out > Index: usageH.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/Tests/usageH.stable.out,v > retrieving revision 1.49 > retrieving revision 1.50 > diff -u -d -r1.49 -r1.50 > --- usageH.stable.out 2 Dec 2008 17:30:41 -0000 1.49 > +++ usageH.stable.out 9 Jan 2009 09:50:33 -0000 1.50 > @@ -11,7 +11,7 @@ > # 15:43:45 > > > Pathfinder XQuery Compiler ($Revision$, $Date$) > -(c) Database Group, Technische Universitaet Muenchen > +(c) Database Systems Group, Eberhard Karls Universitaet Tuebingen > > Usage: pf [OPTION] [FILE] > > @@ -38,6 +38,9 @@ > = -p, --physical-algebra-plan: enable generation of physical algebra plan > = -f<format>, --format=<format>: enable generation of algebra properties > + print all available properties (logical/physical algebra) > + <optoptions> selectively choose optimization options that are based > + on a single property (e.g., 'O') to print the respective > + property > c print cost value (physical algebra) > o print orderings (physical algebra) > > @@ -65,23 +68,30 @@ > 21 after compiling the physical algebra into MIL code > 22 after the MIL program has been serialized > > -= -o<options>, --optimize-algebra=<options>: optimize algebra according to options: > += -o<optoptions>, --optimize-algebra=<optoptions>: optimize algebra according to optimization options: > + E merge common subexpressions (CSE) > + G apply general optimization (without properties) > O apply optimization based on constant property > I apply optimization based on icols property > K apply optimization based on key property > - C apply optimization using multiple properties (complex) > - (and icols based optimization will be applied afterwards) > - G apply general optimization (without properties) > + N apply optimization based on required node values property > V apply optimization based on required values property > - [ map column names to unique column names > - J push down equi-joins (requires unique column names) > - ] map column names back (from unique names to original names) > - M apply optimization based on multi-value dependencies > S apply optimization based on set property > + U apply optimization based on XML Guide information > + (only works for the SQL code generation) > + C apply optimization using multiple properties (complex) > + (and icols based optimization will be applied afterwards) > + J push down equi-joins > + M push up cross products (based on multi-value dependencies > + T push up theta-joins (based on multi-value dependencies > + R push up rank operators > } introduce proxy operators that representoperator groups > { remove proxy operators > + Q apply optimizations tailored for the SQL code generation > + [ assign a new set of unique column names > + ] assign bit-encoded column names (deprecated optimization option) > P infer all properties > - _ does nothing (used for structuring the options) > + _ does nothing (used for structuring the optimization options) > (default for option -A is: '-o OIKCG_VG_JISI_GECSVR_OK_N}MT{JISI_GECSVR_}MT{JISI_OK_GECSVR_GP') > (default for option -S is: '-o OIKCG_VG_JISI_GECSVR_OK_N}MT{JISI_GECSVR_Q_}MT{JISI_OK_GECSVR_QGP') > > > U usage.stable.out > Index: usage.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/Tests/usage.stable.out,v > retrieving revision 1.19 > retrieving revision 1.20 > diff -u -d -r1.19 -r1.20 > --- usage.stable.out 19 Jun 2008 14:13:10 -0000 1.19 > +++ usage.stable.out 9 Jan 2009 09:50:33 -0000 1.20 > @@ -11,7 +11,7 @@ > # 13:16:47 > > > Pathfinder XQuery Compiler ($Revision$, $Date$) > -(c) Database Group, Technische Universitaet Muenchen > +(c) Database Systems Group, Eberhard Karls Universitaet Tuebingen > > Usage: pf [OPTION] [FILE] > > > > ------------------------------------------------------------------------------ > Check out the new SourceForge.net Marketplace. > It is the best place to buy or sell services for > just about anything Open Source. > http://p.sf.net/sfu/Xq1LFB > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [MonetDB-users] COPY INTO on aggregate queries crashes MonetDB
by Martin Kersten 04 Jan '09

04 Jan '09

Dear Peter, The problem mentioned could be reproduced. It is clearly a bug and registered as such in test copy-count.SF-2485215.sql. It seems a bug in the code generator of SQL. The progress can be followed in the sourceforge bugtracker. Thanks for using the MonetDB package and helping to improve its quality. regards, Martin Peter Farkash wrote: > Hi, > > When I use COPY INTO with a count query, monetDB crashes. > For example: > > copy select count (*) into 'C:\\copyinto.txt' using delimiters ','; > > Gives me the following result and kills the server: > > MAPI = monetdb@localhost:50000 > ACTION= read_line > QUERY = copy select count (*) into 'C:\\copyinto.txt' using delimiters ','; > ERROR = Connection terminated > > The same happens if I use sum, average, etc. On normal queries the copy into > works just fine. > I am using v5.8.2, and am getting the crash both when using mclient and the > MAPI programming interface. > > Any ideas? >

1 0

[Monetdb-developers] MonetDB at Ohloh
by Marcin Zukowski 03 Jan '09

03 Jan '09

Dear MonetDB Devs, As a pre-xmas present, I wanted to update MonetDB site on Ohloh.net - a site that has an ambition (and maybe a chance) to become a central information repository about FOSS projects and developers: https://www.ohloh.net/p/10306 Unfortunately, the code-analysis part of the site does not seem to like the 'sql' module, as it hangs during checking out its history: https://www.ohloh.net/p/10306/enlistments I contacted the Ohloh team, and it seems the error occurs at the following command: ~$ cvsnt -d :pserver:anonymous:@monetdb.cvs.sourceforge.net:/cvsroot/monetdb checkout -D'2001/06/07 13:41:21Z' -A -d'monetdb' 'sql' cvs checkout: Updating monetdb ... cvs [checkout aborted]: invalid change text in /cvsroot/monetdb/sql/src/odbc/driver/Attic/statement_dump.c,v If you think being properly visible on Ohloh is worth it, perhaps this is something some local CVS expert could investigate ;) Otherwise, we can remove the 'sql' module and hope the other ones work properly. cheers, Marcin

3 3