November 2008 - developers-list

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_abssyn.h, , 1.4, 1.5
by Stefan Manegold 27 Nov '08

27 Nov '08

On Thu, Nov 27, 2008 at 12:38:18PM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7993 > > Modified Files: > tjc_abssyn.h > Log Message: > - fix old_style extern fun() to extern fun(void) Thanks. ... in case you're curious, icc now (correctly ;-)) complains about ======== .../pathfinder/modules/pftijah/tjc/tjc_parse.y(54): error #593: variable "tjc_errbuff" was set but never used static char* tjc_errbuff; ^ compilation aborted for tjc_parse.tab.c (code 2) ======== Stefan > Thanks Stefan. > > > > U tjc_abssyn.h > Index: tjc_abssyn.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_abssyn.h,v > retrieving revision 1.4 > retrieving revision 1.5 > diff -u -d -r1.4 -r1.5 > --- tjc_abssyn.h 27 Nov 2008 10:53:17 -0000 1.4 > +++ tjc_abssyn.h 27 Nov 2008 12:38:15 -0000 1.5 > @@ -123,7 +123,7 @@ > tjcp_fixme (TJpnode_t *n1, TJpnode_t **n2); > > extern struct TJqnode_t * > -tjcq_initnode (); > +tjcq_initnode (void); > > extern struct TJqnode_t * > tjcq_firstterm (char *term, char *entity, double weight); > @@ -132,7 +132,7 @@ > tjcq_addterm (TJqnode_t *n, char *term, char *entity, double weight); > > extern struct TJptree_t * > -tjcp_inittree (); > +tjcp_inittree (void); > > extern char * > TJstrndup (const char *str); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_abssyn.c, , 1.2, 1.3 tjc_abssyn.h, , 1.3, 1.4 tjc_scan.l, , 1.1, 1.2
by Stefan Manegold 27 Nov '08

27 Nov '08

Jan F. (and others), On Thu, Nov 27, 2008 at 10:53:19AM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv1147 > > Modified Files: > tjc_abssyn.c tjc_abssyn.h tjc_scan.l > Log Message: > fix Windows&icc compiler problems > - old-style parameter list (anachronism) this problem is not fixed, yet; Intel's icc did (and still does) complain about the old-style *parameter list*, not about the return-type declaration: ======== /ufs/manegold/_/scratch0/Monet/Testing/Current/source/pathfinder/modules/pftijah/tjc/tjc_abssyn.h(126): error #310: old-style parameter list (anachronism) tjcq_initnode (); ^ /ufs/manegold/_/scratch0/Monet/Testing/Current/source/pathfinder/modules/pftijah/tjc/tjc_abssyn.h(135): error #310: old-style parameter list (anachronism) tjcp_inittree (); ^ compilation aborted for /ufs/manegold/_/scratch0/Monet/Testing/Current/source/pathfinder/modules/pftijah/tjc/tjc_milprint.c (code 2) ======== For your info, fcn_name(); ^^ is "old-style"; "new-style" is fnc_name(void); ^^^^^^ Stefan > U tjc_abssyn.h > Index: tjc_abssyn.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_abssyn.h,v > retrieving revision 1.3 > retrieving revision 1.4 > diff -u -d -r1.3 -r1.4 > --- tjc_abssyn.h 26 Nov 2008 10:00:24 -0000 1.3 > +++ tjc_abssyn.h 27 Nov 2008 10:53:17 -0000 1.4 > @@ -110,28 +110,28 @@ > > /* interfaces to parse construction routines > */ > -extern TJpnode_t * > +extern struct TJpnode_t * > tjcp_leaf (TJptree_t *t, TJptype_t type); > > -extern TJpnode_t * > +extern struct TJpnode_t * > tjcp_wire1 (TJptree_t *t, TJptype_t type, TJpnode_t *n1); > > -extern TJpnode_t * > +extern struct TJpnode_t * > tjcp_wire2 (TJptree_t *t, TJptype_t type, TJpnode_t *n1, TJpnode_t *n2); > > -extern TJpfixme_t * > +extern struct TJpfixme_t * > tjcp_fixme (TJpnode_t *n1, TJpnode_t **n2); > > -extern TJqnode_t * > +extern struct TJqnode_t * > tjcq_initnode (); > > -extern TJqnode_t * > +extern struct TJqnode_t * > tjcq_firstterm (char *term, char *entity, double weight); > > -extern TJqnode_t * > +extern struct TJqnode_t * > tjcq_addterm (TJqnode_t *n, char *term, char *entity, double weight); > > -extern TJptree_t * > +extern struct TJptree_t * > tjcp_inittree (); > > extern char * > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_scan.l, , 1.2, 1.3
by Stefan Manegold 27 Nov '08

27 Nov '08

On Thu, Nov 27, 2008 at 11:03:29AM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv3513 > > Modified Files: > tjc_scan.l > Log Message: > - defining an empty ECHO should solve the fwrite() problem I think. I copied > this solution which first did not make any sense from nexi.l. Works. Thanks. Alternative (in case ECHO was used) would have been to disable the strict checks for (flex-/bison-) generated code, e.g., via ======== Index: buildtools/conf/MonetDB.m4 =================================================================== RCS file: /cvsroot/monetdb/buildtools/conf/MonetDB.m4,v retrieving revision 1.99 diff -u -r1.99 MonetDB.m4 --- buildtools/conf/MonetDB.m4 27 Nov 2008 08:04:34 -0000 1.99 +++ buildtools/conf/MonetDB.m4 27 Nov 2008 11:46:09 -0000 @@ -758,7 +758,7 @@ dnl locally as possible via "-Wno-undef" dnl (see also MonetDB4/src/monet/Makefile.ag, sql/src/server/Makefile.ag, dnl pathfinder/modules/pftijah/Makefile.ag). - GCC_BISON_CFLAGS="$GCC_BISON_CFLAGS -Wno-undef" + GCC_BISON_CFLAGS="$GCC_BISON_CFLAGS -Wno-undef -Wp,-U_FORTIFY_SOURCE" dnl Likewise, at least with gcc 4.3.0 and flex 2.5.33 and bison 2.3 on Gentoo 1.12.11.1, dnl gcc complains about some bison/flex-generated code that defines an unused static function: dnl "warning: 'input' defined but not used". ======== Stefan > > > U tjc_scan.l > Index: tjc_scan.l > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_scan.l,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- tjc_scan.l 27 Nov 2008 10:53:17 -0000 1.2 > +++ tjc_scan.l 27 Nov 2008 11:03:26 -0000 1.3 > @@ -49,6 +49,8 @@ > YY_FATAL_ERROR( "input in tijah flex scanner failed" ); > #endif > > +#define ECHO /* empty -- don't echo anything (we shouldn't get there anyway */ > + > static void > gotoState (int s) > { > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_instruction.mx, , 1.374, 1.375
by Stefan Manegold 27 Nov '08

27 Nov '08

On Thu, Nov 27, 2008 at 10:43:37AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv739 > > Modified Files: > mal_instruction.mx > Log Message: > If you enter a multiplatform experiment then remove the exception handling too. > > > U mal_instruction.mx > Index: mal_instruction.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_instruction.mx,v > retrieving revision 1.374 > retrieving revision 1.375 > diff -u -d -r1.374 -r1.375 > --- mal_instruction.mx 26 Nov 2008 20:57:50 -0000 1.374 > +++ mal_instruction.mx 27 Nov 2008 10:43:34 -0000 1.375 > @@ -1736,7 +1736,7 @@ > #ifdef STRUCT_ALIGNED > /* experiment against alternative 32 bit platforms */ > #else > - showException(SYNTAX, "convertConstant", "missing implementation"); > + /* showException(SYNTAX, "convertConstant", "missing implementation");*/ > #endif ... hm, maybe the whole "effectless" #ifdef STRUCT_ALIGNED /* ... */ #else /* ... */ #endif [cs]hould be removed, now to keep the sources clean of dead code? Stefan > if ( vr->vtype != type) > showException(SYNTAX, "convertConstant", "coercion failed in '%s'", vr->val.sval); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/Tests colltest2.stable.err, , 1.2, 1.3 colltest2.stable.out, , 1.2, 1.3 procs.stable.out, , 1.46, 1.47 sigs.stable.out, , 1.27, 1.28
by Jan Rittinger 27 Nov '08

27 Nov '08

Hi Jan, was approving test colltest2 really what you wanted? -- I don't think so... On Nov 27, 2008, at 09:15, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25914/Tests > > Modified Files: > colltest2.stable.err colltest2.stable.out procs.stable.out > sigs.stable.out > Log Message: > - cleanup and approve sigs and procs tests > > > > U sigs.stable.out > Index: sigs.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/ > sigs.stable.out,v > retrieving revision 1.27 > retrieving revision 1.28 > diff -u -d -r1.27 -r1.28 > --- sigs.stable.out 24 Apr 2008 06:22:25 -0000 1.27 > +++ sigs.stable.out 27 Nov 2008 08:15:44 -0000 1.28 > @@ -51,7 +51,6 @@ > [ "tj_init_global(BAT[str,str]) : void" ] > [ "tj_log(str, int) : void" ] > [ "tj_normalizeTerm(str, str) : str" ] > -[ "tj_ping() : void" ] > [ "tj_setlog(str) : void" ] > [ "treemergejoin_sort(BAT[oid,oid], BAT[void,int], BAT[oid,oid]) : > BAT[oid,oid]" ] > [ "treemergejoin_sort_unnested(BAT[oid,oid], BAT[void,int], > BAT[oid,oid]) : BAT[oid,oid]" ] > > U colltest2.stable.err > Index: colltest2.stable.err > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/ > colltest2.stable.err,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- colltest2.stable.err 11 Sep 2007 15:52:53 -0000 1.2 > +++ colltest2.stable.err 27 Nov 2008 08:15:44 -0000 1.3 > @@ -5,11 +5,20 @@ > # 16:06:32 > Mtimeout -timeout 180 Mserver "--config=/usr/local/ > flokstra/etc/MonetDB.conf" --debug=0 --set "monet_mod_path=/usr/ > local/flokstra/lib/MonetDB4:/usr/local/flokstra/lib/MonetDB4/lib:/ > usr/local/flokstra/lib/MonetDB4/bin" --set "gdk_dbfarm=/usr/local/ > flokstra/var/MonetDB4/dbfarm" --set "sql_logdir=/usr/local/flokstra/ > var/MonetDB4/sql_logs" --set "xquery_logdir=/usr/local/flokstra/var/ > MonetDB4/xquery_logs" --set mapi_port=31150 --set xrpc_port=43225 -- > set monet_prompt= --trace "--dbname=mTests_modules_pftijah" -- > dbinit=" module(pathfinder);" ; echo ; echo Over.. > # 16:06:32 > > > +looking for col: pos68, ty: 0x1 in function pft_create_pfop (line > 1927) > +environment looks like: > + col: iter65, type: 0x1, mvar->name: a0011 > + col: pos68, type: 0x100000, mvar->name: a0017 > + col: pos68, type: 0x200000, mvar->name: a0016 > > # 16:06:32 > > # 16:06:32 > Mtimeout -timeout 60 MapiClient -lxquery -fxml - > umonetdb -Pmonetdb --host=localhost --port=31150 colltest2.xq > # 16:06:32 > > > +MAPI = monetdb@ewi581:37090 > +QUERY = let $opt := <TijahOptions debug="0" ft-index="FT_PFCOLL" ir- > model="NLLR"/> > + > + !# halted in milgen.brg (env_mvar_), line 676 > > # 16:06:32 > > # 16:06:32 > Done. > > U procs.stable.out > Index: procs.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/ > procs.stable.out,v > retrieving revision 1.46 > retrieving revision 1.47 > diff -u -d -r1.46 -r1.47 > --- procs.stable.out 29 Sep 2008 14:11:44 -0000 1.46 > +++ procs.stable.out 27 Nov 2008 08:15:44 -0000 1.47 > @@ -86,11 +86,10 @@ > [ "_shredlock_set(str, lng) : void" ] > [ "_shredlock_unset(str, lng) : void" ] > [ "_terms2void_tid(BAT[void,str], str) : > BAT[void,oid]" ] > -[ "_timestr(lng) : str" ] > [ "_tj_RTagBat(str) : str" ] > [ "_tj_TagBat(str) : str" ] > [ "_tj_TermBat(str) : str" ] > -[ "_tj_add2collection(str, BAT[str,BAT], str, str, bit) : > void" ] > +[ "_tj_add2collection(str, BAT[oid,BAT], BAT[str,BAT], str, str, > bit) : void" ] > [ "_tj_chk_modified_fragments(str, BAT[str,BAT]) : > BAT[void,str]" ] > [ "_tj_collection(str) : BAT[str,BAT]" ] > [ "_tj_collection_str(str) : BAT[void,BAT]" ] > @@ -509,6 +508,7 @@ > [ "p_containing_q_LMs(BAT[oid,dbl], BAT[void,str], BAT[oid,str]) : > BAT[oid,dbl]" ] > [ "p_containing_q_NLLR(BAT[oid,dbl], BAT[void,str], BAT[oid,str]) : > BAT[oid,dbl]" ] > [ "p_containing_q_OKAPI(BAT[oid,dbl], BAT[void,str], BAT[oid,str]) : > BAT[oid,dbl]" ] > +[ "p_containing_q_PRF(BAT[oid,dbl], BAT[void,str], BAT[oid,str]) : > BAT[oid,dbl]" ] > [ "p_containing_sum(BAT[oid,dbl], BAT[oid,dbl], BAT[oid,str]) : > BAT[oid,dbl]" ] > [ "pagesample(BAT[oid,any]) : BAT[oid,void]" ] > [ "parent(BAT[void,oid], BAT[void,oid], oid, BAT[void,BAT], int) : > BAT[void,BAT]" ] > @@ -646,7 +646,6 @@ > [ "tj_is_indexed(str) : bit" ] > [ "tj_nid2pre(BAT[oid,any], BAT[oid,str]) : > BAT[oid,any]" ] > [ "tj_pfop(BAT[void,oid], BAT[void,any], BAT[void,int], > BAT[void,oid]) : BAT[void,BAT]" ] > -[ "tj_ping() : void" ] > [ "tj_play_doc_tape(BAT[void,BAT], BAT[void,oid], BAT[void,int], > BAT[void,lng], BAT[void,str]) : void" ] > [ "tj_query_handler(bit, BAT[void,BAT], BAT[void,BAT], > BAT[void,BAT], BAT[oid,any], BAT[oid,BAT], BAT[void,lng], > BAT[void,dbl], BAT[void,str], BAT[void,BAT]) : BAT[void,BAT]" ] > [ "tj_rebuild_collection(str) : void" ] > > U colltest2.stable.out > Index: colltest2.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/ > colltest2.stable.out,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- colltest2.stable.out 11 Sep 2007 15:52:53 -0000 1.2 > +++ colltest2.stable.out 27 Nov 2008 08:15:44 -0000 1.3 > @@ -18,14 +18,12 @@ > > Over.. > > -# 16:06:32 > > -# 16:06:32 > Mtimeout -timeout 60 MapiClient -lxquery -fxml - > umonetdb -Pmonetdb --host=localhost --port=31150 colltest2.xq > -# 16:06:32 > > +# 09:11:32 > > +# 09:11:32 > mclient -lxquery -fxml -umonetdb -Pmonetdb -- > host=ewi581 --port=37090 colltest2.xq > +# 09:11:32 > > > -<?xml version="1.0" encoding="utf-8"?> > -<XQueryResult><bubble>Speed is the key to success.</ > bubble><bubble>Snelheid is de sleutel tot succes.</bubble></ > XQueryResult> > > -# 16:06:32 > > -# 16:06:32 > Done. > -# 16:06:32 > > +# 09:11:32 > > +# 09:11:32 > Done. > +# 09:11:32 > > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_instruction.mx, , 1.372, 1.373
by Stefan Manegold 26 Nov '08

26 Nov '08

On Wed, Nov 26, 2008 at 08:21:17PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13401 > > Modified Files: > mal_instruction.mx > Log Message: > An experiment for the nightly tests to address e.g. Darwin color test. > Should be handled correctly by GDK. > > > U mal_instruction.mx > Index: mal_instruction.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_instruction.mx,v > retrieving revision 1.372 > retrieving revision 1.373 > diff -u -d -r1.372 -r1.373 > --- mal_instruction.mx 23 Nov 2008 15:48:14 -0000 1.372 > +++ mal_instruction.mx 26 Nov 2008 20:21:14 -0000 1.373 > @@ -1,4 +1,4 @@ > -@' The contents of this file are subject to the MonetDB Public License > +' The contents of this file are subject to the MonetDB Public License > @' Version 1.1 (the "License"); you may not use this file except in > @' compliance with the License. You may obtain a copy of the License at > @' http://monetdb.cwi.nl/Legal/MonetDBLicense-1.1.html > @@ -1715,7 +1715,6 @@ > if( vr->vtype == type) > return 0; > if( vr->vtype == TYPE_str){ > -#ifdef STRUCT_ALIGNED > int ll = 0; > ptr d = NULL; > > @@ -1734,6 +1733,8 @@ > VALset(vr, type, d); > if (ATOMextern(type) == 0) > GDKfree(d); > +#ifdef STRUCT_ALIGNED > + /* experiment against alternative 32 bit platforms */ The problems does not seem to be 32-bit specific, but possibly big-endian related; it occurs on both 32- & 64-bit big-endian platforms such as PowerPC http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… and SPARC http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… similar problems occur with other tests on the same set of platforms: http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… Stefan > #else > showException(SYNTAX, "convertConstant", "missing implementation"); > #endif > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_instruction.mx, , 1.372, 1.373
by Stefan Manegold 26 Nov '08

26 Nov '08

On Wed, Nov 26, 2008 at 08:21:17PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13401 > > Modified Files: > mal_instruction.mx > Log Message: > An experiment for the nightly tests to address e.g. Darwin color test. > Should be handled correctly by GDK. > > > U mal_instruction.mx > Index: mal_instruction.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_instruction.mx,v > retrieving revision 1.372 > retrieving revision 1.373 > diff -u -d -r1.372 -r1.373 > --- mal_instruction.mx 23 Nov 2008 15:48:14 -0000 1.372 > +++ mal_instruction.mx 26 Nov 2008 20:21:14 -0000 1.373 > @@ -1,4 +1,4 @@ > -@' The contents of this file are subject to the MonetDB Public License > +' The contents of this file are subject to the MonetDB Public License ^^ Was this (also) intended? Stefan > @' Version 1.1 (the "License"); you may not use this file except in > @' compliance with the License. You may obtain a copy of the License at > @' http://monetdb.cwi.nl/Legal/MonetDBLicense-1.1.html > @@ -1715,7 +1715,6 @@ > if( vr->vtype == type) > return 0; > if( vr->vtype == TYPE_str){ > -#ifdef STRUCT_ALIGNED > int ll = 0; > ptr d = NULL; > > @@ -1734,6 +1733,8 @@ > VALset(vr, type, d); > if (ATOMextern(type) == 0) > GDKfree(d); > +#ifdef STRUCT_ALIGNED > + /* experiment against alternative 32 bit platforms */ > #else > showException(SYNTAX, "convertConstant", "missing implementation"); > #endif > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/tools/Tests mclient-lmal--help.stable.out.SunOS5.11.STATIC, Nov2008, NONE, 1.1.2.1
by Stefan Manegold 25 Nov '08

25 Nov '08

On Tue, Nov 25, 2008 at 01:45:28PM +0000, Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/tools/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12238 > > Added Files: > Tag: Nov2008 > mclient-lmal--help.stable.out.SunOS5.11.STATIC ^^^^^^^ IMHO, this will not work since Mtest.py considers ".STATIC" specific stable output only in case MonetDB is "statically linked", i.e., configures with "--disable-shared --enable-static", i.e., extension modules are statically linked into Mserver --- a "feature" which is (soon: was) only supported by MonetDB version 4, but is not (has never been) supported by MonetDB version 5). ... I guess, we should rather try to find out, why the compilation seems to find a usable readline on the very same machine (build-x86-sol10) when using GNU gcc (http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.mTests103/G…), while is apparently does not when using the Sun Studio 12 compiler (http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.mTests103/S…) ... (Mtest.py does not (yet) provide functionality to have *compiler*-specific stable output, mainly because is (still) uses the stabdard welcome message of both Mserver & mserver5 to get configuration information --- but only mserver5's --version option reveals the compiler name ...) http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.GNU.32.32.d… says ======== checking readline/readline.h usability... yes checking readline/readline.h presence... yes checking for readline/readline.h... yes checking for readline in -lreadline... yes checking for rl_completion_matches in -lreadline... yes ======== and ======== configure:31480: checking readline/readline.h usability configure:31497: gcc -c -O2 -D__EXTENSIONS__ -Wall -Wextra -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt conftest.c >&5 configure:31503: $? = 0 configure:31517: result: yes configure:31521: checking readline/readline.h presence configure:31536: gcc -E conftest.c configure:31542: $? = 0 configure:31556: result: yes configure:31589: checking for readline/readline.h configure:31596: result: yes configure:31601: checking for readline in -lreadline configure:31636: gcc -o conftest -O2 -D__EXTENSIONS__ -Wall -Wextra -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt conftest.c -lreadline >&5 configure:31642: $? = 0 configure:31660: result: yes configure:31815: checking for rl_completion_matches in -lreadline configure:31850: gcc -o conftest -O2 -D__EXTENSIONS__ -Wall -Wextra -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt conftest.c -lreadline -lreadline >&5 configure:31856: $? = 0 configure:31874: result: yes ======== while http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.Sun.32.32.d… says ======== checking readline/readline.h usability... no checking readline/readline.h presence... no checking for readline/readline.h... no ======== and ======== configure:31480: checking readline/readline.h usability configure:31497: cc -c -D__EXTENSIONS__ -xc99 -xO5 conftest.c >&5 "conftest.c", line 104: cannot find include file: <readline/readline.h> cc: acomp failed for conftest.c configure:31503: $? = 2 configure: failed program was: | /* confdefs.h. */ | #define PACKAGE_NAME "MonetDB Server" | #define PACKAGE_TARNAME "MonetDB5-server" | #define PACKAGE_VERSION "5.8.1" | #define PACKAGE_STRING "MonetDB Server 5.8.1" | #define PACKAGE_BUGREPORT "monet(a)cwi.nl" | #define PACKAGE "MonetDB5-server" | #define VERSION "5.8.1" | #define HOST "i386-pc-solaris2.11" | #define HAVE_SYS_TYPES_H 1 | #define HAVE_SYS_STAT_H 1 | #define HAVE_STDLIB_H 1 | #define HAVE_STRING_H 1 | #define HAVE_MEMORY_H 1 | #define HAVE_STRINGS_H 1 | #define HAVE_INTTYPES_H 1 | #define HAVE_STDINT_H 1 | #define HAVE_UNISTD_H 1 | #define SIZEOF_LONG 4 | #define _XPG6 1 | #define __EXTENSIONS__ 1 | #define HAVE_C99 1 | #define HAVE_DLFCN_H 1 | #define YYTEXT_POINTER 1 | #define TIME_WITH_SYS_TIME 1 | #define HAVE_DIRENT_H 1 | #define HAVE_ALLOCA_H 1 | #define HAVE_GETOPT_H 1 | #define HAVE_NETDB_H 1 | #define HAVE_SYS_TYPES_H 1 | #define HAVE_SYS_TIMES_H 1 | #define _FILE_OFFSET_BITS 64 | #define RETSIGTYPE void | #define HAVE_PTRDIFF_T 1 | #define HAVE_SSIZE_T 1 | #define HAVE_LONG_LONG 1 | #define LLFMT "%lld" | #define ULLFMT "%llu" | #define SIZEOF_CHAR 1 | #define SIZEOF_SHORT 2 | #define SIZEOF_INT 4 | #define SIZEOF_LONG 4 | #define SIZEOF_VOID_P 4 | #define SIZEOF_SIZE_T 4 | #define SIZEOF_SSIZE_T 4 | #define SIZEOF_PTRDIFF_T 4 | #define SIZEOF_LONG_LONG 8 | #define SIZEOF___INT64 0 | #define HAVE_FTRUNCATE 1 | #define HAVE_GETTIMEOFDAY 1 | #define HAVE_OPENDIR 1 | #define HAVE_SYSCONF 1 | #define HAVE_TIMES 1 | #define HAVE_FTELLO 1 | #define HAVE_FSEEKO 1 | #define DIR_SEP '/' | #define DIR_SEP_STR "/" | #define PATH_SEP ':' | #define PATH_SEP_STR ":" | #define SO_PREFIX "lib" | #define SO_EXT ".so" | #define NDEBUG 1 | #define HAVE_PTHREAD_H 1 | #define HAVE_SEMAPHORE_H 1 | #define HAVE_SCHED_H 1 | #define HAVE_PTHREAD_KILL 1 | #define HAVE_PTHREAD_SIGMASK 1 | #define HAVE_PTHREAD_SETSCHEDPRIO 1 | #define HAVE_LIBPTHREAD 1 | /* end confdefs.h. */ | #include <stdio.h> | #ifdef HAVE_SYS_TYPES_H | # include <sys/types.h> | #endif | #ifdef HAVE_SYS_STAT_H | # include <sys/stat.h> | #endif | #ifdef STDC_HEADERS | # include <stdlib.h> | # include <stddef.h> | #else | # ifdef HAVE_STDLIB_H | # include <stdlib.h> | # endif | #endif | #ifdef HAVE_STRING_H | # if !defined STDC_HEADERS && defined HAVE_MEMORY_H | # include <memory.h> | # endif | # include <string.h> | #endif | #ifdef HAVE_STRINGS_H | # include <strings.h> | #endif | #ifdef HAVE_INTTYPES_H | # include <inttypes.h> | #endif | #ifdef HAVE_STDINT_H | # include <stdint.h> | #endif | #ifdef HAVE_UNISTD_H | # include <unistd.h> | #endif | #include <readline/readline.h> configure:31517: result: no configure:31521: checking readline/readline.h presence configure:31536: cc -E conftest.c "conftest.c", line 71: cannot find include file: <readline/readline.h> cc: acomp failed for conftest.c configure:31542: $? = 2 configure: failed program was: | /* confdefs.h. */ | #define PACKAGE_NAME "MonetDB Server" | #define PACKAGE_TARNAME "MonetDB5-server" | #define PACKAGE_VERSION "5.8.1" | #define PACKAGE_STRING "MonetDB Server 5.8.1" | #define PACKAGE_BUGREPORT "monet(a)cwi.nl" | #define PACKAGE "MonetDB5-server" | #define VERSION "5.8.1" | #define HOST "i386-pc-solaris2.11" | #define HAVE_SYS_TYPES_H 1 | #define HAVE_SYS_STAT_H 1 | #define HAVE_STDLIB_H 1 | #define HAVE_STRING_H 1 | #define HAVE_MEMORY_H 1 | #define HAVE_STRINGS_H 1 | #define HAVE_INTTYPES_H 1 | #define HAVE_STDINT_H 1 | #define HAVE_UNISTD_H 1 | #define SIZEOF_LONG 4 | #define _XPG6 1 | #define __EXTENSIONS__ 1 | #define HAVE_C99 1 | #define HAVE_DLFCN_H 1 | #define YYTEXT_POINTER 1 | #define TIME_WITH_SYS_TIME 1 | #define HAVE_DIRENT_H 1 | #define HAVE_ALLOCA_H 1 | #define HAVE_GETOPT_H 1 | #define HAVE_NETDB_H 1 | #define HAVE_SYS_TYPES_H 1 | #define HAVE_SYS_TIMES_H 1 | #define _FILE_OFFSET_BITS 64 | #define RETSIGTYPE void | #define HAVE_PTRDIFF_T 1 | #define HAVE_SSIZE_T 1 | #define HAVE_LONG_LONG 1 | #define LLFMT "%lld" | #define ULLFMT "%llu" | #define SIZEOF_CHAR 1 | #define SIZEOF_SHORT 2 | #define SIZEOF_INT 4 | #define SIZEOF_LONG 4 | #define SIZEOF_VOID_P 4 | #define SIZEOF_SIZE_T 4 | #define SIZEOF_SSIZE_T 4 | #define SIZEOF_PTRDIFF_T 4 | #define SIZEOF_LONG_LONG 8 | #define SIZEOF___INT64 0 | #define HAVE_FTRUNCATE 1 | #define HAVE_GETTIMEOFDAY 1 | #define HAVE_OPENDIR 1 | #define HAVE_SYSCONF 1 | #define HAVE_TIMES 1 | #define HAVE_FTELLO 1 | #define HAVE_FSEEKO 1 | #define DIR_SEP '/' | #define DIR_SEP_STR "/" | #define PATH_SEP ':' | #define PATH_SEP_STR ":" | #define SO_PREFIX "lib" | #define SO_EXT ".so" | #define NDEBUG 1 | #define HAVE_PTHREAD_H 1 | #define HAVE_SEMAPHORE_H 1 | #define HAVE_SCHED_H 1 | #define HAVE_PTHREAD_KILL 1 | #define HAVE_PTHREAD_SIGMASK 1 | #define HAVE_PTHREAD_SETSCHEDPRIO 1 | #define HAVE_LIBPTHREAD 1 | /* end confdefs.h. */ | #include <readline/readline.h> configure:31556: result: no configure:31589: checking for readline/readline.h configure:31596: result: no ======== apparently, readline/readline.h is in GNU gcc's default include path but not in Sun Studio cc's default include path on that machine ... Stefan > Log Message: > Attempt to approve no static readline library on SunOS 5.11 (when not Prefix-enabled) > > --- NEW FILE: mclient-lmal--help.stable.out.SunOS5.11.STATIC --- > stdout of test 'mclient-lmal--help` in directory 'src/tools` itself: > > > # 11:03:02 > > # 11:03:02 > Mtimeout -timeout 240 mserver5 "--config=/ufs/mk/monet5/Linux/etc/monetdb5.conf" --debug=10 --set "monet_mod_path=/ufs/mk/monet5//Linux/lib/MonetDB5:/ufs/mk/monet5//Linux/lib/MonetDB5/lib:/ufs/mk/monet5//Linux/lib/MonetDB5/bin" --set "gdk_dbfarm=/ufs/mk/monet5//Linux/var/MonetDB5/dbfarm" --set "sql_logdir=/ufs/mk/monet5//Linux/var/MonetDB5/sql_logs" --set "xquery_logdir=/ufs/mk/monet5//Linux/var/MonetDB5/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=36261 --set xrpc_port=45929 --set monet_prompt= --trace "--dbname=mTests_src_tools" --dbinit="" ; echo ; echo Over.. > # 11:03:02 > > > !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. > !WARNING: BBPdir: initializing BBP. > # MonetDB server v5.1.0, based on kernel v1.19.0 > # Serving database 'mTests_src_tools' > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked > # Copyright (c) 1993-2007 CWI, all rights reserved > # Visit http://monetdb.cwi.nl/ for further information > # Listening for connection requests on mapi:monetdb://gio.ins.cwi.nl:36261/ > > Ready. > #function user.main():void; > # clients.quit(); > #end main; > > Over.. > > # 11:03:02 > > # 11:03:02 > Mtimeout -timeout 120 ./mclient-lmal--help.MAL.sh mclient-lmal--help > # 11:03:02 > > > > # 11:03:02 > > # 11:03:02 > Mtimeout -timeout 60 mclient -lmal -umonetdb -Pmonetdb --config=/ufs/mk/monet5/Linux/etc/monetdb5.conf --host=gio --port=36261 --help > # 11:03:02 > > > \? - show this message > ?pat - MAL function help. pat=[modnme[.fcnnme][(][)]] wildcard * > \<file - read input from file > \>file - save response in file, or stdout if no file is given > \|cmd - pipe result to process, or stop when no command is given > \t - toggle timer > \e - echo the query in sql formatting mode > \f - format using a built-in renderer {csv,tab,raw,sql,xml} > \w# - set maximal page width (-1=raw,0=no limit, >0 max char) > \r# - set maximum rows per page (-1=raw) > \L file - save client/server interaction > \X - trace mclient code > \q - terminate session > mal> > # 11:03:02 > > # 11:03:02 > Done. > # 11:03:02 > > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

[Monetdb-developers] Could not create hash table for key test
by Stefan de Konink 23 Nov '08

23 Nov '08

#GDKmalloc(14777222432) fail => BBPtrim(enter) usage[mem=14840896,vm=27527806976] #BBPTRIM_ENTER: memsize=14840896,vmsize=27527806976 #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 #GDKmalloc(14777222432) fail => BBPtrim(ready) usage[mem=11538120,vm=27527806976] #BATpropcheck: BAT tmp_1260(-688): could not allocate hash table for key test #GDKmalloc(14777222432) fail => BBPtrim(enter) usage[mem=11537664,vm=27527806976] #BBPTRIM_ENTER: memsize=11537664,vmsize=27527806976 #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 #GDKmalloc(14777222432) fail => BBPtrim(ready) usage[mem=10416208,vm=27527806976] #BATpropcheck: BAT tmp_1135(-605): could not allocate hash table for key test MAPI = monetdb@localhost:50000 QUERY = COPY 773410980 RECORDS INTO node_tags from '/mnt/data2/csv/node_tags.csv' USING DELIMITERS ',', '\n', ''''; ERROR = !MALException: GDKmallocmax: failed for 1892320544 bytes !ERROR: GDKload: failed name=12/1252, ext=thash !ERROR: GDKmallocmax: failed for 1892320544 bytes !ERROR: GDKload: failed name=12/1253, ext=thash What kind of voodoo is this? I'm trying to import a 42GB csv file using copy into, on a native system, 2GB of memory, 4GB of swap. Latest CVS version, this time compiled for CoreDuo, without debuging, with optimise. Stefan

3 10

Re: [Monetdb-developers] Monetdb-developers Digest, Vol 30, Issue 10
by Peter Boncz 23 Nov '08

23 Nov '08

Hi Stefan (the non-german .de one) > Maybe a very strange idea, could be your better solution. If by default > these operations are mmap'ed, they should be taken care of by a disk based > memory extension. Hence being independent of RAM/SWAP but having all pro's > of both. You are right. In fact, this is what MonetDB is supposed to do. Memory is organized in contiguous Heap objects. This does not only hold for BATs but also for Hash Tables. At some moment, I did add the possibility to use a real memory mapped files for their allocation, as a last resort. The problem was there that the Heap() API did not have a filename parameter, and a HEAPextend() thus would not know what file to use. In order not to break the API, I decided to initialize the filename fields at BAT creation time (this is why you may sometimes see .hhash and .thash files in a just stopped MonetDB repository -- even though hash tables are not persistent). With hindsight, this API decision was bad judgement; because the question whether real file mapping is used now depends on the question whether the filename was initialized at BAT or Hash table creation. Now, this should be the case, but it would be my first question to address in a debugging session. I also recall that in case of the Skyserver TB dataset, key checking was disabled to to similar problems. Of course, if we would find and fix this bug, life will not be rosy for you, doing random access (key uniqueness checking) into a 14GB heap that will never fit your 2GB RAM. That goes back to your question whether it is in fact reasonable to materialize 14GB. Questions like these led to a redesign that is much more careful with memory consumption (X100) whose spin-off development regrettably means that my time for such debugging sessions currently is limited. Peter PS The likely cause for the problem is a shortage of swap space. Increasing your swap file size (with a few 10s of GB) should be a workaround for the problem.

3 2