June 2008 - developers-list

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime pathfinder.mx, XQuery_0-24, 1.416.2.8, 1.416.2.9
by Stefan Manegold 18 Jun '08

18 Jun '08

On Tue, Jun 17, 2008 at 09:56:41PM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv8192 > > Modified Files: > Tag: XQuery_0-24 > pathfinder.mx > Log Message: > check in correct branch (just in time for testing?) Yes. Thanks! One open questions: Was the change in pf_support that you committed with the same checkin on the development trunk (see below) related to the bug fix or not? If not, what was it for? In either case: should it be back-ported as well> Stefan ======== Index: pf_support.mx =================================================================== RCS file: /cvsroot/monetdb/pathfinder/runtime/pf_support.mx,v retrieving revision 1.301 retrieving revision 1.302 diff -u -d -r1.301 -r1.302 --- pf_support.mx 10 Jun 2008 09:22:17 -0000 1.301 +++ pf_support.mx 17 Jun 2008 17:07:27 -0000 1.302 @@ -8373,7 +8373,7 @@ BUNins(*res, &docpre, &docid[j], FALSE); /* skip all nodes of this document */ - docpre = docpre + size[docpre]; + docpre = docpre + size[docpre] + 1; for (delta = (n-i) >> 4; delta > 40; delta >>= 4) while (i+delta < n && * (oid *) BUNtail(inputi, i+delta) <= docpre) i += delta; ======== > > > U pathfinder.mx > Index: pathfinder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/pathfinder.mx,v > retrieving revision 1.416.2.8 > retrieving revision 1.416.2.9 > diff -u -d -r1.416.2.8 -r1.416.2.9 > --- pathfinder.mx 16 Jun 2008 21:23:51 -0000 1.416.2.8 > +++ pathfinder.mx 17 Jun 2008 21:56:37 -0000 1.416.2.9 > @@ -4246,7 +4246,7 @@ > * - execute MIL buffer (parse & execute) > * > * int > - * xquery_compile_exec(xquery_client *ctx, char* xquery, int is_url, > + * xquery_compile_exec(xquery_client *ctx, int options, char* xquery, int is_url, > * char** prologue, char** query, char** epilogue, char* nsurl) > * - translate xquery to MIL and execute > * > @@ -4345,6 +4345,7 @@ > extern char* PFmaxstack; > static int > xquery_compile_exec(xquery_client *ctx, > + int options, > char* url, > int is_url, > char** prologue, > @@ -4356,22 +4357,9 @@ > char *xquery = url; > char *err = NULL; > > - int options = 0; > /* Setting the StandOff flag based on runtime settings */ > if ((GDKgetenv("standoff") != NULL) && (strcmp(GDKgetenv("standoff"),"enabled") == 0)) > options |= COMPILE_OPTION_STANDOFF; > - /* Setting the Algebra flag; server setting overules compile-time default; client choice overrules server setting */ > -#if MILPRINT_SUMMER_IS_DEFAULT > - if (((ctx->mode & XQ_ALGEBRA) != 0) || \ > - (((ctx->mode & XQ_MILPRINT_SUMMER) == 0) && \ > - (GDKgetenv("xquery_backend") != NULL) && (strcmp(GDKgetenv("xquery_backend"),"algebra") == 0))) > - options |= COMPILE_OPTION_ALGEBRA; > -#else /* ALGEBRA_IS_DEFAULT */ > - if (((ctx->mode & XQ_MILPRINT_SUMMER) == 0) && \ > - (((ctx->mode & XQ_ALGEBRA) != 0) || \ > - (GDKgetenv("xquery_backend") == NULL) || (strcmp(GDKgetenv("xquery_backend"),"milprint_summer") != 0))) > - options |= COMPILE_OPTION_ALGEBRA; > -#endif > > MT_set_lock(pf_compiler_lock, "xquery_compile_exec"); > if (is_url) { > @@ -4910,7 +4898,7 @@ > strcpy(mod->url, url); > mod->nsurl = mod->url + url_len; > > - ret = xquery_compile_exec(ctx, url, 1, &mod->prologue, NULL, &mod->epilogue, mod->nsurl); > + ret = xquery_compile_exec(ctx, 0, url, 1, &mod->prologue, NULL, &mod->epilogue, mod->nsurl); > if (!ret) { > xquery_module_free(mod); > return NULL; > @@ -5745,9 +5733,22 @@ > char *sec1 = NULL; > char *sec2 = NULL; > char *sec3 = NULL; > + int options = 0; > /* compile and execute the query (minus module imports) */ > err = xquery_nondescriptive_error; > - if (xquery_compile_exec(ctx, query, 0, &sec1, &sec2, &sec3, NULL)) > + /* Setting the Algebra flag; server setting overules compile-time default; client choice overrules server setting */ > +#if MILPRINT_SUMMER_IS_DEFAULT > + if (((ctx->mode & XQ_ALGEBRA) != 0) || \ > + (((ctx->mode & XQ_MILPRINT_SUMMER) == 0) && \ > + (GDKgetenv("xquery_backend") != NULL) && (strcmp(GDKgetenv("xquery_backend"),"algebra") == 0))) > + options = COMPILE_OPTION_ALGEBRA; > +#else /* ALGEBRA_IS_DEFAULT */ > + if (((ctx->mode & XQ_MILPRINT_SUMMER) == 0) && \ > + (((ctx->mode & XQ_ALGEBRA) != 0) || \ > + (GDKgetenv("xquery_backend") == NULL) || (strcmp(GDKgetenv("xquery_backend"),"milprint_summer") != 0))) > + options = COMPILE_OPTION_ALGEBRA; > +#endif > + if (xquery_compile_exec(ctx, options, query, 0, &sec1, &sec2, &sec3, NULL)) > err = NULL; > if (sec1) free(sec1); > if (sec2) free(sec2); > > > ------------------------------------------------------------------------- > Check out the new SourceForge.net Marketplace. > It's the best place to buy or sell services for > just about anything Open Source. > http://sourceforge.net/services/buy/index.php > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Pathfinder (MonetDB/XQuery) testing results
by Stefan Manegold 17 Jun '08

17 Jun '08

Dear all, after I finally switched the compile time default for Pathfinder from using the old MPS ("milprint_summer") back-end to using the new ALG ("Algebra") back-end last night, the nightly testing result for Pathfinder (aka. MonetDB/XQuery) are available at (`make check` using default ALG back-end): http://monetdb.cwi.nl/testing/projects/monetdb/Stable/pathfinder/.mTests103… http://monetdb.cwi.nl/testing/projects/monetdb/Current/pathfinder/.mTests10… (`RunMtest -g` explicitly using the old MPS back-end): http://monetdb.cwi.nl/testing/projects/monetdb/Stable/pathfinder/.mTestsg10… http://monetdb.cwi.nl/testing/projects/monetdb/Current/pathfinder/.mTestsg1… The TestWeb pages at http://monetdb.cwi.nl/Development/TestWeb/Stable/pathfinder/index.html and http://monetdb.cwi.nl/Development/TestWeb/Current/pathfinder/index.html will be updated accordingly as soon as we manage to re-buld the web-site ... Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Question on monetdb PHP support
by Rt Ibmer 17 Jun '08

17 Jun '08

I am building Monetdb using the stable nightly builds. I would like to write queries against Monetdb using PHP. I came across this in the docs and have two questions about it: ---------------- The unix configure process normally tries to detect if you have PHP including developer packages installed and builds the PHP module only if you have it. With the --with-php option you could tell 'configure' where to find the PHP installation. ---------------- 1) Regarding "detect if you have PHP including developer packages" - can you please tell me what packages exactly MonetDB will look for. Obviously it wants the main php package. But I am not sure what development packages I need to install so that Monetdb will build in the PHP support and make me the DB/monetdb.php file. I am using Fedora 8. What yum packages (or equiv) should I have installed for this? 2) Regarding the "--with-php" compile option - which of the PHP base directories would I want to point the build .sh script for MonetDb at? Thanks!

2 1

[Monetdb-developers] Cannot get perl talking to monetdb5 nightly stable
by Rt Ibmer 17 Jun '08

17 Jun '08

I am using the nightly stable build of monetdb5. All outside of perl->monetdb seems to be working just fine. I just can't get perl to talk to the db. Here's what I did: - installed from nightly stable source on Fedora 8 - copied the source from http://homepages.cwi.nl/~mk/MonetDB/The-Perl-Library.html into mytest.pl - tried running: perl /tmp/mytest.pl but it came back complaining about missing libs in @INC. So then I added these steps: - /var/tmp/MonetDB-1213632062/MonetDB-client/clients/src/perl - make install and also ran make instlal in the various subdirs like MonetDB-CLI and others (not sure if this step was necessar) Then I tried running the script and this time it executed without the @INC errors. So this was progress. However all I get is this: ------- Start a simple Monet MIL interaction data sources: dbi:monetdb: -------- and then nothing. It just sits there indefinitely. In playing with the source of the .pl I see that it is the "my $dbh = DBI->connect( $dsn, ..." that execution stops at. I have merovingian running and the db is started. I also tried with merovigan stopped and just using mserver5 --dbinit="include sql;" but I had the same result. Am I doing something wrong? Thanks.

1 0

[Monetdb-developers] arrow keys not working in mclient in stable nightly
by Rt Ibmer 16 Jun '08

16 Jun '08

Hi - I use a SSH client to access my Fedora 8 core box. When I was using the RELEASE built I was able to use left/right/up/down/home/end keys within mclient to edit the line. For instance I could push up arrow to have it automatically cycle through the previous lines, and then use left arrow to move over to a part of the line and process to change it. That all worked fine under the RELEASE build. However now that I have built from source the nightly stable (as of a couple nights ago) I can no longer use these keys. For instance when I press UP arrow it simply adds "^[[A" to the line. Other arrow keys / home /end do something similar. Not sure but I think something broke regarding this at some point between the released build and the stable nightly. Thanks.

2 1

[Monetdb-developers] Does monetdb support limit x,y syntax?
by Rt Ibmer 16 Jun '08

16 Jun '08

To get a median I want to use this: select myIntCol from mytable order by myIntCol limit half_table_size,1; This works in mySQL. However I get an error when I use limit with x,y params. If I just use limit x then it limits the return results to just x rows. But what I need to do is tell it to start with row x and only give me 1 row (i.e. "... limit 5000, 1;" when I have 10000 rows in the table. Does MonetDB support this format? If not is there a work around?? Thanks.

2 1

[Monetdb-developers] JDBC connection error: Max number of redirects reached
by Rt Ibmer 15 Jun '08

15 Jun '08

OK I have a strange problem that I have FINALLY narrowed down and hoping someone can help me resolve please. I am using the latest stable nightly MonetDB5 with SQL on Fedora core 8. If I run merovingian and then try to connect to my database using JDBC through my Java app, I get this error returned by JDBC: "Maximum number of redirects reached, aborting connection attempt. Sorry." However, if instead of running merovingian I run this from the shell: mserver5 --dbinit="include sql;" Then my JDBC connection works perfectly!! However, I need to start MonetDB in the background and use merovingian at boot time, so I am stuck. What does this 'maximum number of redirects reached' mean exactly? Why would I get this problem when using merovingian but not when using MonetDB? How can I resolve this or troubleshoot things further? I tried searching the web for this error message but didn't come up with anything related to monetdb. Thank you!!

3 6

[Monetdb-developers] Bad SQL query causes mclient to terminate
by Rt Ibmer 14 Jun '08

14 Jun '08

When working with RELEASE version of MonetDB5 every once in a while I would enter in a bad query into mclient and it would crash the entire server hard - it would not even reboot. I did notice, however, that in the nightly stable release this same issue is handled better, in that it no longer crashes the server (very good news!). However it does result in mclient terminating the connection and closing. Here is how you can reproduce this: 1) run merovingian 2) mclient -lsql --time --database=demo 3) enter this query: sql>select avg(1); and you will get this: MAPI = monetdb@localhost:50000 ACTION= read_line QUERY = select avg(1); ERROR = Connection terminated Timer 3.049 msec <mclient exits> [bash ~] # Am I correct to assume this is not expected behavior? Thanks.

1 0

[Monetdb-developers] Support for stdev() and var() ?
by Rt Ibmer 14 Jun '08

14 Jun '08

Does the very latest version of MonetDB support built-in queries for the mathematical standard deviation and variance functions stdev() and var()? When I try these queries it returns "no such unary operator". I was under the impression that these were fairly standard in the SQL syntax so I am surprised to find this. If this is not supported, can you please let me know if there are any plans to add this and if so in what approximate timeframe? These functions are critical to our use of the db. Thank you.

1 0

Re: [Monetdb-developers] Works fine once, then get Invalid credentials for user monetdb
by Rt Ibmer 14 Jun '08

14 Jun '08

>Probably you aren't but the binpkgs you use are. You'll probably have >less frustrations at this point if you just compile from source, using >the monetdb-install.sh script. What seems wrong here is that the >default path is set to the builddir instead of the target dir. Thanks for the suggestion. My results were mixed. The good news is that in the latest nightly stable build the problems with the intermitant bad passwords and with the server failing to reboot have been fixed! So that is great! However the not-so-good news is that now my JDBC connection is no longer working properly. Do I need to use a newer version of the JDBC driver in conjunction with this latest stable nightly build? If so I could not find it - where do I get it? The problem with the JDBC driver is that when running with merovingian I get: Maximum number of redirects reached, aborting connection attempt. Sorry. then instead of running withmerovingian, as a test I ran with: mserver5 --dbinit="include sql;" and when running that way I get InvalidCredentialsException:checkCredentials:Invalid credentials for user 'monetdb' However I am using the default username and password of monetdb for both and haven't changed this. Furthermore If I run mclient with -umonetdb and specify monetdb as the password it accepts it there just fine. So I assume monetdb is still the default valid username/password for this stable nightly. But for some reason when I pass this as the user name and password in my JDBC connection it won't accept it. As mentioned earlier, this part was working just fine under the released version of MonetDB5. Can someone please help? I am running out of time to get this implemented so I am hoping to close this loop today. Thank you so much!!

2 17