March 2010 - developers-list

[Monetdb-developers] Fw: Re: Fw: Re: Fw: Re: need help in monetdb xquery interface
by anshul gangwar 07 Mar '10

07 Mar '10

hello, I just want to know about current monetdb version. Whether it does any optimization at compile time or not or it fully does at run time only. where can i get the information about the optimization strategy of monetdb. May be the specific src code file to refer of monetdb. can you please refer some research papers on monetdb optimization strategy etc. On Sat, Mar 06, 2010 at 07:27:09PM +0530, anshul gangwar wrote: > > > how can we get the estimate of the size of result of query based on any two attributes with varying rangeAnshul Well, I guess you'd need to browse the related research literature for XML/XQuery cost modeling / result size estimation techniques --- however, to my knowledge that area is not yet as well charted and understood as cost modeling / result size estimation for relational algebra and SQL. Of course, the details highly depend on your XML document structure and data distribution as well as the shape and characteristics of your XQuery queries ... Stefan > On Sat, Mar 06, 2010 at 11:32:03AM +0530, anshul gangwar wrote: > > > > > > --- On Fri, 5/3/10, Martin Kersten <Martin.Kersten(a)cwi.nl> wrote: > > > > From: Martin Kersten <Martin.Kersten(a)cwi.nl> > > Subject: * Re: [Monetdb-developers] need help in monetdb xquery interface > > To: "anshul gangwar" <anshul1886(a)yahoo.co.in> > > Date: Friday, 5 March, 2010, 11:26 PM > > > > anshul gangwar wrote: > > > hello , > > > I want to know whether there is any expression or command or anything equivalent to explain sql construct. Also What is the way to > > There is material for you to study on the website: > > http://monetdb.cwi.nl/SQL/Documentation/SQL-Runtime-Features.html > > http://monetdb.cwi.nl/SQL/Documentation/EXPLAIN-Statement.html#EXPLAIN-Stat… > > > get histogram statistics i.e way to find that histogram exists on attribute or not through Xquery interface. not through sql . > > MonetDB does not rely on separate statistics tables. > > > > > Please reply as soon as possible. > > > > > > thank you. > > > > > > Actually i want the xquery construct equivalent to sql explain construct and > > MonetDB/XQuery does not provide such feature. > > To see the equivalent of the SQL EXPLAIN output, i.e., the MIL plan > generated from your XQuery query, you need to use the Pathfinder stand-alone > compiler "pf"; see > `pf --help` > and/or > `pf --fullhelp` > for details. > > > so how it simulates histogram features i.e to get that percentage of query etc. > > Like MonetDB/SQL also > MonetDB/XQuery does not rely on separate statistics > such as histograms. > > Stefan > > > > > > Your Mail works best with the New Yahoo Optimized IE8. Get it NOW!. > > > Your Mail works best with the New Yahoo Optimized IE8. Get it NOW! http://downloads.yahoo.com/in/internetexplorer/ > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 | The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/

4 4

[Monetdb-developers] Fw: Re: Fw: Re: Fw: Re: Fw: Re: need help in monetdb xquery interface
by anshul gangwar 07 Mar '10

07 Mar '10

hello, what are these statistical guides based on data guides in monetdb. And did monetdb stores these statistical guides(data guides). And if yes where it stores it & how can we access it . & does the physical algebra plan depend only on these statistical guides at compile time without actually running the query. And what are children Histogram & Typed valued Histogram , & are these Histograms are stored & if yes how can we access it. Your Mail works best with the New Yahoo Optimized IE8. Get it NOW!. The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/

1 0

[Monetdb-developers] Fw: Re: Fw: Re: need help in monetdb xquery interface
by anshul gangwar 06 Mar '10

06 Mar '10

how can we get the estimate of the size of result of query based on any two attributes with varying rangeAnshul On Sat, Mar 06, 2010 at 11:32:03AM +0530, anshul gangwar wrote: > > > --- On Fri, 5/3/10, Martin Kersten <Martin.Kersten(a)cwi.nl> wrote: > > From: Martin Kersten <Martin.Kersten(a)cwi.nl> > Subject: * Re: [Monetdb-developers] need help in monetdb xquery interface > To: "anshul gangwar" <anshul1886(a)yahoo.co.in> > Date: Friday, 5 March, 2010, 11:26 PM > > anshul gangwar wrote: > > hello , > > I want to know whether there is any expression or command or anything equivalent to explain sql construct. Also What is the way to > There is material for you to study on the website: > http://monetdb.cwi.nl/SQL/Documentation/SQL-Runtime-Features.html > http://monetdb.cwi.nl/SQL/Documentation/EXPLAIN-Statement.html#EXPLAIN-Stat… > > get histogram statistics i.e way to find that histogram exists on attribute or not through Xquery interface. not through sql . > MonetDB does not rely on separate statistics tables. > > > Please reply as soon as possible. > > > > thank you. > > > Actually i want the xquery construct equivalent to sql explain construct and MonetDB/XQuery does not provide such feature. To see the equivalent of the SQL EXPLAIN output, i.e., the MIL plan generated from your XQuery query, you need to use the Pathfinder stand-alone compiler "pf"; see `pf --help` and/or `pf --fullhelp` for details. > so how it simulates histogram features i.e to get that percentage of query etc. Like MonetDB/SQL also MonetDB/XQuery does not rely on separate statistics such as histograms. Stefan Your Mail works best with the New Yahoo Optimized IE8. Get it NOW!. Your Mail works best with the New Yahoo Optimized IE8. Get it NOW! http://downloads.yahoo.com/in/internetexplorer/

2 1

[Monetdb-developers] Fw: Re: need help in monetdb xquery interface
by anshul gangwar 06 Mar '10

06 Mar '10

--- On Fri, 5/3/10, Martin Kersten <Martin.Kersten(a)cwi.nl> wrote: From: Martin Kersten <Martin.Kersten(a)cwi.nl> Subject: Re: [Monetdb-developers] need help in monetdb xquery interface To: "anshul gangwar" <anshul1886(a)yahoo.co.in> Date: Friday, 5 March, 2010, 11:26 PM anshul gangwar wrote: > hello , > I want to know whether there is any expression or command or anything equivalent to explain sql construct. Also What is the way to There is material for you to study on the website: http://monetdb.cwi.nl/SQL/Documentation/SQL-Runtime-Features.html http://monetdb.cwi.nl/SQL/Documentation/EXPLAIN-Statement.html#EXPLAIN-Stat… > get histogram statistics i.e way to find that histogram exists on attribute or not through Xquery interface. not through sql . MonetDB does not rely on separate statistics tables. > Please reply as soon as possible. > > thank you. Actually i want the xquery construct equivalent to sql explain construct and so how it simulates histogram features i.e to get that percentage of query etc. Please reply as soon as possible. The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/

3 3

[Monetdb-developers] need help in monetdb xquery interface
by anshul gangwar 05 Mar '10

05 Mar '10

hello , I want to know whether there is any expression or command or anything equivalent to explain sql construct. Also What is the way to get histogram statistics i.e way to find that histogram exists on attribute or not through Xquery interface. not through sql . Please reply as soon as possible. thank you. The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/

1 0

[Monetdb-developers] Announcement: New Feb2010 feature release of MonetDB suite
by Sjoerd Mullender 02 Mar '10

02 Mar '10

The MonetDB team at CWI/MonetDB BV is pleased to announce the Feb2010 feature release of the MonetDB suite of programs. More information (including release notes) on this release is available at <http://monetdb.cwi.nl/Development/Releases/Feb2010/>. -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_interpreter.mx, Feb2010, 1.337.2.33, 1.337.2.34
by Stefan Manegold 01 Mar '10

01 Mar '10

On Mon, Mar 01, 2010 at 10:20:01AM +0100, Sjoerd Mullender wrote: > Note that this particular initialization doesn't do anything. Static > variables are automatically initialized to 0. Thanks! --- I overlooked that one --- then the rather high value of hottop (600037897) I encountered was indeed only cause by incrementing it "unboundedly" rather than an "unexpected" initialization ... > Also note that in the HEAD branch, hottop is initialized to MAXHOT > (causing a propagation conflict). I indeed did not check the HEAD branch --- I cannot tell which is supposed to be the "correct" initial value, 0 or MAXHOT --- maybe Martin can help ... Stefan > On 2010-03-01 09:27, Stefan Manegold wrote: > > Update of /cvsroot/monetdb/MonetDB5/src/mal > > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv17757/MonetDB5/src/mal > > > > Modified Files: > > Tag: Feb2010 > > mal_interpreter.mx > > Log Message: > > > > make sure we initialize the static global variable hottop at least once; > > I hope, 0 is the correct initial value. > > > > > > Index: mal_interpreter.mx > > =================================================================== > > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_interpreter.mx,v > > retrieving revision 1.337.2.33 > > retrieving revision 1.337.2.34 > > diff -u -d -r1.337.2.33 -r1.337.2.34 > > --- mal_interpreter.mx 28 Feb 2010 18:49:24 -0000 1.337.2.33 > > +++ mal_interpreter.mx 1 Mar 2010 08:27:04 -0000 1.337.2.34 > > @@ -89,7 +89,7 @@ > > lng claim; /* actual claim on memory*/ > > int bid; > > } hotpotatoes[MAXHOT]; > > -static int hottop; > > +static int hottop = 0; > > @- > > The struct alignment leads to 40% gain in simple instructions when set. > > @c > > > > > > ------------------------------------------------------------------------------ > > Download Intel® Parallel Studio Eval > > Try the new software tools for yourself. Speed compiling, find bugs > > proactively, and fine-tune applications for parallel performance. > > See why Intel Parallel Studio got high marks during beta. > > http://p.sf.net/sfu/intel-sw-dev > > _______________________________________________ > > Monetdb-checkins mailing list > > Monetdb-checkins(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > -- > Sjoerd Mullender > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

[Monetdb-developers] Mx segfaults during MonetDB build
by Mark Bucciarelli 01 Mar '10

01 Mar '10

Hi, I'm getting a segfault when running Mx, in buildtools/Mx/Code.c, CodeSubBlk(). The symptom is around line 305---s[-1] is not accessible memory. Any suggestions for how to debug/fix this? I got as far as looking at def in the parent frame (CodeSub()): (gdb) print *def $9 = { d_dir = Mxmacro, d_cmd = 0x8592e110 "DEFseqscan", d_blk = 0x89ca2000 "@:DEFseqscan_@[10](@1,@2,@3,@4,@5,@6,@7,@8,@9)@\n", d_mod = 0, d_sec = 0, d_cms = 0xd0d0d0d0 <Address 0xd0d0d0d0 out of bounds>, d_file = 0x86c3a080 "gdk_scanselect_defs.mx", d_line = 132 } (gdb) This is the Feb2010 branch, on OpenBSD 4.6 with the following malloc.conf options: A ``Abort''. malloc() will coredump the process, rather than tol- erate internal inconsistencies or incorrect usage. This is the default and a very handy debugging aid, since the core file rep- resents the time of failure, rather than when the bogus pointer was used. G ``Guard''. Enable guard pages. Each page size or larger alloca- tion is followed by a guard page that will cause a segmentation fault upon any access. J ``Junk''. Fill some junk into the area allocated. Currently junk is bytes of 0xd0 when allocating; this is pronounced ``Duh''. :-) Freed chunks are filled with 0xdf. P ``Move allocations within a page.'' Allocations larger than half a page but smaller than a page are aligned to the end of a page to catch buffer overruns in more cases. This is the default. I was getting these when building Nov2009, but I was able to get past them by restarting the build multiple times. I'd like to fix it this time around. Fortunately, after a gmake clean the crash is reproduceable. Thanks, m

2 1