developers-list November 2013

developers-list@monetdb.org

11 participants
10 discussions

New Jan2014 stable branch created

by Sjoerd Mullender

I have created a new stable branch for the next feature release. This branch was created in order to stabilize the code before the feature release. From now on *only* bug fixes may go to this new stable branch. I reserve the right to undo any changes that do not comply with this rule. I also reserve the right to admit changes that are not strictly bug fixes. The name for the branch is Jan2014. So in each of your stable checkout directories you can do hg pull hg update -rJan2014 to update to this new branch. -- Sjoerd Mullender

8 years, 8 months

MonetDB with OpenCL extension (Ocelot) query fails trying to cache empty BAT

by Edward Ching

I'm running into a problme with Ocelot, the MonetDB with OpenCL extension.Not sure if this should go to the developers' or users' list. I apologize if this is not the right list to post to. I'm seeing a query failure which was caused by MoneDB-OpenCL trying to cache an empty BAT and ended up calling clCreateBuffer with a 0 size buffer and failed. Any select with a where clause would trigger it. Has anyone seen this too? It fails whether I use 32 bit or 64 bit oid, Nvidia or AMD. I'm trying to figure if it's a real issue or if I'm missing anything. Any input greatly appreciated. The database was generated by TPC-H dbgen (details below). The query I used was "select c_custkey, c_name from customer where c_custkey < 2", and here's a trace of the sequence of calls leading to the failure starting from the MAL statement: 1) X_52 := ocelot.thetasubselect(r1_10,A0,"<",0);(see log below) 2) ocl_select.c::ocl_subselect() line 142: ocl_cacheBAT 3) ocl_memmanager.c::ocl_cacheBAT() line 771: allocateBuffer 4) ocl_memmanager.c::allocateBuffer() line 432: clCreateBuffer ===== Source version and environment ===== 1) Ocelot src installed from zip downloaded from monetdb-opencl: msaecker-monetdb-opencl-b513b35eb84a.zip 2) Ocelot configure options: ./configure --prefix=/usr/local --enable-oid32 --enable-optimize --disable-test ing --disable-developer --disable-debug --disable-assert --enable-sql --enable-m onetdb5 --with-opencl=/usr 3) Operating System: Fedora 17 kernel 3.9.10-100 4) Hardware: NVIDIA GTX570 on Intel i7-3820 w/ 16GB mem 5) OpenCL: Nvidia OpenCL that came with CUDA 5.5 SDK 6) Database: generated w/ TPC-H dbgen using size factor s=0.01 ===== operation log follows ===== [root@gen3-2 ocelot]# mclient -ddb001 -lmal mal>ocelot.init(); mal>ocelot.listDevices(); # Device 0: NVIDIA Corporation - GeForce GTX 570 (default device) mal>\q [root@gen3-2 ocelot]# mclient -ddb001 -lsql sql>\d TABLE sys.customer TABLE sys.lineitem TABLE sys.nation TABLE sys.orders TABLE sys.part TABLE sys.partsupp TABLE sys.region TABLE sys.supplier sql>\d customer CREATE TABLE "sys"."customer" ( "c_custkey" INTEGER NOT NULL, "c_name" VARCHAR(25) NOT NULL, "c_address" VARCHAR(40) NOT NULL, "c_nationkey" INTEGER NOT NULL, "c_phone" VARCHAR(15) NOT NULL, "c_acctbal" DECIMAL(15,2) NOT NULL, "c_mktsegment" VARCHAR(10) NOT NULL, "c_comment" VARCHAR(117) NOT NULL, CONSTRAINT "customer_c_custkey_pkey" PRIMARY KEY ("c_custkey"), CONSTRAINT "customer_c_nationkey_fkey" FOREIGN KEY ("c_nationkey") REFERENCES "sys"."nation" ("n_nationkey") ); sql>select count(*) from customer; +------+ | L1 | +======+ | 1500 | +------+ 1 tuple (1.311ms) sql>select c_custkey, c_name from customer where c_custkey < 2; +-----------+--------------------+ | c_custkey | c_name | +===========+====================+ | 1 | Customer#000000001 | +-----------+--------------------+ 1 tuple (1.776ms) sql>set optimizer='cl_pipe'; operation successful (0.981ms) sql>select c_custkey, c_name from customer where c_custkey < 2; invalid/unknown response from server, ignoring output ? #Could not allocate OpenCL buffer of size: 0. Error caching input BAT. sql> sql>explain select c_custkey, c_name from customer where c_custkey < 2; +------------------------------------------------------------------------------+ | mal +==============================================================================+ | function user.s9_1{autoCommit=true}(A0:int):void; | | ocelot.beginQuery(); | | X_3 := sql.mvc(); | | X_7 := sql.bind(X_3,"sys","customer","c_custkey",0); | | X_4:bat[:oid,:oid] := sql.tid(X_3,"sys","customer"); | | X_51 := ocelot.thetasubselect(X_7,X_4,A0,"<",0); | | (X_10,r1_10) := sql.bind(X_3,"sys","customer","c_custkey",2); | | X_52 := ocelot.thetasubselect(r1_10,A0,"<",0); | | X_13 := sql.bind(X_3,"sys","customer","c_custkey",1); | | X_53 := ocelot.thetasubselect(X_13,X_4,A0,"<",0); | | ocelot.sync(X_51); | | ocelot.sync(X_52); | | ocelot.sync(X_53); | | X_15 := sql.subdelta(X_51,X_4,X_10,X_52,X_53); | | X_17 := sql.projectdelta(X_15,X_7,X_10,r1_10,X_13); | | X_18 := sql.bind(X_3,"sys","customer","c_name",0); | | (X_20,r1_23) := sql.bind(X_3,"sys","customer","c_name",2); | | X_22 := sql.bind(X_3,"sys","customer","c_name",1); | | X_23 := sql.projectdelta(X_15,X_18,X_20,r1_23,X_22); | | X_24 := sql.resultSet(2,1,X_17); | | sql.rsColumn(X_24,"sys.customer","c_custkey","int",32,0,X_17); | | sql.rsColumn(X_24,"sys.customer","c_name","varchar",25,0,X_23); | | X_32 := io.stdout(); | | sql.exportResult(X_32,X_24); | | ocelot.endQuery(); | | end s9_1; | | # querylog.define("explain select c_custkey, c_name from customer where c_cu | : stkey < 2;","cl_pipe") : +------------------------------------------------------------------------------+ 27 tuples (1.408ms) sql> =======================================

8 years, 8 months

Re: MonetDB: default - Get rid of Mx.

by Fabian Groffen

On 21-11-2013 12:54:34 +0100, Sjoerd Mullender wrote: > Changeset: f6606676fe5e for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=f6606676fe5e > Branch: default > Log Message: > > Get rid of Mx. Hooray! Congratulations :) Fabian

8 years, 8 months

Re: MonetDB: default - Prepare split of sql.mx

by Stefan Manegold

Martin, what's the (intended) difference between the newly added command mmath.rand{unsafe} (v:int) :int (see below) and the existing function mmath.rand{inline}( v:int ) :int; (see sql/backends/monet5/sql.mx line 1123) ? In particular, which of the two seemingly identical signatures will the MAL interpreter choose / use to evaluate, say, a:int:=mmath.rand(0:int); ? If they are identical / indistinguishable, one should be removed (again). Thanks, Stefan ps: Found by test clients/Tests/MAL-signatures ;-) ----- Original Message ----- > Changeset: 026d2c8bc8ee for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=026d2c8bc8ee > Added Files: > sql/backends/monet5/sql.mal > sql/backends/monet5/sql_aggr_bte.mal > sql/backends/monet5/sql_aggr_flt.mal > sql/backends/monet5/sql_aggr_int.mal > sql/backends/monet5/sql_aggr_lng.mal > sql/backends/monet5/sql_aggr_sht.mal > sql/backends/monet5/sql_aggr_wrd.mal > sql/backends/monet5/sql_cast.mal > sql/backends/monet5/sql_inspect.mal > sql/backends/monet5/sql_octopus.mal > sql/backends/monet5/sql_rank.mal > sql/backends/monet5/sql_rdf.mal > sql/backends/monet5/sql_sort.mal > Modified Files: > monetdb5/modules/kernel/mmath.mal > sql/backends/monet5/Makefile.ag > Branch: default > Log Message: > > Prepare split of sql.mx > The first step in a dissection of the monster. > Splitting sql.mx into *mal and the rest > > times() has been removed. Also script 11_times > should be removed. > > sql_cast.mal calls for a shell script > whereafter we can finish the first step in > the dissection. > > > diffs (truncated from 1794 to 300 lines): > > diff --git a/monetdb5/modules/kernel/mmath.mal > b/monetdb5/modules/kernel/mmath.mal > --- a/monetdb5/modules/kernel/mmath.mal > +++ b/monetdb5/modules/kernel/mmath.mal > @@ -182,6 +182,10 @@ command rand{unsafe} () :int > address MATHrandint > comment "return a random number"; > > +command rand{unsafe} (v:int) :int > +address MATHrandint > +comment "return a random number"; > + > command srand(seed:int) :void > address MATHsrandint > comment "initialize the rand() function with a seed"; > diff --git a/sql/backends/monet5/Makefile.ag > b/sql/backends/monet5/Makefile.ag > --- a/sql/backends/monet5/Makefile.ag > +++ b/sql/backends/monet5/Makefile.ag > @@ -96,7 +96,7 @@ lib__sql = { > headers_mal = { > HEADERS = mal > DIR = libdir/monetdb5 > - SOURCES = sql.mx > + SOURCES = sql.mx sql_aggr_bte.mal sql_aggr_flt.mal sql_aggr_int.mal > sql_aggr_lng.mal sql_aggr_sht.mal sql_aggr_wrd.mal sql_cast.mal > sql_inspect.mal sql.mal sql_octopus.mal sql_rank.mal sql_rdf.mal > sql_sort.mal > } > > headers_autoload = { > diff --git a/sql/backends/monet5/sql.mal b/sql/backends/monet5/sql.mal > new file mode 100644 > --- /dev/null > +++ b/sql/backends/monet5/sql.mal > @@ -0,0 +1,1055 @@ > +# The contents of this file are subject to the MonetDB Public License > +# Version 1.1 (the "License"); you may not use this file except in > +# compliance with the License. You may obtain a copy of the License at > +# http://www.monetdb.org/Legal/MonetDBLicense > +# > +# Software distributed under the License is distributed on an "AS IS" > +# basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the > +# License for the specific language governing rights and limitations > +# under the License. > +# > +# The Original Code is the MonetDB Database System. > +# > +# The Initial Developer of the Original Code is CWI. > +# Portions created by CWI are Copyright (C) 1997-July 2008 CWI. > +# Copyright August 2008-2013 MonetDB B.V. > +# All Rights Reserved. > + > + > +module batsql; > +module sql; > + > +pattern start():void > +address SQLsession > +comment "Switch to processing SQL statements"; > + > +pattern start2():void > +address SQLsession2 > +comment "Switch to processing precompiled sql statements"; > + > +pattern init():void > +address SQLinitEnvironment > +comment "Initialize the environment for MAL"; > + > +pattern shutdown(delay:bte, force:bit):str > +address SQLshutdown_wrap; > +pattern shutdown(delay:sht, force:bit):str > +address SQLshutdown_wrap; > +pattern shutdown(delay:int, force:bit):str > +address SQLshutdown_wrap; > + > +pattern shutdown(delay:bte):str > +address SQLshutdown_wrap; > +pattern shutdown(delay:sht):str > +address SQLshutdown_wrap; > +pattern shutdown(delay:int):str > +address SQLshutdown_wrap; > + > +pattern mvc():int > +address SQLmvc > +comment "Get the multiversion catalog context. > +Needed for correct statement dependencies > +(ie sql.update, should be after sql.bind in concurrent execution)"; > + > +pattern trans(type:int,chain:int,name:str):void > +address SQLtransaction > +comment "A transaction statement (type can be commit,release,rollback or > start)"; > + > +pattern transaction{unsafe}() > +address SQLtransaction2 > +comment "Start an autocommit transaction"; > + > +pattern commit() > +address SQLcommit > +comment "Trigger the commit operation for a MAL block"; > + > +pattern abort() > +address SQLabort > +comment "Trigger the abort operation for a MAL block"; > + > +pattern catalog(type:int,sname:str,name:str,action:int):void > +address SQLcatalog; > +pattern > catalog(type:int,sname:str,name:str,funcid:int,ft:int,action:int):void > +address SQLcatalog; > +pattern > catalog(type:int,sname:str,name:str,tname:str,time:int,o:int,event:int,oname:str,nname:str,condition:str,query:str):void > +address SQLcatalog; > +pattern catalog(type:int,sname:str,t:ptr):void > +address SQLcatalog; > +pattern catalog(type:int,sname:str,t:ptr,temp:int):void > +address SQLcatalog; > +pattern catalog(type:int,sname:str,t:ptr,restart:lng):void > +address SQLcatalog > +comment "a catalog statement"; > + > +pattern catalog(type:int,grantee:str,role:str):void > +address SQLcatalog > +comment "a grant/revoke role statement"; > + > +pattern > catalog(type:int,user:str,passwd:str,enc:int,schema:str,fullname:str):void > +address SQLcatalog > +comment "a user catalog statement"; > + > +pattern > catalog(type:int,sname:str,tname:str,grantee:str,privs:int,cname:str,grant:int,grantor:int):void > +address SQLcatalog > +comment "a grant/revoke privileges statement"; > + > +pattern catalog(type:int,iname:str,itype:int,sname:str,tname:str...):void > +address SQLcatalog > +comment "a create index catalog statement"; > + > +pattern eval(cmd:str):void > +address SQLstatement; > +pattern eval(cmd:str, output:bit):void > +address SQLstatement > +comment "Compile and execute a single sql statement (and optionaly send > output on the output stream)"; > + > +pattern include(fname:str):void > +address SQLinclude > +comment "Compile and execute a sql statements on the file"; > + > +pattern evalAlgebra(cmd:str, optimize:bit):void > +address RAstatement > +comment "Compile and execute a single 'relational algebra' statement"; > + > +pattern assert(b:bit,msg:str):void > +address SQLassert; > +pattern assert(b:int,msg:str):void > +address SQLassertInt; > +pattern assert(b:wrd,msg:str):void > +address SQLassertWrd; > +pattern assert(b:lng,msg:str):void > +address SQLassertLng > +comment "Generate an exception when b!=0"; > + > +pattern setVariable(mvc:int, varname:str, value:any_1 ):int > +address setVariable > +comment "Set the value of a session variable"; > + > +pattern getVariable(mvc:int, varname:str ):any_1 > +address getVariable > +comment "Get the value of a session variable"; > + > +pattern logfile{unsafe}(filename:str):void > +address mvc_logfile > +comment "Enable/disable saving the sql statement traces"; > + > +pattern next_value( sname:str, sequence:str ):lng > +address mvc_next_value > +comment "return the next value of the sequence"; > + > +pattern batsql.next_value( sname:bat[:oid,:str], sequence:str ) > :bat[:oid,:lng] > +address mvc_bat_next_value > +comment "return the next value of the sequence"; > + > +pattern get_value( sname:str, sequence:str ):lng > +address mvc_get_value > +comment "return the current value of the sequence"; > + > +pattern restart{unsafe}( sname:str, sequence:str, start:lng ):lng > +address mvc_restart_seq > +comment "restart the sequence with value start"; > + > +pattern bind_idxbat(mvc:int, schema:str, table:str, index:str, > access:int):bat[:oid,:any_1] > +address mvc_bind_idxbat_wrap > +comment "Bind the 'schema.table.index' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind_idxbat(mvc:int, schema:str, table:str, index:str, > access:int)(uid:bat[:oid,:oid],uval:bat[:oid,:any_1]) > +address mvc_bind_idxbat_wrap > +comment "Bind the 'schema.table.index' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind_idxbat(mvc:int, schema:str, table:str, index:str, access:int, > part_nr:int, nr_parts:int):bat[:oid,:any_1] > +address mvc_bind_idxbat_wrap > +comment "Bind the 'schema.table.index' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind_idxbat(mvc:int, schema:str, table:str, index:str, access:int, > part_nr:int, nr_parts:int)(uid:bat[:oid,:oid],uval:bat[:oid,:any_1]) > +address mvc_bind_idxbat_wrap > +comment "Bind the 'schema.table.index' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind(mvc:int, schema:str, table:str, column:str, access:int > ):bat[:oid,:any_1] > +address mvc_bind_wrap > +comment "Bind the 'schema.table.column' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind(mvc:int, schema:str, table:str, column:str, access:int > )(uid:bat[:oid,:oid],uval:bat[:oid,:any_1]) > +address mvc_bind_wrap > +comment "Bind the 'schema.table.column' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind(mvc:int, schema:str, table:str, column:str, access:int, > part_nr:int, nr_parts:int ):bat[:oid,:any_1] > +address mvc_bind_wrap > +comment "Bind the 'schema.table.column' BAT partition with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind(mvc:int, schema:str, table:str, column:str, access:int, > part_nr:int, nr_parts:int )(uid:bat[:oid,:oid],uval:bat[:oid,:any_1]) > +address mvc_bind_wrap > +comment "Bind the 'schema.table.column' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +command delta ( col:bat[:oid,:any_3], uid:bat[:oid,:oid], > uval:bat[:oid,:any_3], ins:bat[:oid,:any_3] ) > + :bat[:oid,:any_3] > +address DELTAbat > +comment "Return column bat with delta's applied."; > + > +command projectdelta( subselect:bat[:oid,:oid], col:bat[:oid,:any_3], > uid:bat[:oid,:oid], uval:bat[:oid,:any_3], ins:bat[:oid,:any_3] ) > :bat[:oid,:any_3] > +address DELTAproject > +comment "Return column bat with delta's applied."; > + > +command subdelta ( col:bat[:oid,:oid], cand:bat[:oid,:oid], > uid:bat[:oid,:oid], uval:bat[:oid,:oid], ins:bat[:oid,:oid] ) > :bat[:oid,:oid] > +address DELTAsub > +comment "Return a single bat of subselected delta."; > + > +command delta ( col:bat[:oid,:any_3], uid:bat[:oid,:oid], > uval:bat[:oid,:any_3]) :bat[:oid,:any_3] > +address DELTAbat2 > +comment "Return column bat with delta's applied."; > + > +command projectdelta( subselect:bat[:oid,:oid], col:bat[:oid,:any_3], > uid:bat[:oid,:oid], uval:bat[:oid,:any_3]) :bat[:oid,:any_3] > +address DELTAproject2 > +comment "Return column bat with delta's applied."; > + > +command subdelta ( col:bat[:oid,:oid], cand:bat[:oid,:oid], > uid:bat[:oid,:oid], uval:bat[:oid,:oid]) :bat[:oid,:oid] > +address DELTAsub2 > +comment "Return a single bat of subselected delta."; > + > +command getVersion(clientid:int):lng > +address mvc_getVersion > +comment "Return the database version identifier for a client"; > + > +pattern append(mvc:int, sname:str, tname:str, cname:str, ins:any):int > +address mvc_append_wrap > +comment "Append b to the column tname.cname (possibly optimized to replace > the insert bat of tname.cname (returns sequence number for order > dependence)"; > + > +pattern update(mvc:int, sname:str, tname:str, cname:str, rids:any, > upd:any):int > +address mvc_update_wrap > +comment "Update the values of the column tname.cname"; > + > +pattern clear_table{unsafe}(sname:str, tname:str) :wrd > +address mvc_clear_table_wrap > +comment "Clear table"; > + > +pattern tid( mvc:int, sname:str, tname:str):bat[:oid,:any_3] > +address SQLtid; > +pattern tid( mvc:int, sname:str, tname:str, part_nr:int, nr_parts:int > ):bat[:oid,:any_3] > +address SQLtid > +comment "Return the tables tid column."; > + > +pattern delete{unsafe}(mvc:int, sname:str, tname:str, b:any):int > +address mvc_delete_wrap > +comment "delete from table"; > + > +pattern resultSet{unsafe}( nr_cols:int, sep:str, rsep:str, ssep:str, ns:str, > order:any_1 ) :int > +address mvc_result_file_wrap; > +pattern resultSet{unsafe}( nr_cols:int, sep:str, rsep:str, ssep:str, ns:str, > order:bat[:oid,:any_1] ) :int > +address mvc_result_file_wrap; > +pattern resultSet{unsafe}( nr_cols:int, qtype:int, order:any_1 ) :int > +address mvc_result_row_wrap; > +pattern resultSet{unsafe}( nr_cols:int, qtype:int, order:bat[:oid,:any_1] ) > :int > +address mvc_result_table_wrap; > +pattern rsColumn{unsafe}(rs:int, tname:str, name:str, typename:str, > digits:int, scale:int, val:any_1 ) :void > +address mvc_result_value_wrap > +comment "Add the value to the row query result"; > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/checkin-list > -- | Stefan.Manegold(a)CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

8 years, 8 months

Default branch does not compile for builds with --enable_oid32

by Max Heimel

Hi, I stumbled upon a build error in the latest source from the default branch when I configure with --enable_oid32. The fix is a missing curly brace in the HASHputall macro at gdk/gdk_search.h:110.

8 years, 8 months

Re: MonetDB: holindex - Comment lines that use papi in order to meas...

by Stefan Manegold

Eleni, this calls for a proper configure check and conditionals to reduce/eliminate (extra) code maintenance overhead ;-) Feel free to ask in case you need more detailed pointers ... Stefan ----- Original Message ----- > Changeset: da0067120542 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=da0067120542 > Modified Files: > monetdb5/extras/crackers/crackers_selectholpl_ops.mx > Branch: holindex > Log Message: > > Comment lines that use papi in order to measure hardware events. > > > diffs (59 lines): > > diff --git a/monetdb5/extras/crackers/crackers_selectholpl_ops.mx > b/monetdb5/extras/crackers/crackers_selectholpl_ops.mx > --- a/monetdb5/extras/crackers/crackers_selectholpl_ops.mx > +++ b/monetdb5/extras/crackers/crackers_selectholpl_ops.mx > @@ -77,6 +77,7 @@ crackers_export str CRKrandomholpl_@1(in > */ > #include "monetdb_config.h" > #include "crackers.h" > +//#include <papi.h> > > /* Local support functions and macros */ > @:TypeSwitch(crackOperations)@ > @@ -384,7 +385,7 @@ CRKrandomholpl_@1(int *bid, bit *inclusi > FN->c = FN->c + incr_pieces; > if(FN->weight > 0) > FN->weight = changeWeight(FN,countBatElements,L1); > - fprintf(ofp,"Idle_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Low= \t %d \t Thread_id= > \t" SZFMT "\n",FN->bid,FN->c,wt,ct,(int)*low,MT_getpid()); > + fprintf(ofp,"Idle_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT > "\n",FN->bid,FN->c,wt,ct,MT_getpid()); > fclose(ofp); > MT_lock_unset(&frequencylock, "getFrequencyStruct"); > > @@ -1371,6 +1372,12 @@ CRKRangeLeftNilTree_@1(int *vid, int *bi > FrequencyNode *FrequencyStructA = getFrequencyStruct('A'); > FILE *ofp; > char *outputFilename1; > + //long long counters[2]; > + //int PAPI_events[] = { > + // PAPI_L2_DCA, > + // PAPI_L2_DCM}; > + > + //PAPI_start_counters(PAPI_events, 2); > > gettimeofday(&tv0,0); > > @@ -1444,8 +1451,10 @@ CRKRangeLeftNilTree_@1(int *vid, int *bi > FN->c = FN->c + incr_pieces; > FN->weight = changeWeight(FN,countBatElements,L1); > gettimeofday(&tv1,0); ct+=dt(tv0,tv1); tv0=tv1; > - fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Hgh= \t %d \t Thread_id= > \t" SZFMT "\n",FN->bid,FN->c,wt,ct,(int)*hgh,MT_getpid()); > -+ fclose(ofp); > + //PAPI_read_counters(counters, 2); > + //fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT "\t > L2_DCA= \t %lld \t L2_DCM \t > %lld\n",FN->bid,FN->c,wt,ct,MT_getpid(),counters[0],counters[1]); > + fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT > "\n",FN->bid,FN->c,wt,ct,MT_getpid()); > + fclose(ofp); > MT_lock_unset(&frequencylock, "getFrequencyStruct"); > > BBPincref(b->batCacheid,TRUE); > @@ -1552,8 +1561,10 @@ CRKRangeLeftNilTree_@1(int *vid, int *bi > if(FN->weight > 0) > FN->weight = changeWeight(FN,countBatElements,L1); > gettimeofday(&tv1,0); ct+=dt(tv0,tv1); tv0=tv1; > - fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Hgh= \t %d \t Thread_id= > \t" SZFMT "\n",FN->bid,FN->c,wt,ct,(int)*hgh,MT_getpid()); > -+ fclose(ofp); > + //PAPI_read_counters(counters, 2); > + //fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT "\t > L2_DCA \t %lld \t L2_DCM= \t %lld > \n",FN->bid,FN->c,wt,ct,MT_getpid(),counters[0],counters[1]); > + fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT > "\n",FN->bid,FN->c,wt,ct,MT_getpid()); > + fclose(ofp); > MT_lock_unset(&frequencylock, "getFrequencyStruct"); > > > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/checkin-list > -- | Stefan.Manegold(a)CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

8 years, 8 months

Re: MonetDB: default - handle added types also in declared tables

by Sjoerd Mullender

Is this the fix for bug 3394 that you just closed? If so, was this really intended for the default branch (in which case the bug should be NEXTFEATURERELEASE) or should this have gone to the Feb2013 branch? On 2013-11-11 22:14, Niels Nes wrote: > Changeset: 63c54046f8c4 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=63c54046f8c4 > Modified Files: > sql/backends/monet5/sql.mx > sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql > Branch: default > Log Message: > > handle added types also in declared tables > > > diffs (43 lines): > > diff --git a/sql/backends/monet5/sql.mx b/sql/backends/monet5/sql.mx > --- a/sql/backends/monet5/sql.mx > +++ b/sql/backends/monet5/sql.mx > @@ -3993,12 +3993,13 @@ mvc_declared_table_column_wrap(Client cn > str msg = getSQLContext(cntxt,mb, &m, NULL); > sql_schema *s = NULL; > sql_table *t = NULL; > + sql_type *type = NULL; > sql_subtype tpe; > int *ret = (int *) getArgReference(stk, pci, 0); > int *rs = (int *) getArgReference(stk, pci, 1); > str *tname = (str *) getArgReference(stk, pci, 2); > str *name = (str *) getArgReference(stk, pci, 3); > - str *type = (str *) getArgReference(stk, pci, 4); > + str *typename = (str *) getArgReference(stk, pci, 4); > int *digits = (int *) getArgReference(stk, pci, 5); > int *scale = (int *) getArgReference(stk, pci, 6); > > @@ -4006,8 +4007,11 @@ mvc_declared_table_column_wrap(Client cn > return msg; > if (*rs != 0) > throw(SQL, "sql.dtColumn", "Cannot access declared table"); > - if (!sql_find_subtype(&tpe, *type, *digits, *scale)) > + if (!sql_find_subtype(&tpe, *typename, *digits, *scale) && > + (type = mvc_bind_type(m, *typename)) == NULL) > throw(SQL, "sql.dtColumn", "Cannot find column type"); > + if (type) > + sql_init_subtype(&tpe, type, 0, 0); > s = mvc_bind_schema(m, dt_schema); > if ( s == NULL) > throw(SQL,"sql.declared_table_column","3F000!Schema missing"); > diff --git a/sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql b/sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql > --- a/sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql > +++ b/sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql > @@ -45,3 +45,8 @@ begin > end; > > select tmp4(); > + > +drop function tmp4; > +drop function tmp3; > +drop function tmp2; > +drop function tmp1; > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/checkin-list > -- Sjoerd Mullender

8 years, 8 months

How do I get SQL decimal scale in MAL?

by Dru Nelson

HI, I"m working on writing an aggregate in in C that is a MAL function. I've run into a problem with decimal types. I've noticed that when I inspect the BAT inputs for various types, they are coerced to simpler types. (flt,dbl -> dbl). (int, decimal -> int). There is also no other information in the BAT structure to see the type. I notice that a SQL select gets the type info passed in as parameters for the 'exportValue' output. For example: >* sql.exportValue(1,".","second_single_value","decimal",9,3,8,_4,""); * How can I get this type information ('decimal', etc.) passed into my function? Dru

8 years, 8 months

about "MT" in gdk module

by 张磊

hi all, I found that in gdk module of monetdb, the file gdk_posix.c has many functions which begin with “MT”, and I want to ask that what's "MT", is that "MoneT", "Multiple Thread" or others? what's the meaning of "MT"? :) -- Best Wishes! zhanglei

8 years, 8 months

Monetdb ODBC datatype conversion problem

by baraa Mohamad

Dear MonetDB users, I have created a database link from oracle to monetdb using Monetdb ODBC driver, the link works fine but i have a strange results 😓 I have the following configurations: host1: Oracle (ubuntu 64bit)host2: MonetDB (ubntu 64bit)ODBC driver: MonetDB odbc (64bit) using unixODBC driver manager on monetdb i have the following table: emp (id integer , name varchar); test query: select id from emp where id<20; when I execute this query directly on montdb I get the following results (IDs from 1 to 19)ID123..19 BUT when I execute this query from oracle using dblink select "id" from "emp"@monetdb where "id"<20 ; I GET THE FOLLOWING RESULTS: ID-------- 18589934592 21.2885E+10 31.7180E+10 42.1475E+10 52.5770E+10 63.0065E+10 73.4360E+10 83.8655E+10 94.2950E+10 10 I cannot figure out the cause of the problem and how I can solve it (it seems a problem related to datatype conversion using ODBC) Could you please tell me what I should do.... Best regards,Baraa

8 years, 8 months

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

developers-list November 2013