April 2016 - users-list

Function does not complete
by Shmagi Kavtaradze 07 Apr '16

07 Apr '16

When I run the own written function it runs and does no exit. I was waiting for 5-6 hours, checked dstats, no disk writes, only 1 core works and no memory usage. It is like stuck and can not exit. It happens when I use function separately for each variable, without callingm for example: while( *a ){ countA += *a & 1; *a >>= 1; } while( *b ){ countB += *b & 1; *b >>= 1; } while( c ){ countC += c & 1; c >>= 1; } but when I call functions like this monetdb works fine: int countSetBits1(unsigned int n){ unsigned int count = 0; while(n){ count += n & 1; n >>= 1; } return count; } countA = countSetBits1(*a); countB = countSetBits1(*b); countC = countSetBits1(c); I am not strong in C or monetdb internals, but in Netbeans both codes work well. The entire code : str UDFbitanddec(flt *ret, lng *a, lng *b) { int c = 0; int countA = 0; int countB = 0; int countC = 0; int maxCount = 0; unsigned int iA = *a; unsigned int iB = *b; c = iA & iB; while( iA ){ countA += iA & 1; iA >>= 1; } while( iB ){ countB += iB & 1; iB >>= 1; } while( c ){ countC += c & 1; c >>= 1; } if (countA >= countB) { maxCount = countA; } else { maxCount = countB; } *ret = (float)countC /maxCount; return MAL_SUCCEED; }

2 1

Exception Error
by Erie, Rob 07 Apr '16

07 Apr '16

I am in the process of evaluating databases for analysis at my organization. I have installed MonetDB and loaded some data. I was attempting to compare results both in performance and accuracy between MySQL and MonetDB. I have been receiving Overflow in Calculation errors from MonetDB. I am a total novice with MonetDB. Here is the information about my system: Red Hat Enterprise Linux Server release 7.2 (Maipo) (Linux 3.10.0-327.el7.x86_64 #1 SMP Thu Oct 29 17:29:29 EDT 2015 x86_64 x86_64 x86_64 GNU/Linux) MySQL Server version: 5.7.11-log MySQL Community Server Java version "1.8.0_74"; Java(TM) SE Runtime Environment (build 1.8.0_74-b02); Java HotSpot(TM) 64-Bit Server VM (build 25.74-b02, mixed mode). Apache Tomcat 7.0.54 Welcome to mclient, the MonetDB/SQL interactive terminal (Jul2015-SP3) Database: MonetDB v11.21.17 (Jul2015-SP3), 'mapi:monetdb://ip-10-153-0-5.ec2.internal:50000/set_mktng' Issue Description: I would like to know the correlation between two variables group by a variable. SQL: select milageRange, sys.corr(numberOfTheseParts,avgHomeValue) FROM aPartsByZipRange INNER JOIN avgHomeValueZipPeriod ON zipCode = zip where numberOfTheseParts <> 0 and avgHomeValue <>0 group by milageRange; Error: TypeException:user.s78_2[44]:'aggr.subcorr' undefined in: X_75:bat[:any,:int] := aggr.subcorr(X_72:bat[:oid,:int],X_74:bat[:oid,:int],X_67:bat[:oid,:oid],r1_67:bat[:oid,:oid],true:bit); program contains errors -- -------------------------------------------------- This e-mail transmission contains information intended only for the use of the recipient(s) named above. Further, it contains information that may be privileged and confidential. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this message (including any attachments) is strictly prohibited. If you have received this e-mail in error, please notify the sender by reply e-mail and then delete this message from your mail system. Thank you for your compliance.

3 4

Question
by Сергей 07 Apr '16

07 Apr '16

Does anyone create replication with MonetDB? I've tried many times but still cannot run MonetDB in master-slave mode(replication). I have such errors when start slave server: !mvc_init: unable to create system tables !SQLException:SQLinit:Catalogue initialization failed I've done all that written in https://www.monetdb.org/Documentation/Cookbooks/SQLrecipes/TransactionRepli… but it does not work. Does anyone can help me? Is transaction-replication included to July2015SP3 release? Or I must build MonetDB from sources? Thanks.

1 0

Create R function that can be applied to an entire table
by Willem Ligtenberg 07 Apr '16

07 Apr '16

Hi, I guess I am pushing the user defined R functions to their limits. I know want to implement some batch correcting in R and then apply that to an entire table. I have written R code, that will generate a function definition that has matching parameters. And then I want to call the function as follows: CREATE TABLE data_bc AS SELECT * FROM batch_correction( (SELECT * FROM data) ) WITH DATA; I then get the following error: Error in .local(conn, statement, ...) : Unable to execute statement 'CREATE TABLE hcs_batch AS SELECT * FROM batch_correction( (SELECT * FROM hcs_norm) ) WITH DATA;'. Server says '!Command too large' Looking at the source, this error is raised in rapi.c on either line 467 or 473. After editing the source to figure out which of the lines was triggered, I figured out is was on line: 467 it is triggered, so the following code raises the issue that the command is too large: pos = 0; for (i = pci->retc + 2; i < pci->argc && pos < sizeof(argnames); i++) { pos += snprintf(argnames + pos, sizeof(argnames) - pos, "%s%s", args[i], i < pci->argc - 1 ? ", " : ""); } if (pos >= sizeof(argnames)) { msg = createException(MAL, "rapi.eval", "Command too large1"); goto wrapup; } (yes, I added the 1 to large, to make it unique) If this is not a bug, any help in getting my code to work is greatly appreciated. Kind regards, Willem

2 3

Disabling do_sort() does not work.
by Xu,Wenjian 06 Apr '16

06 Apr '16

Hi, I would like to replace MonetDB' sorting algorithms (timsort/quicksort) with my own. As the first step, I commented all content of function *do_sort()* in gdk_batop.c to disable the sorting functionality. Then I re-build the monetdb (with no error) and type a SQL statement with ORDER-BY clause in mclient interface: "select o_orderkey, o_custkey, o_orderstatus from orders order by o_custkey limit 10;" I was expecting to see the dis-ordered result. However, it turns out that the result is still ordered by o_custkey. I am confused about the result. Did I miss something? Any help would be great. Best regards, John

1 0

accessing intermediate optimizer results.
by Xu,Wenjian 01 Apr '16

01 Apr '16

Hi all, I would like to see the intermediate result (i.e., MAL instructions) after each optimizer step in a optimizer pipeline. So I searched Monetdb's documents and found the following sentence in https://www.monetdb.org/Documentation/Cookbooks/SQLrecipes/OptimizerPipelin… : "Alternatively, the SQL DEBUG statement modifier in combination with the 'o' command provides access to the intermediate optimizer results." I cannot figure out what this sentence means. What I know about SQL DEBUG statement is to use "debug <SQL statement>" to enter the debug mode and iterate through each (final) MAL instruction one by one. How could I use 'o' command to access intermediate optimizer results? I am using MonetDB 11.21.17 (JUL2015 SP3) and my environment is Ubuntu14.04. Thank you very much. Best regards, XU Wenjian

2 4