- users-list - monetdb.org

Variable scope in Mal function
by imad hajj chahine 16 Jun '22

16 Jun '22

Hi, I have a mal function defined as following: function halfofyear(pdate:bat[:date]):bat[:int]; hym:= batmtime.month(pdate); hy:= batcalc.-(hym, 1, nil:bat); hy:= batcalc./(hy, 6, nil:bat); return halfofyear:= batcalc.+(hy, 1, nil:bat); end halfofyear; and I am calling it twice on 2 date columns: select halfofyear(colDate1), halfofyear(colDate2) from table. My concern is the scope of variables defined (hym, hy), as I was expecting to have unique naming when executing. Is it a guarantee that internally they are different variables or these are shared across the calls from the same query. bellow is the trace produced: hym=[57530]:bat[:int] := batmtime.month(pdate=[57530]:bat[:date]); hym=[57530]:bat[:int] := batmtime.month(pdate=[57530]:bat[:date]); hy=[57530]:bat[:int] := batcalc.-(hym=[57530]:bat[:int], 1:int, nil:BAT); hy=[57530]:bat[:int] := batcalc.-(hym=[57530]:bat[:int], 1:int, nil:BAT); hy=[57530]:bat[:int] := batcalc./(hy=[57530]:bat[:int], 6:int, nil:BAT); hy=[57530]:bat[:int] := batcalc./(hy=[57530]:bat[:int], 6:int, nil:BAT); return halfofyear=[57530]:bat[:int] := batcalc.+(hy=[57530]:bat[:int], 1:int, nil:BAT); return halfofyear=nil:bat[:int] := batcalc.+(hy=nil:bat[:int], 1:int, nil:BAT); function batudf.halfofyear(pdate:bat[:date]):bat[:int]; X_22=[57530]:bat[:int] := batudf.halfofyear(X_20=[57530]:bat[:date]); return halfofyear=[57530]:bat[:int] := batcalc.+(hy=[57530]:bat[:int], 1:int, nil:BAT); return halfofyear=nil:bat[:int] := batcalc.+(hy=nil:bat[:int], 1:int, nil:BAT); function batudf.halfofyear(pdate:bat[:date]):bat[:int]; X_25=[57530]:bat[:int] := batudf.halfofyear(X_21=[57530]:bat[:date]); barrier X_76=false:bit := language.dataflow(); X_26=33:int := sql.resultSet(X_27=[2]:bat[:str], X_28=[2]:bat[:str], X_29=[2]:bat[:str], X_30=[2]:bat[:int], X_31=[2]:bat[:int], X_22=[57530]:bat[:int], X_25=[57530]:bat[:int]); Thanks.

2 3

change Mal function definition without server restart
by imad hajj chahine 16 Jun '22

16 Jun '22

Hi, Is it possible to change the Mal function definition while the server is running without restarting? I tried connecting with mclient -lmal and running the function in an attempt to override the previous definition with no luck. any similar syntax to sql create or replace in Mal? Thanks.

1 0

Possible Loss of data (11.27.9)
by imad hajj chahine 16 Jun '22

16 Jun '22

Hi, I still have a server running 2017-sp2 (11.27.9) version, we had several reports of tables becoming empty after no activity for a period of one month or more. These tables are loaded from csv using the copy command, and at the time of loading the tables contain the correct data. Querying sys.storage showed that the oid column has a count of 210852 while the others are empty. Digging into the release-notes i only found the following alarming issue: https://github.com/MonetDB/MonetDB/issues/6465 I know that release is not supported anymore and I am planning a migration. Any idea what's the reason behind this behavior, was this reported before? [image: image.png] Thanks. Regards.

2 2

Announcement: New Jan2022-SP3 Bugfix release of MonetDB suite
by Sjoerd Mullender 31 May '22

31 May '22

The MonetDB team at MonetDB Solutions BV is pleased to announce the Jan2022-SP3 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <https://www.monetdb.org/>. For details on this release, please see the release notes at <https://www.monetdb.org/documentation/admin-guide/release-notes/jan2022/>. As usual, the download location is <https://www.monetdb.org/downloads/>. ### MonetDB Common - All accesses to the BACKUP directory need to be protected by the same lock. The lock already existed (GDKtmLock), but wasn't used consistently. This is now fixed. Hopefully this makes the hot snapshot code more reliable. - When exiting, long running instructions are aborted using the same mechanism that is used for query timeouts. ### SQL Frontend - GLOBAL TEMPORARY tables are now treated like LOCAL TEMPORARY tables as far as the table content is concerned. The schema information stays global. This fixes an issue with concurrent access and cleanup of stale data. - The NO CONSTRAINT option of the COPY INTO query has been removed. It didn't work and it was never a good idea anyway. ### Bug Fixes - [7036](https://github.com/MonetDB/MonetDB/issues/7036): Generate column names instead of labels

1 0

DELETE INTO?
by Marc Lowenthal 25 Apr '22

25 Apr '22

Hi all -- Does anyone know if MonetDB has a way of doing "DELETE INTO". The use case is to delete records from a table and save those results into another table with a single query. Thanks! --- Marc [cid:image001.png@01D85569.F9F48BB0]<http://www.scifinsys.com/> Marc Lowenthal Chief Product Officer marc(a)scifinsys.com<mailto:marc@scifinsys.com> [facebook]<https://www.facebook.com/Scientific-Financial-Systems-105163315113238> [linkedin]<https://www.linkedin.com/company/scientific-financial-systems-inc/> [/e9a7975e-dda8-4271-afa6-992bc461e648/]<https://scifinsys.com/> SFS is hiring! https://www.linkedin.com/jobs/view/2995084707/?refId=W7U9EW8bJ8ZxuymdxbxPqw… The entire content of this email message is confidential. This also applies to any files attached to it. This email is intended for an individual or entity to whom they are addressed. In case you are not the addressee of this email, and you have received it in error, immediately contact the system manager. The information in this email is very sensitive, and it is intended for the specific addressee. This email should not be disseminated, distributed or copied. If you have received this email and it was not for you, make sure to immediately notify the sender by email and afterwards delete this email from your system. Disclosing, copying, distributing, or taking any action in reliance to the email content is strictly prohibited. Consider yourself notified.

2 1

CHANGE COLUMN DATA TYPE?
by Alberto Ferrari 21 Apr '22

21 Apr '22

Hi all, I need to change the data type of a column. (I know the trick of creating a new temp column, copy the data from old, etc...) But I expected newer versions already have a command equivalent to MySql "CHANGE COLUMN" or similar, but I can't found in monetdb documentation. All examples of "ALTER COLUMN" are for setting other attributes. Anybody knows a specific command to do what I need? Kind regards, Alberto

2 4

Announcement: New Jan2022-SP2 Bugfix release of MonetDB suite
by Sjoerd Mullender 08 Apr '22

08 Apr '22

The MonetDB team at MonetDB Solutions BV is pleased to announce the Jan2022-SP2 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <https://www.monetdb.org/>. For details on this release, please see the release notes at <https://www.monetdb.org/documentation/admin-guide/release-notes/jan2022/>. As usual, the download location is <https://www.monetdb.org/downloads/>. ### Client Package - Improved the handling of the \r (internal pager) command in mclient. It now properly counts the header of table, and when a (very) long table is being printed and aborted part way in the built-in pager, not all data is transferred to the client (and then discarded). Instead at most 1000 rows are transferred. ### MonetDB Common - Improved speed of BATappend to empty varsized bat: we now just copy the heaps instead of inserting individual values. - Improved speed of projection (BATproject) on varsized bats by sharing the data heap (vheap). - Fixed a race condition which could cause a too large size being written for a .theap file to the BBP.dir file after the correct size file had been saved to disk. - We now ignore the size and capacity columns in the BBP.dir file. These values are essential during run time, but not useful in the on-disk image of the database. - Fixed a bug in the append code for msk (bit mask) bats. - Conversions from floating point types to integral types that involve multiplication now use the "long double" as intermediate type, thereby loosing as few significant bits as is feasible. - Found and fixed another source for the now infamous BBPcheckbats error that sometimes occurs at startup of the server. ### MonetDB5 Server - Improved parsing speed of blob values, especially on Windows. On Windows, using the locale-aware functions isdigit and isxdigit is comparatively very slow, so we avoid them. ### Bug Fixes - [7252](https://github.com/MonetDB/MonetDB/issues/7252): Segmentation fault on second run - [7253](https://github.com/MonetDB/MonetDB/issues/7253): Extremely slow INSERT INTO <table> SELECT - [7254](https://github.com/MonetDB/MonetDB/issues/7254): Commit with deletions is very slow - [7263](https://github.com/MonetDB/MonetDB/issues/7263): PRIMARY KEY constraint is not persistent through server restarts - [7267](https://github.com/MonetDB/MonetDB/issues/7267): Update after delete does not update some rows - [7278](https://github.com/MonetDB/MonetDB/issues/7278): BUG when there is more than one field/filter in the having clause

1 0

wrong command on deb package installation page
by Manuel Pagliai 04 Mar '22

04 Mar '22

Hello, I was following these instructions: https://www.monetdb.org/downloads/deb/ I think there is a mistake in the page and the command sudo wget --output-document=/etc/apt/trusted.gpg.d/monetdb.gpg /downloads/MonetDB-GPG-KEY.gpg should be replaced with sudo wget --output-document=/etc/apt/trusted.gpg.d/monetdb.gpg https://www.monetdb.org/downloads/MonetDB-GPG-KEY.gpg Best regards, *Manuel Pagliai* Visokio Ltd www.visokio.com +44 20 7351 4646

2 1

Iterations in MonetDB
by Oxana Dolmatova 23 Feb '22

23 Feb '22

Hello MonetDB Team, I want to integrate iterations into MonetDB using the barrier symbols provided by MAL (here the variable list_of_updates is repeated body of the iteration and ex_cond is the exit condition): ======================================= res_body = stmt_list(sql->sa, list_of_updates); stmt *s_begin = stmt_begin(sql->sa); list_append(res_list, s_begin); list_append(res_list, ex_cond); stmt *s_check = stmt_check(sql->sa, ex_cond, s_begin); list_append(res_list, s_check); list_append(res_list, res_body); list_append(res_list, stmt_redo(sql->sa, s_check)); list_append(res_list, stmt_exit(sql->sa, s_begin)); return stmt_list(sql->sa, res_list); ======================================== Currently the implementation works, when the exit condition is true, but unfortunately never stops, if the exit condition is false (I assume that this happens due to non-updating computation of ex_cond). Could you please give the reference point in the documentation or code where I could look to check if my assumption is correct? Or point me to a proper mailing-list if this is the wrong one for such questions? :) Thank you and best regards, Oksana

1 0

Fwd: COPY SELECT INTO with problems on new version 11.43.5 (Jan2022)
by Ariel Abadi 16 Feb '22

16 Feb '22

Hi All! I'm resending to the new user list. BR Ariel ---------- Forwarded message --------- From: Ariel Abadi <aabadi(a)starbi.com> Date: Fri, Feb 4, 2022, 18:44 Subject: COPY SELECT INTO with problems on new version 11.43.5 (Jan2022) To: Communication channel for MonetDB users <users-list(a)monetdb.org> Hi All! We found a problem on the new version 11.43.5 (Jan2022). We have some processes that run the COPY SELECT INTO to "move" data from monetdb to other different databases. We are expecting to receive an "answer" from monetdb affected, when the export finishes, like in the example below that informes "3 affected rows" sql>COPY SELECT * FROM cars INTO '/tmp/cars_out.csv' USING DELIMITERS ',' , '\n' , '"';*3 affected rows* While we run the same query on the new server, mclient/monetdb is not returning anything like the image below. sql>COPY SELECT * FROM cars INTO '/tmp/cars_out.csv' USING DELIMITERS ',' , '\n' , '"'; sql> Does anybody have the same issue? Am i doing something wrong? Thks a lot in advance! Ariel

2 1