September 2015 - users-list

Encrypted Client Sessions
by James Candalino 17 Sep '15

17 Sep '15

Hi all, Is it possible to establish encrypted client sessions? If so, how? I didn't see anything in the documentation. With postgres connecting using jdbc is just jdbc:postgresql://dbhost/dbname?ssl=true. Any insight would be greatly appreciated. --James -- *NOTICE TO RECIPIENTS*: This communication is confidential and intended for the use of the addressee only. If you are not an intended recipient of this communication, please delete it immediately and notify the sender by return email. Unauthorized reading, dissemination, distribution or copying of this communication is prohibited. This communication does not constitute an offer to sell or a solicitation of an indication of interest to purchase any loan, security or any other financial product or instrument, nor is it an offer to sell or a solicitation of an indication of interest to purchase any products or services to any persons who are prohibited from receiving such information under applicable law. The contents of this communication may not be accurate or complete and are subject to change without notice. As such, Orchard App, Inc. (including its subsidiaries and affiliates, "Orchard") makes no representation regarding the accuracy or completeness of the information contained herein. The intended recipient is advised to consult its own professional advisors, including those specializing in legal, tax and accounting matters. Orchard does not provide legal, tax or accounting advice.

1 0

Accessing admin GUI
by Peter Smith 17 Sep '15

17 Sep '15

Hi, https://www.monetdb.org/XQuery/Tutorials/adminGUI It looks as if the admin GUI should automatically start up on 50001/TCP when I start MonetDB, but this doesn't seem to be the case: I have monetdb listening on 50000, but nothing listening on 50001. I'm running MonetDB 11.19 on Ubuntu. I'm using an init.d script to start MonetDB, and here's the running process: /usr/bin/mserver5 --dbpath=/home/administrator/monetdb/xxx/xxx --set merovingian_uri mapi:monetdb://127.0.0.1:50000/xxx --set mapi_open false --set mapi_port 0 --set mapi_usock /home/administrator/monetdb/xxx/xxx/.mapi.sock --set monet_vault_key /home/administrator/monetdb/xxx/xxx/.vaultkey --set gdk_nr_threads 16 --set max_clients 64 --set sql_optimizer default_pipe --set monet_daemon yes Do I need to pass extra start-up options to enable the GUI? (I don't see anything in the mserver5 man page) Thanks, Peter Smith

2 1

What is the difference ?
by Brian Hood 16 Sep '15

16 Sep '15

Hi All, So the new CREATE REPLICA TABLE definition / CREATE TABLE definition i'm not sure what the difference would be ? CREATE REPLICA TABLE test2 AS (SELECT * FROM test) WITH DATA; CREATE TABLE test2 AS (select * from test) WITH DATA; Regards, Brian Hood

2 1

Inserting in 'raw' mode??
by Vijay Krishna 15 Sep '15

15 Sep '15

Hi, I was analysing the Insert performance of MonetDB... I am trying to optimize a process where in a single tuple has to be inserted into a table of 1200 columns, which takes about 7.5 seconds presently... The query has values for only 5 columns out of 1200, yet the speed is still the same.. Is it possible to reduce this time even?? While digging on this, I came across this thread.. https://www.monetdb.org/pipermail/users-list/2005-August/000139.html *What is the insert speed relatively to other DBs? > * > Using SQL, with the current version we won't compete very well. We get > much more acceptable speeds in 'raw' mode, where lots of the parsing > overhead is removed. > > Can anyone please help me understand what is the 'raw' mode that is explained in this thread?? I am using Oct-2014 version on a CentOS machine with 128 GB RAM... Thanks & Regards, Vijayakrishna.P. Mobile : (+91) 9500402305.

3 2

DbVisualizer support for MonetDB
by Robert Koch 14 Sep '15

14 Sep '15

Hi Folks, DbVisualizer is my preferred GUI to MonetDB. DbVis offers capability to write own database profiles for specific DB's. Today I committed a MonetDB database profile for DbVisualizer. https://github.com/dbvisualizer/dbvis-database-profiles/tree/master/monetdb Anyone familiar to DbVis can import and/or improve this profile. There's a free DbVis version, but the Pro offers much more features, which make life easier. BTW, I'm not working for them. :-) Please feel free to write me your desired features by mail or directly into the MD-file inside the monetdb-directory. If possible, I will implement it inte the profile. Best regards Mario

1 0

`/usr/bin/mserver5': double free or corruption
by Brian Hood 10 Sep '15

10 Sep '15

Hi Guys, I created a brand new directory for my dbfarm yesterday and as you can see everything was fine for 24 hours then my merovingian.log shows an error. My Compile options are: ./configure --libdir=/usr/lib64 --prefix=/usr --sysconfdir=/etc --localstatedir=/var --disable-assert \ --disable-testing --enable-optimize --enable-rintegration --enable-jsonstore http://pastebin.com/qAebcMhp I'm currently only inserting to one table. DROP TABLE "threatmonitor".http_traffic_json; CREATE TABLE "threatmonitor".http_traffic_json ( id INT GENERATED ALWAYS AS IDENTITY ( START WITH 0 INCREMENT BY 1 NO MINVALUE NO MAXVALUE CACHE 2 CYCLE ) primary key, guid char(36), recv_date date, recv_time time, json_data JSON ); Typical insert INSERT INTO http_traffic_json (recv_time,recv_date,guid,json_data) VALUES (NOW(), NOW(), '1f248d6e-ed15-2a3e-a08f-96536ed925d0', '{"http":{"host":"ad.sxp .smartclip.net","connection":"keep-alive","cachecontrol":"max-age=0","accept":"image/webp,*/*;q=0.8","useragent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/4 2.0.2311.90 Safari/537.36","referer":" http://cdn.turn.com/server/ddc.htm?uid=8915259122209287941&rnd=246995741890…","acceptencoding":"gzip, defla te, sdch","acceptlanguage":"en-GB,en-US;q=0.8,en;q=0.6","cookie":"ommited"}}'); I will look more at this tomorrow and try and reproduce. Regards, Brian Hood

1 0

Issue upgrading from 11.17.9 to 11.21.5
by Brian Hood 09 Sep '15

09 Sep '15

Hi All, I am unsure what to do in this scenario. Can anyone help ? http://pastebin.com/LwLCLeAB 1. 2015-09-08 13:40:07 MSG threatmonitor[31747]: # Listening for UNIX domain connection requests on mapi:monetdb:///data2/threatmonitor/threatmonitor/.mapi.sock 2. 2015-09-08 13:40:07 MSG threatmonitor[31747]: # Start processing logs sql/sql_logs version 52200 3. 2015-09-08 13:40:07 ERR threatmonitor[31747]: !FATAL: Incompatible database version 052001, this server supports version 052200. 4. 2015-09-08 13:40:07 ERR threatmonitor[31747]: Maybe you need to upgrade to an intermediate release first. 5. 2015-09-08 13:40:07 ERR threatmonitor[31747]: 6. 2015-09-08 13:40:07 MSG merovingian[31739]: database 'threatmonitor' (31747) has exited with exit status 1 7. 2015-09-08 13:40:07 ERR control[31739]: (local): failed to fork mserver: database 'threatmonitor' appears to shut itself down after starting, check monetdbd's logfile for possible hints Regards, Brian Hood

2 5

Announcement: New Jul2015 Feature release of MonetDB suite
by Sjoerd Mullender 09 Sep '15

09 Sep '15

The MonetDB team at CWI/MonetDB BV is pleased to announce the Jul2015 feature release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Jul 2015 feature release MonetDB5 Server * Implemented batcalc.min and batcalc.max. Made calc.min and calc.max generic so that no other implementations are needed. * Removed function batcalc.ifthen. Build Environment * Upgraded the license to the Mozilla Public License Version 2.0. Client Package * Added a new output format to mclient: --format=expanded (or -fx). In this format, column values are shown in full and below each other. MonetDB Common * BUNtvar and BUNhvar macros no longer work for TYPE_void columns. * Changed interfaces of a lot of GDK-level functions. When they modify a BAT, don't return the same BAT or NULL, but instead return GDK_SUCCEED or GDK_FAIL. * Changed a bunch of hash-related functions to work on the tail column. The functions that have been changed to work on the tail column are: BAThash, BATprepareHash, HASHgonebad, HASHins, and HASHremove. Java Module * Improved JDBC driver to not throw NullPointerException anymore when calling isNullable() or getPrecision() or getScale() or getColumnDisplaySize() or getSchemaName() or getTableName() or getColumnClassName() on a ResultSetMetaData object. * We now compile the Java classes using the latest Java 1.8 version, and we tell it to compile for Java 1.7. SQL * Differences between time, timestamp, and date values now return properly typed interval types (second or month intervals) instead of integers. * Added support for 128-bit integers (called HUGEINT) on platforms that support this. * Removed support for the mseed library. * Removed support for RDF. * Removed DataCell. It was experimental code that was never enabled. Bug Fixes * 2618: Implement master slave scheme * 3361: constants as MAL function parameters prevent intermediate reuse * 3364: Cannot set role back to a user's default role * 3365: Unable to grant object privileges while having a non-default current_role * 3440: Sequence type errors * 3449: mserver crash on start - Freebsd 10 amd64 * 3476: Cannot revoke object access * 3496: autocompletion table names does not work correctly * 3556: when 2 multiplexed functions in MAL plan, only one is mapped correctly to bat<mod>.function primitive * 3564: Request: add support for postgresql specific scalar function: split_part(string text, delimiter text, field int) * 3625: SIGSEGV because mat array can overrun in opt_mergetable.c * 3627: SQRT in CASE does not work as of Oct2014 * 3654: configure --enable-fits requires extra commands after creating a database instance * 3673: mclient 'expanded' row formatter * 3674: Obfuscate event tracing * 3679: No error is given when incorrect timezone value is specified for a timetz column * 3686: Wrong associativity of multiply/divide * 3702: Filter function not found if created in a user schema * 3708: wrong scoping for cross-schema view references * 3716: alter table my_merge_table drop table t1; crashes mserver5 with Segmentation fault * 3724: Wrong size calculation in BATsubjoin * 3730: SAMPLE function not sampling randomly * 3732: memory leak (of InstrRecord) in opt_mergetable * 3733: "(TRUE OR <Exp>) AND <Exp>" is evaluated incorrectly * 3735: python connection with unix_socket * 3736: crash if mclient disconnects abruptly during a query * 3738: Database inconsistency when using savepoint * 3739: CASE statements do not handle NULLs in the IN () operator properly * 3740: select epoch(now()); types timestamptz(7,0) and bigint(64,0) are not equal * 3742: Division By Zero * 3744: cast to int gives different results for decimal than double * 3747: joins fail in the presence of nulls * 3748: Missing META-INF/services/java.sql.Driver in JDBC package * 3753: Hang on json field parsing * 3754: select from a REMOTE TABLE referring local table crashes mserver5 * 3756: column type conversion sticks to subsequent queries * 3758: "COPY INTO ..." doesn't work, if executing from 2 processes concurrently. * 3759: select data from "sys"."rejects" returns unexpected error and when next select data from "sys"."sessions" causes an assertion failure in mal_interpreter.c:646. * 3760: SQL parser has problem with (position of) a scalar subquery in a SELECT-list * 3761: SQL executor has problem with (position of) a subquery in a SELECT-list. Inconsistent behavior. * 3763: JDBC PreparedStatement for a table with 14 Foreign Keys crashing the Database * 3764: DROPping multiple users causes a crash * 3765: Re-granting a revoked privilege does not work * 3766: VIEW not visible if created under a different schema * 3767: CREATE TEMP TABLE using "LIKE" incorrectly handled * 3769: SIGSEGV when combining a cast/column alias with a UNION ALL view * 3770: combined conditions on declared table in User Defined Function definition crashes monetdb * 3771: Owner of the schema loses rights if assumes the monetdb role. * 3772: Any user can grant a role. * 3773: quantile(col, 0) and quantile(col, 1) fail * 3774: mclient is unaware of merge tables and remote tables * 3775: COPY INTO: Backslash preceding field separator kills import * 3778: Crash on remote table schema mismatch * 3779: server crashes on MAX() on SELECT DISTINCT something combo * 3783: Behavioural change in Jul2015 for 'timestamp minus timestamp' * 3784: Assertion failed: (bn->batCapacity >= cnt), function BAT_scanselect, file gdk_select.c, line 1008. * 3785: sum(interval) causes overflow in conversion to bte * 3786: ResultSet.close() never sends Xclose to free resources * 3787: "b and g must be aligned" from complex group/union query * 3791: HEAPextend: failed to extend to 2420077101056

3 3

Jul2015: access denied to sys.tables from custom user/schema
by Roberto Cornacchia 02 Sep '15

02 Sep '15

Hi there, Is it a Jul2015 feature that access to sys.tables is denied to custom a user/schema? However, sys._tables is accessible. That sounds strange. Roberto

3 4

I love Jul2015!
by Roberto Cornacchia 01 Sep '15

01 Sep '15

Not about issues this time. I just wanted to thank the team for this new upcoming release, I'm using it for a while already and it seems to be brilliant. I particularly like that hash tables are kept around, making a hot DB solve in *microseconds* joins that would take almost half a *second* otherwise. Ka-Boom!

3 2