Hi Stefan,
Thanks for your reply!
We have run the query a few times with different size of data. There we
used 16G RAM(actually 13.5G was used), and find the size of 10G's data
is the critical point that can run the query. All of the data files'
size are listed below, each file name is a table name(there are only a
few tables are refered -- store_sales, date_dim, item, customer,
catalog_sales, web_sales):
7.4K call_center.dat
1.6M catalog_page.dat
212M catalog_returns.dat
2.9G catalog_sales.dat
27M customer_address.dat
64M customer.dat
77M customer_demographics.dat
9.9M date_dim.dat
77B dbgen_version.dat
149K household_demographics.dat
328B income_band.dat
2.6G inventory.dat
28M item.dat
61K promotion.dat
1.7K reason.dat
1.1K ship_mode.dat
27K store.dat
323M store_returns.dat
3.8G store_sales.dat
4.9M time_dim.dat
1.2K warehouse.dat
19K web_page.dat
98M web_returns.dat
1.5G web_sales.dat
12K web_site.dat
So we guess that the monetdb has no memory management?
For the output of `mserver5 --version` is:
MonetDB 5 server v11.27.13 "Jul2017-SP4" (64-bit, 128-bit integers)
Copyright (c) 1993 - July 2008 CWI
Copyright (c) August 2008 - 2018 MonetDB B.V., all rights reserved
Visit https://www.monetdb.org/ for further information
Found 17.0GiB available memory, 40 available cpu cores
Libraries:
libpcre: 8.38 2015-11-23 (compiled with 8.38)
openssl: OpenSSL 1.0.2g 1 Mar 2016 (compiled with OpenSSL 1.0.2g 1
Mar 2016)
libxml2: 2.9.3 (compiled with 2.9.3)
Compiled by: monetdb(a)MonetDB-0.0 (x86_64-pc-linux-gnu)
Compilation: gcc -g -O2
Linking : /usr/bin/ld -m elf_x86_64
And the size of processes is not limited.
To let you reproduce the problem conveniently, I'll provide more details
here:
you can get tpc-ds from its website(we use version 2.6.0).
Install the tpc-ds, access the directory v2.6.0/tools and run `./dsdgen
-scale 10 -dir /home/monetdb/tpc-ds_test_data10G` to generate the data.
When data has been generated, using the script /expe.sh/ to create
tables and load the data. The query script is 123.tpcds.23.sql.(The
syntaxs of other queries that tpc-ds generates is not suitable for
monetdb all, we don't modify them all when the problem occurred).
One more question, I can't get your reply email, so I don't know how to
reply you, for this case, I could only send a new mail echo time.
Thanks!
Regards,
Rancho
Does anybody has installed the monetdb datasource plugin for Grafana?
Im running Grafana v5.3.4.
The plugin was downloaded from
https://github.com/MonetDBSolutions/grafana-monetdb-datasource
And is not working... :'(
Does anybody knows how to connect MonetDB within Grafana?
Any ideas will be very much appreciated!!!
Thks
Ariel
Hi,
Internally (as in in the MonetDB code base),the impact of the problem could imho be significantly reduced (though not fully avoided)by "simply" using different separator characters (or even strings?) when creating qnames,e.g. schema:table;column insteadof schema_table_column ...
A unique bijective reversible mapping from schema,table,column to qname should avoid the problem entirely , but might require to use separator chracter(s) that are not valid in SQL identifiers, if such exist ...
Best,Stefan
-------- Original message --------From: Ying Zhang <Y.Zhang(a)cwi.nl> Date: 28/11/2018 07:33 (GMT+01:00) To: Communication channel for MonetDB users <users-list(a)monetdb.org> Subject: Re: Issues trying to create a table...
> On 28 Nov 2018, at 04:18, Herman Knief <hknief(a)gmail.com> wrote:
>
> Hi Folks,
> I'm new to MonetDB and trying to setup a schema from a MariaDB export.
> I have a particular table that reports a conflict with the create statement. I've stripped this down to just a particular field that seems to be causing the issue, but unsure where to go from here.
>
> sql>CREATE TABLE "sc_cat_item_delivery_plan" ("script" string);
> CREATE TABLE: zboot_sc_cat_item_delivery_plan_script conflicts
Hai Herman,
This is because something has already been defined before, whose complete qname is “zboot_sc_cat_item_delivery_plan_script”. This often happens with (but probably not limited to) schema_name+table_name+column_name. In MonetDB test suite, we have two examples to trigger this (type of) error:
sql>create table foo (id integer, bar_id integer);
operation successful
sql>create table foo_bar (id integer);
CREATE TABLE: sys_foo_bar_id conflicts
and
sql>create table foo_bar (baz int);
operation successful
sql>create table foo (bar_baz int);
CREATE TABLE: sys_foo_bar_baz conflicts
This is not a bug. You need to change your table and/or column definitions, like your alternatives below. Then CREATE TABLE will succeed.
Regards,
Jennie
>
> What's interesting is that either changing the name of the table or the name of the field and these statements work. There is something about this particular combo that is problematic.
> sql>CREATE TABLE "sc_cat_item_delivery_plan1" ("script" string);
> operation successful
> sql>CREATE TABLE "sc_cat_item_delivery_plan" ("script1" string);
> operation successful
>
> I have a total of 2251 tables... all were created except for this one. I've tried to destroy and recreate the schema with no luck. Logs don't seem to indicate any issue and trying to use the debug on the client didn't get me anywhere. Thoughts? Suggestions?
>
> --
> Please excuse typos... I can't type.
> _______________________________________________
> users-list mailing list
> users-list(a)monetdb.org
> https://www.monetdb.org/mailman/listinfo/users-list
_______________________________________________
users-list mailing list
users-list(a)monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list
Hi Folks,
I'm new to MonetDB and trying to setup a schema from a MariaDB export.
I have a particular table that reports a conflict with the create
statement. I've stripped this down to just a particular field that seems
to be causing the issue, but unsure where to go from here.
sql>CREATE TABLE "sc_cat_item_delivery_plan" ("script" string);
CREATE TABLE: zboot_sc_cat_item_delivery_plan_script conflicts
What's interesting is that either changing the name of the table or the
name of the field and these statements work. There is something about this
particular combo that is problematic.
sql>CREATE TABLE "sc_cat_item_delivery_plan1" ("script" string);
operation successful
sql>CREATE TABLE "sc_cat_item_delivery_plan" ("script1" string);
operation successful
I have a total of 2251 tables... all were created except for this one.
I've tried to destroy and recreate the schema with no luck. Logs don't
seem to indicate any issue and trying to use the debug on the client didn't
get me anywhere. Thoughts? Suggestions?
--
Please excuse typos... I can't type.
Hi,
We have a Perl code via which we are trying to connect to one of the MonetDB instance. Here we are using DBD::monetdb Perl cpan driver for connectivity.
when we run the snippet, it just tries to connect to DB and seems hung, looks like it's awaiting for user input for password. Also, on the server side logs we see an error (challenge error) can connection will not be established.
Here is a sample snippet which isn't working. Could anyone help with an idea or code snippet which works with Perl DBI for MonetDB connectivity?
[cid:image001.png@01D47D35.C23AD040]
#!/usr/bin/perl
#
use strict;
use warnings;
use DBI();
print "Attempting to connect...\n";
my $dbh = DBI->connect('dbi:monetdb:host=XXXX;port=55555', 'USERNAME', 'Password', { RaiseError => 1 } );
print "Connected. Trying SQL...\n";
my $sth = $dbh->prepare('SELECT * FROM env');
$sth->execute;
$sth->dump_results;
print "Done\n";
exit 0;
Regards,
Sreejith
Hello all:
I have run across a show-stopping error, "cannot bind delete column" which renders Monet unusable until I restart the service.
A batch import of events runs every 10 minutes and has been unable to complete for the last 28 hours because the service is not accepting commands.
I'm not sure where to look for the source of this error. Restarting the service correct the issue, but this is a problem as the Monet instance drives live Tableau dashboards using this imported data.
Where do I need to start looking to track down the source of this error?
I am currently running 11.29.3 on CentOS 7.
Adam
All,
Is it possible to add a column to an existing table via binary bulk loading? We have a table with ~1 billion rows and we would like to add columns to the table, but would prefer bulk loads for speed. Also, does anyone have a snippet of code to create the binary file format that bulk loading expects. I've tried a couple versions (simple int and double), but the server wouldn't recognize the files.
Thanks,
Dave
Hello,
We are unable to get the information for all active users sessions when we use sys.queue as monetdb user.
Also, the tried as user other than monetdb, it returned no access, We had provided the user select privilege on the sys.queue view.
[monetadmin@lnx1487 scripts]$ /monet_binaries/MonetDB-11.27.13_PY/bin/mclient mapi:monetdb://lnx1487:50053/DB_BWS_S
Welcome to mclient, the MonetDB/SQL interactive terminal (Jul2017-SP4)
Database: MonetDB v11.27.13 (Jul2017-SP4), 'mapi:monetdb://lnx1487:50053/DB_BWS_S'
Type \q to quit, \? for a list of available commands
auto commit mode: on
sql>select "user","active",count(*) as "No. Of Connections" from sys.sessions() group by "user","active";
+-------------------+--------+--------------------+
| user | active | No. Of Connections |
+===================+========+====================+
| DM_POS_BWS_STG_P6 | true | 1 |
| DM_POS_BWS_STG_P6 | false | 3 |
| monetdb | true | 1 |
+-------------------+--------+--------------------+
3 tuples (6.027ms)
sql>select * from sys.queue;
+------+---------+----------------------------+----------------------------+----------+---------+--------+--------------------------+
| qtag | user | started | estimate | progress | status | tag | query |
+======+=========+============================+============================+==========+=========+========+==========================+
| 3630 | monetdb | 2018-11-07 17:07:34.000000 | null | null | running | 3630@0 | select * from sys.queue; |
+------+---------+----------------------------+----------------------------+----------+---------+--------+--------------------------+
1 tuple (1.610ms)
sql>\q
[monetadmin@lnx1487 scripts]$
Thank You,
Gautham
Hi all,
I am trying to use the following patten from MAL[1]
pattern eval(fptr:ptr,cpp:bit,expr:str,arg:any...):any...
However, I am not sure how I should create the first parameter <fptr:ptr>
from MAL. I am just trying to be able to call a C-UDF from MAL. From
capi.c, it would seem that it is the client's context but I don't know how
to get a handle of that.
Any pointers are highly appreciated.
Thanks!
Renato M.
[1]
https://github.com/MonetDB/MonetDB/blob/2310e49a349ebcb8ff5b5c585928c8f4bd1…
