Hi,
does anyone know whether there is any doc on how the server is implemented
in Pthreads, such as how many threads are forked and what job each different
thread is responsible for?
Thanks a lot.
--
View this message in context: http://www.nabble.com/MonetDB-server-thread-architecture-tp20134440p2013444…
Sent from the monetdb-users mailing list archive at Nabble.com.
Dear all,
I'm using MonetDB/XQuery. After i have added a few XML-files into
MonetDB, i want to check out how their BATs looks like.
/MonetDB>ls();
#---------------------------------------------------------------------------------------------------------------------------------#
# name htype ttype count heat
dirty status kind refcnt lrefcnt #
# str str str lng int
str str str int int #
#---------------------------------------------------------------------------------------------------------------------------------#
[ "1000000001_attr_own", "void", "oid", 5,
0, "clean", "disk", "pers", 0, 2 ]
[ "1000000001_attr_prop", "void", "oid", 5,
0, "clean", "disk", "pers", 0, 2 ]
[ "1000000001_attr_qn", "void", "oid", 5,
0, "clean", "disk", "pers", 0, 2 ]
[ "1000000001_frag_root", "oid", "oid", 1,
0, "clean", "disk", "pers", 0, 1 ]
[ "1000000001_map_pid", "void", "oid", 1,
0, "clean", "disk", "pers", 0, 2 ]
[ "1000000001_nid_rid", "void", "oid", 25,
0, "clean", "disk", "pers", 0, 2 ]
[ "1000000001_prop_com", "void", "str", 0,
0, "clean", "disk", "pers", 0, 2 ]
[ "1000000001_prop_ins", "void", "str", 0,
0, "clean", "disk", "pers", 0, 2 ]/
*I get a list of BAT-data summary. But i cann't figure out how to use
print functions from buildin module as listed:*
/ / 231 .COMMAND print(ANY value) = CMDprint_val;
232 "Print a MIL value between square brackets."
233
234 .COMMAND print(BAT[ANY::1,ANY], ...BAT[ANY::1,ANY]...) = CMDprint_table;
235 "BATs are printed with '#' for legend lines, and the BUNs on seperate
236 lines between brackets, containing each to comma separated values
237 (head and tail).
238 If multiple BATs are passed for printing, print() performs an implicit
239 natural join, producing a multiattribute table."
240
241 .COMMAND print(INT order, BAT[ANY::1,ANY], ...BAT[ANY::1,ANY]...)
242 = CMDprint_otable;
243 "The same as normal table print, but enforces to use the order of
244 BAT number [1..argc] to do the printing."
245
246 .COMMAND table(BAT[any::1,any], ...BAT[any::1,any]...) = print_table_default;
247 "Print an n-ary table. Like print(n-ary) but does not print oid column"
248
249 .COMMAND table(INT order, BAT[any::1,any], ...BAT[any::1,any]...) = print_table;
250 "Print an n-ary table. Use the ordering of param [1..argc]"
251
252 .COMMAND multitable(BAT[any,bat]) = CMDprint_multitable;
253 "Print an n-ary table contained within a BAT of BATs"
254
255 .COMMAND printf(str format, ...) = print_format;
256 "Print a formatted string on the standard client output."
257
258 .COMMAND sprintf(str format, ...) : str = print_str;
259 "Print a formatted string on the standard client output."
260
261
262 .END builtin;
One single example may help me out of this trap.
Best regards,
Chaojing
------------------------------------------------------------------------------------------------------------------------------------------
Email: chaojing.yang(a)gmail.com
Blog: http://goethe-ist-taoist.blogspot.com/
§1
Ich widerspreche der Nutzung oder Übermittlung meiner Daten für
Werbezwecke oder sowie andere unbefugte Verwendungszwecke.
(§ 28 Abs. 4 BDSG=Bundesdatenschutzgesetz).
§2
Durch die Datenübertragung bzw. Kommunikation per E-Mail liegt
ein Verstoß gegen das BDSG vor, da ihre Daten insoweit nicht
ausreichend geschützt sind. Ich bitte Sie daher, mir schriftlich zu
bestätigen, dass Sie mit dem Verstoß gegen das BDSG
einverstanden sind und keine Schadensersatzanspräche bzw.
Unterlassungsanspräche mir gegenüber geltend machen.
§3
Der Inhalt dieser Nachricht ist vertraulich und nur für den oben
angegebenen Empfänger bestimmt.
Hi all,
I am trying to use MonetDB on a 32bit Windows XP SP2, but am having a lot of
trouble given the size of my tables. Is there any experience in regards to
using MOnetDB on a "virtual" server set up on Windows 2003 Server and
configuring it with "X64" inlieu of a true "64bit".
Thanks you in advance for your support.
Daniel Murray G.
Hi All,
I am working with Windows XP SP2 (32-bit), with 2Gb RAM; am using Java 1.5.
I downloaded MonetDB5-SQL-Installer-i386-20080624.msi;
Squirell has been update to use monetdb-1.8-jdbc.jar.
I am trying to upload data from MySQL to MonetDB5, using the MonetDB Bulk
Loader that comes with Pentaho Kettle 3.1.
I am using a MySQL table with a little over 9 millon rows & 7 columns (2
BIGINT, 2 INT and 3 FLOAT, consequently I understand no encoding issues are
involved).
After a number of failed transformation attempts to load my data to MonetDB,
on all attempts the Monetdb Server is suddenly shutting down after some
20,000 records are processed.
When trying to review the data -that I understand to be in MonetDB- using
Squirell, the following server console screen out is shown (I had to modify
the .config file to "gdk_debug=1") and as likewise, the MonetDB Server shuts
down:
***console output start***
C:\MONETDB\CWI\MonetDB5>MSQLServer.bat
# MonetDB server v5.6.0, based on kernel v1.24.0
# Serving database 'demo'
# Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked
# Copyright (c) 1993-2008 CWI, all rights reserved
# Visit http://monetdb.cwi.nl/ for further information
#warning: please don't forget to set your vault key!
#(see C:\MONETDB\CWI\MonetDB5\etc\monetdb5.conf)
# Listening for connection requests on mapi:monetdb://127.0.0.1:50000/
# MonetDB/SQL module v2.24.0 loaded
>!01 ERROR: MT_mmap: MapViewOfFileEx(150c, 1, 0, 0, 196885248, 0) failed
!01 OS: Espacio de almacenamiento insuficiente para procesar este comando.
#01 #GDKmmap(196885248) fail => BBPtrim(enter)
usage[mem=4583848,vm=1158283264]
#01
#mallinfo.arena = 5927701
#01 #mallinfo.ordblks = 61996
#01 #mallinfo.smblks = 383
#01 #mallinfo.hblkhd = 0
#01 #mallinfo.hblks = 0
#01 #mallinfo.usmblks = 1768421
#01 #mallinfo.fsmblks = 345928
#01 #mallinfo.uordblks = 3811784
#01 #mallinfo.fordblks = 1568
#01 #BBPTRIM_ENTER: memsize=4583848,vmsize=1158283264
#01 #BBPTRIM: memtarget=0 vmtarget=1073741824
#01 #TRIMSCAN: mem=0 vm=1, start=1, limit=1
#01 #TRIMSCAN: 92596* 0=tmp_2143 (#20500000)
#01 #TRIMSCAN: 92598* 1=tmp_2144 (#20510000)
#01 #TRIMSCAN: 92599* 2=tmp_2145 (#20510000)
#01 #TRIMSCAN: 92600* 3=tmp_2146 (#20510000)
#01 #TRIMSCAN: 92601* 4=tmp_2147 (#20510000)
#01 #TRIMSCAN: 92602* 5=tmp_2151 (#20500000)
#01 #TRIMSCAN: end at 1 (size=1197)
#01 #TRIMSELECT: dirty = 0
#01 #TRIMSELECT: candidate=tmp_2143 BAT*=454e700
#01 # (cnt=20500000, mode=4096, refs=0, wait=0, parent=0,0,
lastused=
92598,92596,-2147391052)
#01 #TRIMSELECT: delete tmp_2143 from trimlist (has been touched since last
scan
)
#01 #TRIMSELECT: candidate=tmp_2144 BAT*=454e7f8
#01 # (cnt=20510000, mode=4096, refs=0, wait=0, parent=0,0,
lastused=
92599,92598,-2147391050)
#01 #TRIMSELECT: delete tmp_2144 from trimlist (has been touched since last
scan
)
#01 #TRIMSELECT: candidate=tmp_2145 BAT*=454e8f0
#01 # (cnt=20510000, mode=4096, refs=0, wait=0, parent=0,0,
lastused=
92600,92599,-2147391049)
#01 #TRIMSELECT: delete tmp_2145 from trimlist (has been touched since last
scan
)
#01 #TRIMSELECT: candidate=tmp_2146 BAT*=454e9e8
#01 # (cnt=20510000, mode=4096, refs=0, wait=0, parent=0,0,
lastused=
92601,92600,-2147391048)
#01 #TRIMSELECT: delete tmp_2146 from trimlist (has been touched since last
scan
)
#01 #TRIMSELECT: candidate=tmp_2147 BAT*=454eae0
#01 # (cnt=20510000, mode=4096, refs=0, wait=0, parent=0,0,
lastused=
92602,92601,-2147391047)
#01 #TRIMSELECT: delete tmp_2147 from trimlist (has been touched since last
scan
)
#01 #TRIMSELECT: candidate=tmp_2151 BAT*=454ecd0
#01 # (cnt=20500000, mode=4096, refs=0, wait=0, parent=0,0,
lastused=
92596,92602,-2147391046)
#01 #TRIMSELECT: keep tmp_2151 [82035748,82035520] bytes [82035748,82035520]
dir
ty target(mem=0 vm=1073741824)
#01 #TRIMSELECT: end
#01 #TRIMSELECT: dirty = 1
#01 #TRIMSELECT: candidate=tmp_2151 BAT*=454ecd0
#01 # (cnt=20500000, mode=4096, refs=0, wait=0, parent=0,0,
lastused=
92596,92602,-2147391046)
#01 #TRIMSELECT: unload tmp_2151 [82035748,82035520] bytes
[82035748,82035520] d
irty
#01 #TRIMSELECT: end
#01 #BBPTRIM: lastused batid name
#01 #BBPTRIM: -2147391046 1129 tmp_2151
#01 #BBPTRIM_EXIT: memsize=114688,vmsize=1076232192
#01 #GDKmmap(196885248) fail => BBPtrim(ready)
usage[mem=4583792,vm=1076232192]
#01
#mallinfo.arena = 5927717
#01 #mallinfo.ordblks = 61993
#01 #mallinfo.smblks = 384
#01 #mallinfo.hblkhd = 0
#01 #mallinfo.hblks = 0
#01 #mallinfo.usmblks = 1768421
#01 #mallinfo.fsmblks = 346232
#01 #mallinfo.uordblks = 3811728
#01 #mallinfo.fordblks = 1336
!01 ERROR: MT_mmap: MapViewOfFileEx(1510, 1, 0, 0, 196885248, 0) failed
!01 OS: Espacio de almacenamiento insuficiente para procesar este comando.
!01 ERROR: GDKload: cannot mmap(): name=21\2150, ext=tail
!01 OS: Espacio de almacenamiento insuficiente para procesar este comando.
!01 ERROR: GDKload failed: name=21\2150, ext=tail
***console output ends***
Furthermore, I have tried to find the folders holding \var\MonetDB5\dbfarm
with no luck. Ie, they are not in the MonetDB folders that are installed
when using the Windows Installer referenced above.
I would very much appreciate any asisstance you can provide, as my interest
is to actively use MonetDb in my DW / BI projects.
Kind Regards,
Daniel Murray
Hi All -
I am trying to evaluate MonetDB on Windows by loading up some large
data sets. I'm not having much luck and I'm hoping someone can help
me out.
The first set of problems revolve around the ODBC driver. It seems
to not be able to report errors or even return the results of queries
reliably. Most errors come back as a generic error message although
we occasionally run into strange messages involving UTF-16
conversions when no string columns are involved (e.g. a count
distinct of a numeric column). We are using the July 2008 version
from the web site. Are these known issues and is there a more recent
build we could try? This is not in production yet, we are simply
trying to evaluate the system.
I have managed to work around the ODBC problems very slowly and have
got to a point where I can load small data sets. But when I then try
to do a large insert using the COPY FROM syntax, my client got a
"connection terminated" error. When I take the COPY FROM statement
and paste it into the client, the MonetDB server crashes. The only
log files I can find have a few (mostly unprintable) characters in
them. Restarting the server and trying again produces the same
problem. The insert query is
COPY 6568253 RECORDS
INTO "Airlines"."_2005_On_Time_Performance"
FROM 'C:\\DOCUME~1\\hawkfish\\LOCALS~1\\Temp\\1\\7A.tmp\\table.tbl'
USING DELIMITERS '\t', '\n', '\'';
Is there some limit on the COPY INTO syntax? Is there some log file
somewhere that could point me in the right direction?
TIA,
________________________________________________________
Richard Wesley Senior Software Developer Tableau
Software
Visit: http://www.trytableau.com/now.html
Hi Guys,
As of 3.1 Kettle now has a connector built in for Monet so I thought I'd
give it another go after not getting too far earlier in the year. Anyway
I have it up and running on a Quad Core Xeon box running Centos x86_64
and it seems pretty happy, but when I try to copy sizable amounts of
data into it, kettle stops with an error:
2008/10/17 12:29:22 - Table output.0 - Prepared statement : INSERT INTO
voc.d_budgets3 (entity_anl_code, trad_code, Cost, Sales, CostMTD,
SalesMTD) VALUES ( ?, ?, ?, ?, ?, ?)
2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826
from 2008/09/30 11:32:36) : Because of an error, this step can't
continue:
2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826
from 2008/09/30 11:32:36) :
org.pentaho.di.core.exception.KettleException:
2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826
from 2008/09/30 11:32:36) : Error inserting row into table [d_budgets3]
with values: [19], [A09], [0], [0], [0], [0]
2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826
from 2008/09/30 11:32:36) :
2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826
from 2008/09/30 11:32:36) : Error inserting/updating row
2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826
from 2008/09/30 11:32:36) : current transaction is aborted (please
ROLLBACK)
But to my untrained eye the data looks fine(coming from a mysql
database) and I don't know where to start debugging this or what
settings I could change. The monet table is 2 Strings, 2 Int, 2 Big Num
and it always inputs a load of data before stopping.
What can I look at to resolve the issues? otherwise, rocking database
and keep up the good work.
Thanks
Tom
CONFIDENTIALITY NOTICE
This e-mail is confidential and may also be privileged. Please notify us immediately if you are not the intended recipient. You should not copy it, forward it or use it for any purpose or disclose the contents to any person. If you have received this e-mail in error, please notify us as soon as possible and destroy your copy.
Unless otherwise expressly stated, this e-mail is not intended to constitute a business letter, order form or other offer or invitation to you, nor does this e-mail form the basis of any contract. Contracts may not be concluded by e-mail and any contract or agreement attached is subject to contract and shall not and is not intended to create a legally binding relationship.
This e-mail is sent by or on behalf of Encon Limited or the relevant subsidiary undertaking of Encon Limited with which you are dealing. Encon Limited is registered in England and Wales with company number 3411533 registered office at The Wolseley Center, Harrison Way, Leamington Spa, CV31 3HH, United Kingdom. VAT No 362 0233 93.
Encon Ireland is registered in Ireland with company number 262605 registered office at Wolseley Ireland Moydrum Road, Athlone, Co Westmeath.
Save a Tree ! - Please think before you print.
Hi!
Are there companies that are providing commercial support for MonetDB?
The home page for MonetDB seems to imply that. If so, can somebody send
me a pointer and does anybody have any experience with it?
Thanks!
Rick
Rick Spickelmier | CTO | Success Metrics, Inc. | w (415) 738-2078 |
ricks(a)successmetricsinc.com <mailto:ricks@successmetricsinc.com> |
www.successmetricsinc.com | www.birst.com
Hi Sjored -
I have a lot of questions, so I thought I start a few threads if that
is all right.
What is the CREATE INDEX syntax? According to the manual it is
CREATE [UNIQUE] INDEX <index_name> ON <table_name>
( <column_name>, ...) ;
But whey I use this syntax, I get strange errors:
sql>CREATE INDEX "_tidx_usernames_2a" ON
"Performance"."usernames" ("username");
!CREATE INDEX: no such table 'usernames'
sql>select count(*) from "Performance"."usernames";
+--------+
| count_ |
+========+
| 5 |
+--------+
sql>
________________________________________________________
Richard Wesley Senior Software Developer Tableau
Software
Visit: http://www.trytableau.com/now.html
Hi,
I haven't looked at monetdb for a while, but now for a new project I
have I think it would be a really good solution. I downloaded the
current windows installers yesterday (I want to develop this project
on Windows for various reasons, specifically related to demos of
another component part of the project I need to get up and running
quickly that will need to run on Windows)
anyway the installers did not install. I don't necessarily want to
compile the source etc. since I didn't want to spend a lot of time on
getting the database to work in the demo phase, so the question is:
what is the last working Windows MSI version so I can download that
version and worry about building a new one later?
The main problem in the installed servers are a hard coded path to a
config file, according to the following error message I get:
Could not open file c:\Documents and Settings\sjoerd\My
Documents\src\stable\vs32\NT32\etc\monetdb5.conf
I guess I could create that path for the purposes of testing but I
would rather get a working version.
Thanks,
Bryan Rasmussen
