users-list September 2008

users-list@monetdb.org

23 participants
22 discussions

[MonetDB-users] merovingian locking up - port issue?

by Ross Bates

I'm having an issue with merovingian locking up. This is the typical scenario. - Start mero and my db with ./merovingian sobi - Everything works great for anywhere between 50 & 100 queries, then mero stops responding (I'm using python, jdbc & php) - I can still connect to the db from the command line using ./mclient -d sobi -lsql -p 50001 - both merovingian and mserver5 processes continue to run, but mero will end up dying within 1-2 minutes by itself leaving the mserver5 process running - even when mero dies, it appears that all the ports are still in use. This is the result of netstat -a AFTER mero is dead: tcp 0 0 *:50000 *:* LISTEN tcp 0 0 *:50001 *:* LISTEN tcp 0 0 mayfair.local:50000 mayfair.local:48973 ESTABLISHED tcp 0 0 mayfair.local:48973 mayfair.local:50000 ESTABLISHED udp 0 0 *:50000 *:* - when I try to restart mero to reattach it to the database it fails with this error: ./merovingian: binding to stream socket port 50000 failed: Address already in use - stopping the db doesn't work becase mero isn't running. ./monetdb stop sobi warning: MonetDB Database Server is not running stop: cannot perform: MonetDB Database Server (merovingian) is not running - the only thing left to do is kill the mserver5 process and restart both mero and the db. Unfortunately the merovingian.log file doesn't tell me anything. Any other tips for helping troubleshoot this issue? The version is 5.7.0 and was built from the Aug 23rd nightly. Many Thanks, Ross

13 years, 9 months

Re: [MonetDB-users] best practices with connection pool

by gashi gashi

Hi,All I found this subject in the archives, and I am having the same problem. ---------------------------------------------------------------------- >> What is currently the best practice of connecting to MonetDB5/SQL? Is >> there much overhead in the connection phase (thus: cache the connection) >> or can a developer just reconnect each time the database connection is >> required without much overhead? >> >> The target platform is extremely demanding in requests and memory, so I >> would like to design it good from the start. >Then go for connection pooling. Logging in requires a handshake, which >is expensive on large scale. Beware that using >1 connection at the >same time to an SQL server is a challenge that is only minimally tested. >My practical experiences with that boils down to signal 11. ---------------------------------------------------------------------- Would you let me know more detail? Your meaning of "Beware that using >1 connection at the same time..." is which case? Case 1. : 2 or more process try to connect at the same. Case 2. : 1 process is connecting, and other process try to connect. I appreciate your kindly support. gashi

13 years, 10 months

[MonetDB-users] billions rows ?

by eric Gtep

Hello, I'm testing for store large collections of genotypes on Monetdb. In few words, a genotype is a little piece of information ( about 3 or 4 char ) related to an individual and a dna marker. So a genotypes looks like contents of cell of sheet. Sometime we need to access them by individuals (cross marker), sometime by dna marker (cross individual). Today genotyping technologies provide to get 600, 000,0000 genotypes by run. Is MonetDB able to manage efficiently tables with several billions of rows ? have you any example of application with lot ( > 1 billion) of rows in only one table ? I' ve compiled and installed monetDB/SQL on a Dell PE2950 with 2 quadcores intel xeon 2.66 Ghz and 4 GB RAM with success I 've created a very basic table to store genotype : Create table genotypes ( ind char(10), mark char(10), alleles(char3) ) after I've populated this table with the "copy into table" statement About 370 millions rows have been loaded after 7 minutes. I haven't defined any index. >From mclient I sent the query below : select * from genotypes where alleles ="A A"; Immediatly the server became frozen and after about ten minutes a w unix command showed : load average 16 !!!! I stopped the query Could you explain to me what has appended ? Is this behaviour normal ? Is it possible to restrict the cpu ressources allowed to monetDB ? Thank you in advance for your advices and your help Eric

13 years, 10 months

[MonetDB-users] How to declare a bug ?

by Pierre BOIZOT

Hi All, Somebody can explain me how i can submit a bug ? Regards. Pierre -- Pierre Boizot Chemin des Ecureuils, 8 CH-1009 PULLY Mobile : +41 795713660

13 years, 10 months

[MonetDB-users] Perl DBD

by Pierre BOIZOT

Hi all, I install on a ubuntu monetdb , i began to test sql , insert , update and select . very nice performance. But when i try to use Perl DBD to access at the database . nothing work :( the CPAN is not update. the perl DBD in the source have no test no example :( what programming interface work with monetdb ? perl ? perhaps i jump something. python ? Where can i find small examples? Thank you for your help Regards. Pierre - Pierre Boizot Rue des philosophes , 13 1400 Yverdon les bains Mobile : +41 795713660

13 years, 10 months

[MonetDB-users] Installation Problems

by Scott Stephens

I've been attempting to install MonetDB by compiling the Aug. 2008 superball. My system is 64-bit linux, specifically the Ubuntu Intrepid Ibex alpha . It appears that the installation is failing while compiling the JDBC driver, with the error message: BUILD FAILED java.lang.UnsupportedClassVersionError: Bad version number in .class file I'm using the Sun Java 1.5.0 JRE and JDK. You can look at my full installation log here: http://docs.google.com/Doc?id=dhqbmd8x_6fqdnn7c3 Can somebody help me out? I'm hoping I've just made an easily corrected newbie mistake, but I'm out of things to try. Thanks, Scott

13 years, 10 months

[MonetDB-users] basic math error?

by Kirk Abbott

Hello All, sql>select 585.0 / 635.0; +----------------------+ | sql_div_single_value | +======================+ | 0 | +----------------------+ and sql>select cast(585.0 / 635.0 as numeric(10,4)); +----------------------+ | sql_div_single_value | +======================+ | 0.0000 | +----------------------+ Is not what I was expecting. Ideas? Kirk.

13 years, 10 months

[MonetDB-users] Bug....

by Pierre BOIZOT

Hi all, a test with the gold data .... no errors on the load if i stop and restart the database errors is allways here. sql>select age,gender, count(*), avg(price) from car group by age, gender; +-----+-------+-------------+-----------------------+ | age |gender |count_gender |avg_price | +=====+=======+=============+=======================+ | 19 |f | 110025 | -1449.6788093615087 | | 41 |m | 97200 | -6411.6489300411522 | ........ 52 |f | 95940 | -6467.6865332499483 | +-----+-------+-------------+-----------------------+ Timer 2694.008 msec 92 rows sql>select count(*) from car where price = 0; +--------+ | count_ | +========+ | 0 | +--------+ Timer 2502.145 msec 1 rows sql>select count(*) from car where price < 0; +--------+ | count_ | +========+ | 0 | +--------+ Timer 148.724 msec 1 rows see the trace file . Regards Pierre -- Pierre Boizot Rue des philosophes , 13 1400 Yverdon les bains Mobile : +41 795713660

13 years, 10 months

[MonetDB-users] Several newbie questions: Performance and plans

by Mark V

Hi, I am more of an end user, new to column store DB's in general and MonetDB in particular. I'm thinking of using MonetDB in a context where CRUD would be done using SQL statements (as much as possible). I have some questions that I'd appreciate some feedback on: It seems that in column stores single insert/update/delete are much slower than reads. In LucidDB this can be in the order of seconds. Q1) In MonetDB are single insert/update/delete in the order of seconds? Comparable to LucidDB? Q2) If so, when might this change/improve and by how much? On comparative performance. I've seen the Goggle tech talk (2008/01) on MonetDB/X100 indicating some incredible performance: Q3) When might those improvements be incorporated into the stable/released MonetDB? Q4) How does MonetDB compare to Kdb and Vertica? Finally, I'm toying with writing a MonetSQL adapter for Ruby's Sequel ORM, hence the reliance on SQL statements. I have seen the MonetDB ActiveRecord library, which uses SWIG to make the Ruby MonetDB-mapi library. Q5) Will MonetDB be implementing something like MySQL's Information_Schema? Q6) What is the relative performance of the JDBC and SWIG-MAPI interfaces? Thanks Mark

13 years, 10 months

[MonetDB-users] Ubuntu packages and launchpad PPA for MonetDB

by Gijs Molenaar

Hello everyone, I'm working on precompiled Ubuntu packages for MonetDB, which can be found here: https://launchpad.net/~monetdb/+archive These packages are meant for Ubuntu users who don't want to compile monetdb on every Ubuntu system where they want to use this software. You can install the packages and automatically update to new released packages by adding the following to /etc/apt/sources.list: --- 8< cut here --- deb http://ppa.launchpad.net/monetdb/ubuntu hardy main deb-src http://ppa.launchpad.net/monetdb/ubuntu hardy main ------------------- These packages are quite 'fresh' and not fully tested and completed, but the basics should work fine. If you want to test them out or/and you have some comments, feel free to contact me. Note that these packages are not signed due to a limitation in launchpad. -- Gijs Molenaar http://gijs.pythonic.nl

13 years, 10 months

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

users-list September 2008