June 2012 - users-list

[MonetDB-users] python-monetdb and pip
by Molenaar, Gijs 14 Jun '12

14 Jun '12

Hi Monetdb people, python-monetdb is now also in the pypi repo, which means you can easily install it with pip: $ pip install python-monetdb more info: http://pypi.python.org/pypi/python-monetdb/11.9.5 -- Gijs Molenaar http://www.astro.uva.nl/people/gijs-molenaar/

1 0

[MonetDB-users] python-monetdb and pip
by Molenaar, Gijs 13 Jun '12

13 Jun '12

Hi Monetdb people, python-monetdb is now also in the pypi repo, which means you can easily install it with pip: $ pip install python-monetdb -- Gijs Molenaar http://www.astro.uva.nl/people/gijs-molenaar/

1 1

Re: [MonetDB-users] hold cursors over commit in JDBC
by Majid Azimi 12 Jun '12

12 Jun '12

Let me ask it this way: How can we configure driver so it doesn't fetch all records at one time. for example 100 records per each fetch, So the application server doesn't get OutOfMemoryException. Thank you. >> hi guys, >> >> I have a very large table, which I should scan it and generate reports. My code is like this: >> >> Class.forName("nl.cwi.monetdb.jdbc.MonetDriver"); >> Connection conn = DriverManager.getConnection("jdbc:monetdb://localhost/online", "monetdb", "monetdb"); >> >> conn.setAutoCommit(false); >> conn.setHoldability(ResultSet.HOLD_CURSORS_OVER_COMMIT); >> >> Statement stmt = conn.createStatement(ResultSet.TYPE_FORWARD_ONLY, ResultSet.CONCUR_READ_ONLY); >> stmt.setFetchSize(10); >> >> ResultSet rs = stmt.executeQuery("SELECT * FROM denorm"); >> >> while (rs.next()) { >> /* process line */ >> } >> >> conn.commit(); >> >> I do not use much ram inside while loop. I get OutOfMemeryException from JVM. >> So I think the driver ignores HOLD_CURSORS_OVER_COMMIT and fetches all records. Is there any solution? > HOLD_CURSORS_OVER_COMMIT means it keeps the cursor open, right? So what > else can the driver do but keep them open (including the memory > associated to that)? What would you have expected to happen with this > setting?

2 1

[MonetDB-users] hold cursors over commit in JDBC
by Majid Azimi 12 Jun '12

12 Jun '12

hi guys, I have a very large table, which I should scan it and generate reports. My code is like this: Class.forName("nl.cwi.monetdb.jdbc.MonetDriver"); Connection conn = DriverManager.getConnection("jdbc:monetdb://localhost/online", "monetdb", "monetdb"); conn.setAutoCommit(false); conn.setHoldability(ResultSet.HOLD_CURSORS_OVER_COMMIT); Statement stmt = conn.createStatement(ResultSet.TYPE_FORWARD_ONLY, ResultSet.CONCUR_READ_ONLY); stmt.setFetchSize(10); ResultSet rs = stmt.executeQuery("SELECT * FROM denorm"); while (rs.next()) { /* process line */ } conn.commit(); I do not use much ram inside while loop. I get OutOfMemeryException from JVM. So I think the driver ignores HOLD_CURSORS_OVER_COMMIT and fetches all records. Is there any solution?

2 1

[MonetDB-users] Setting up replication
by Majid Azimi 12 Jun '12

12 Jun '12

Hi guys, I', trying to configure replication on single node(different ports). What I did is: 1. I have created 2 dbfarms 2. set port=50000 for master node and set port=50001 for slave node 3. set control=yes for both 4. set passphrase=master for master node and set passphrase=slave for second node My master node has already data in it, I just changed the configuration. then: moentdb -p 50000 set master=yes maindb --> for master node monetdb -p 50001 set slave=mapi:monetdb://127.0.0.1:50000/maindb slavedb --> on slave node(slavedb is empty database) Now there is no data in slave node. Can anyone help?

2 1

[MonetDB-users] Server socket stays 'open' after crash
by Stefan de Konink 11 Jun '12

11 Jun '12

Instead of using monetdbd I am using a very simple while [ 1 ]; do monetdb; sleep 2; done command to restart the database after an assertion failed or segmentation fault. For some reason even after a crash MonetDB complains at the start of the application that the port is already in use. Would could -unix wise- be the reason for this, that even after a crash and the program has been terminated resources are still claimed for the terminated program? Stefan

2 3

[MonetDB-users] MonetDB Clustering
by Majid Azimi 11 Jun '12

11 Jun '12

Hi guys, What types of clustering does monetdb support? Sharding? Master/Slave? if it is Master/Slave does it support multi master? or all writes must go to master node? In clustering documentation (http://www.monetdb.org/Documentation/Cookbooks/Recipes/Cluster) there is paragraph: willem% monetdb -h cruquius -P mypassphraseset shared=pump/2/harvey pump willem% monetdb -h lijnden -P mypassphraseset shared=pump/2/fox pump willem% monetdb -h leeghwater -P mypassphraseset shared=pump/1/harvey pump What are those 1, 2, fox, harvey?

2 1

[MonetDB-users] monetdb clustering
by Majid Azimi 10 Jun '12

10 Jun '12

Hi guys, What types of clustering does monetdb support? Sharding? Master/Slave? if it is Master/Slave does it support multi master? or all writes must go to master node? In clustering documentation (http://www.monetdb.org/Documentation/Cookbooks/Recipes/Cluster) there is paragraph: willem% monetdb -h cruquius -P mypassphraseset shared=pump/2/harvey pump willem% monetdb -h lijnden -P mypassphraseset shared=pump/2/fox pump willem% monetdb -h leeghwater -P mypassphraseset shared=pump/1/harvey pump What are those 1, 2, fox, harvey?

1 0

[MonetDB-users] Install MonetDB in CentOS 5
by Hancel Gonzalez 08 Jun '12

08 Jun '12

Hi people, i'm new here and i hope your help. I wanna install MonetDB in a computer with CentOS 5: download rpm packages from http://code.google.com/p/monetdb-rhel-5/downloads/list but i not work. Then, i tried compile the sourcecode http://dev.monetdb.org/downloads/sources/Latest/MonetDB-11.9.5.zip, command ./configure work but when i 'make' i have error of compilation. I dont know what to do! Please help me! Greetings, Hancel Gonzalez.

2 1

[MonetDB-users] Djonet
by Gijs Molenaar 08 Jun '12

08 Jun '12

Hi, I've updated the MonetDB Django backend created by Mark Bucciarelli and renamed it to Djonet. https://github.com/gijzelaerr/djonet basic stuff is working, but many Django tests are still failing, which i'm working on. Still it is already quite usable. If people want to help make it better, let me know. -- Gijs Molenaar http://www.astro.uva.nl/people/gijs-molenaar/

5 5