[MonetDB-users] Using JDBC for MonetDB across the network
I successfully installed Monet on Mac OS X (Tiger) and it works as expected.
I can use JDBC from Aqua Data Studio or even Netbeans 6.0 beta 2 to access databases I create but my experiments so far are when these clients and the Monet DB are on the same Mac OS X host.
Now I want to install Monet on a linux box on my network and access the DB via JDBC from my Mac.
I installed Monet on the linux box (Cent OS).
But access via JDBC from the Mac does not seem to be working. I seem to connect from the Mac via Aqua Data Studio, but I do not see the demo database. Instead I see a <DEFAULT> database listed with no schemas. I created a new user and and a schema for that user on Linux using the command line client and that seemed to work.
But after disconnecting and re-connecting, I still don't see the database.
Could I be doing something wrong?
Jim
On Mon, Nov 12, 2007 at 11:04:22AM -0800, jsolderitsch wrote:
I successfully installed Monet on Mac OS X (Tiger) and it works as expected.
I can use JDBC from Aqua Data Studio or even Netbeans 6.0 beta 2 to access databases I create but my experiments so far are when these clients and the Monet DB are on the same Mac OS X host.
Now I want to install Monet on a linux box on my network and access the DB via JDBC from my Mac.
I installed Monet on the linux box (Cent OS).
But access via JDBC from the Mac does not seem to be working. I seem to connect from the Mac via Aqua Data Studio, but I do not see the demo database. Instead I see a <DEFAULT> database listed with no schemas. I created a new user and and a schema for that user on Linux using the command line client and that seemed to work.
But after disconnecting and re-connecting, I still don't see the database.
Could I be doing something wrong?
I'm guessing your server isn't opened for remote connections. You can enable this by editing your $prefix/etc/monetdb5.conf file (usually prefix = /). And change mapi_open=false into mapi_open=true. (or simply start your mserver5 with
mserver5 --dbinit="include sql;" --set mapi_open=true
Niels
Jim
View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Thanks for the reply but this is the first thing I tried. Without this setting, I cannot connect at all.
With the setting, I can connect, but I do not see the demo database. Instead the only database I see is called <DEFAULT> and there are no tables there.
I am using the jdbc jar that was built when I installed the Mac version from source.
For some reason, when I built the linux version from source, I did not get a linux copy of the jdbc jar actually built.
Will it make a difference which jdbc jar I used for my cross-network experiments? If so, how can I force a jdbc jar to be built? I do have java (1.5: java version "1.5.0_12") installed on the linux box.
If it makes a difference, the only way I can access the linux box is to use its local network IP rather than a host name.
Jim
Niels Nes wrote:
On Mon, Nov 12, 2007 at 11:04:22AM -0800, jsolderitsch wrote:
...
Could I be doing something wrong?
I'm guessing your server isn't opened for remote connections. You can enable this by editing your $prefix/etc/monetdb5.conf file (usually prefix = /). And change mapi_open=false into mapi_open=true. (or simply start your mserver5 with
mserver5 --dbinit="include sql;" --set mapi_open=true
Niels
Jim
View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 12-11-2007 11:53:12 -0800, jsolderitsch wrote:
Thanks for the reply but this is the first thing I tried. Without this setting, I cannot connect at all.
With the setting, I can connect, but I do not see the demo database. Instead the only database I see is called <DEFAULT> and there are no tables there.
I am using the jdbc jar that was built when I installed the Mac version from source.
For some reason, when I built the linux version from source, I did not get a linux copy of the jdbc jar actually built.
You are probably missing "ant" on your linux box. Mac OS X comes with ant preinstalled.
Will it make a difference which jdbc jar I used for my cross-network experiments? If so, how can I force a jdbc jar to be built? I do have java (1.5: java version "1.5.0_12") installed on the linux box.
Nope, Java is cross-platform.
If it makes a difference, the only way I can access the linux box is to use its local network IP rather than a host name.
This should not be an issue. If you start mserver5 servers yourself (e.g. not using merovingian) then I'm not sure how this can happen. Are you sure there is only one mserver5 running?
Yes -- it looks like the linux box does not have ant installed -- or at least not visible.
I start the server using the command:
./mserver5 --dbinit="include sql;"
I see:
[awsim2@centos-modernization bin]$ ./mserver5 --dbinit="include sql;" # MonetDB server v5.2.0, based on kernel v1.20.0 # Serving database 'demo' # Compiled for i686-redhat-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /home/awsim2/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://centos-modernization:50000/ # MonetDB/SQL module v2.20.0 loaded
I did a ps and I only see one mserver5 process running/
Do I need to background the server? Or use a different startup option?
Is that vault key warning significant?
Fabian Groffen wrote:
You are probably missing "ant" on your linux box. Mac OS X comes with ant preinstalled.
Will it make a difference which jdbc jar I used for my cross-network experiments? If so, how can I force a jdbc jar to be built? I do have java (1.5: java version "1.5.0_12") installed on the linux box.
Nope, Java is cross-platform.
If it makes a difference, the only way I can access the linux box is to use its local network IP rather than a host name.
This should not be an issue. If you start mserver5 servers yourself (e.g. not using merovingian) then I'm not sure how this can happen. Are you sure there is only one mserver5 running?
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
I checked the version of gcc I am using:
[awsim2@centos-modernization bin]$ gcc --version gcc (GCC) 3.4.6 20051222 (prerelease) for GNAT Pro 5.04a
This is quite old but the box is built to support Ada for another system being developed on the box.
Could the version of gcc matter?
jsolderitsch wrote:
Yes -- it looks like the linux box does not have ant installed -- or at least not visible.
I start the server using the command:
./mserver5 --dbinit="include sql;"
I see:
[awsim2@centos-modernization bin]$ ./mserver5 --dbinit="include sql;" # MonetDB server v5.2.0, based on kernel v1.20.0 # Serving database 'demo' # Compiled for i686-redhat-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /home/awsim2/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://centos-modernization:50000/ # MonetDB/SQL module v2.20.0 loaded
I did a ps and I only see one mserver5 process running/
Do I need to background the server? Or use a different startup option?
Is that vault key warning significant?
Fabian Groffen wrote:
You are probably missing "ant" on your linux box. Mac OS X comes with ant preinstalled.
Will it make a difference which jdbc jar I used for my cross-network experiments? If so, how can I force a jdbc jar to be built? I do have java (1.5: java version "1.5.0_12") installed on the linux box.
Nope, Java is cross-platform.
If it makes a difference, the only way I can access the linux box is to use its local network IP rather than a host name.
This should not be an issue. If you start mserver5 servers yourself (e.g. not using merovingian) then I'm not sure how this can happen. Are you sure there is only one mserver5 running?
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 12-11-2007 12:25:55 -0800, jsolderitsch wrote:
I checked the version of gcc I am using:
[awsim2@centos-modernization bin]$ gcc --version gcc (GCC) 3.4.6 20051222 (prerelease) for GNAT Pro 5.04a
This is quite old but the box is built to support Ada for another system being developed on the box.
Could the version of gcc matter?
If it works fine when connecting local (you could even try using a temporal ssh bridge: ssh -L50000:centos-modernization:50000 modernization) then it should work the same when from outside.
Can you verify it works correctly locally?
Yes, I can use mclient locally and with yours and Neil's help, I can use mclient on the Mac and talk to the networked Database that way. This works.
I can use Netbeans on the centos box to talk to the localhost'd database (and to a database running back on my Mac). Just not netbeans from my Mac -- fails like Aqua Data Studio.
I did say previously that the machine name centos-modernization is NOT known to DNS. I can't ping centos-modernization. I must use an internal IP address for this database. Could the name resolution be a factor here?
For my mac I have a specific DNS entry so that my machine name is usable on the network.
Jim
Fabian Groffen wrote:
On 12-11-2007 12:25:55 -0800, jsolderitsch wrote:
I checked the version of gcc I am using:
[awsim2@centos-modernization bin]$ gcc --version gcc (GCC) 3.4.6 20051222 (prerelease) for GNAT Pro 5.04a
This is quite old but the box is built to support Ada for another system being developed on the box.
Could the version of gcc matter?
If it works fine when connecting local (you could even try using a temporal ssh bridge: ssh -L50000:centos-modernization:50000 modernization) then it should work the same when from outside.
Can you verify it works correctly locally?
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 12-11-2007 12:17:26 -0800, jsolderitsch wrote:
I did a ps and I only see one mserver5 process running/
Do I need to background the server? Or use a different startup option?
Nope, should all be fine.
Is that vault key warning significant?
Not for the issue at hand.
On Mon, Nov 12, 2007 at 11:53:12AM -0800, jsolderitsch wrote:
Thanks for the reply but this is the first thing I tried. Without this setting, I cannot connect at all.
Good.
With the setting, I can connect, but I do not see the demo database. Instead the only database I see is called <DEFAULT> and there are no tables there.
I know of no such schema or database. So its some fallback of aqua studio I guess. Which means the connection isn't really functional jet.
Did you try mclient on mac to connect to the server on your centos system?
I am using the jdbc jar that was built when I installed the Mac version from source.
Should work (if it is too old it complains about incompatible protocol or so).
For some reason, when I built the linux version from source, I did not get a linux copy of the jdbc jar actually built.
For building you need ant and sun java (ie not the gcj usually comming with redhat and derivetives).
Will it make a difference which jdbc jar I used for my cross-network experiments? If so, how can I force a jdbc jar to be built? I do have java (1.5: java version "1.5.0_12") installed on the linux box.
If it makes a difference, the only way I can access the linux box is to use its local network IP rather than a host name.
both ip and hostname should work
Niels
Jim
Niels Nes wrote:
On Mon, Nov 12, 2007 at 11:04:22AM -0800, jsolderitsch wrote:
...
Could I be doing something wrong?
I'm guessing your server isn't opened for remote connections. You can enable this by editing your $prefix/etc/monetdb5.conf file (usually prefix = /). And change mapi_open=false into mapi_open=true. (or simply start your mserver5 with
mserver5 --dbinit="include sql;" --set mapi_open=true
Niels
Jim
View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
How do I try mclient this way? I guess I need to read the docs more closely?
I have Sun java but ant was not in my path -- I need to fix this.
Jim
Niels Nes wrote:
On Mon, Nov 12, 2007 at 11:53:12AM -0800, jsolderitsch wrote:
Did you try mclient on mac to connect to the server on your centos system?
For building you need ant and sun java (ie not the gcj usually comming with redhat and derivetives).
Niels
Jim
Niels Nes wrote:
On Mon, Nov 12, 2007 at 11:04:22AM -0800, jsolderitsch wrote:
...
Could I be doing something wrong?
I'm guessing your server isn't opened for remote connections. You can enable this by editing your $prefix/etc/monetdb5.conf file (usually
prefix
= /). And change mapi_open=false into mapi_open=true. (or simply start your mserver5 with
mserver5 --dbinit="include sql;" --set mapi_open=true
Niels
Jim
View this message in context:
http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht...
Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a
browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On Mon, Nov 12, 2007 at 12:20:15PM -0800, jsolderitsch wrote:
How do I try mclient this way? I guess I need to read the docs more closely?
if you have a compiled monet on your mac simply run mclient -lsql -h'linux system'
If this give you a sql> prompt it works else something is wrong.
Niels
I have Sun java but ant was not in my path -- I need to fix this.
Jim
Niels Nes wrote:
On Mon, Nov 12, 2007 at 11:53:12AM -0800, jsolderitsch wrote:
Did you try mclient on mac to connect to the server on your centos system?
For building you need ant and sun java (ie not the gcj usually comming with redhat and derivetives).
Niels
Jim
Niels Nes wrote:
On Mon, Nov 12, 2007 at 11:04:22AM -0800, jsolderitsch wrote:
...
Could I be doing something wrong?
I'm guessing your server isn't opened for remote connections. You can enable this by editing your $prefix/etc/monetdb5.conf file (usually
prefix
= /). And change mapi_open=false into mapi_open=true. (or simply start your mserver5 with
mserver5 --dbinit="include sql;" --set mapi_open=true
Niels
Jim
View this message in context:
http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht...
Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a
browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Thanks for the usage help.
The mclient works great from the Mac using the -h option. I can connect to the network database and run queries just fine.
Let me try another JDBC tool -- squirrel or something.
For completeness, I did fire up netbeans on the centos box and created a database connection back to the database running on my Mac and that worked -- I can see and work with tables.
I can also use netbeans on the linux box to connect to the localhost'd database as well.
BUT I cannot use netbeans on the Mac to connect to the centos DB.
The fact that the jdbc driver did not build due to ant not found -- could that have deeper repercussions?
Jim
Niels Nes wrote:
On Mon, Nov 12, 2007 at 12:20:15PM -0800, jsolderitsch wrote:
How do I try mclient this way? I guess I need to read the docs more closely?
if you have a compiled monet on your mac simply run mclient -lsql -h'linux system'
If this give you a sql> prompt it works else something is wrong.
Niels
Niels Nes wrote:
On Mon, Nov 12, 2007 at 11:04:22AM -0800, jsolderitsch wrote:
...
Could I be doing something wrong?
I'm guessing your server isn't opened for remote connections. You
can
enable this by editing your $prefix/etc/monetdb5.conf file (usually
prefix
= /). And change mapi_open=false into mapi_open=true. (or simply start your mserver5 with
mserver5 --dbinit="include sql;" --set mapi_open=true
Niels
Jim
View this message in context:
http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht...
Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a
browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a
browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- View this message in context:
http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht...
Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a
browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.ht... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 12-11-2007 13:10:04 -0800, jsolderitsch wrote:
I can also use netbeans on the linux box to connect to the localhost'd database as well.
BUT I cannot use netbeans on the Mac to connect to the centos DB.
This weird. Can you try the following from your Mac to the CentOS box:
mjclient -h centosbox -Xdebug /var/tmp/mac-to-centos.log
and copy/paste the contents of /var/tmp/mac-to-centos.log in a mail to the list?
The fact that the jdbc driver did not build due to ant not found -- could that have deeper repercussions?
None at all. JDBC natively speaks the "wire protocol", like mclient uses.
OK. When I run the command you state below, I see on the terminal:
jjsmacpro:~/MonetDB/bin jjs$ ./mjclient -lsql -h'10.5.100.39' -uafmstt -Xdebug /var/tmp/mac-to-centos.log password:
A fatal exception occurred: java.lang.IndexOutOfBoundsException java.lang.IndexOutOfBoundsException at java.io.BufferedInputStream.read(BufferedInputStream.java:306) at nl.cwi.monetdb.mcl.net.MapiSocket$BlockInputStream.readBlock(MapiSocket.java:680) at nl.cwi.monetdb.mcl.net.MapiSocket$BlockInputStream.read(MapiSocket.java:732) at sun.nio.cs.StreamDecoder$CharsetSD.readBytes(StreamDecoder.java:411) at sun.nio.cs.StreamDecoder$CharsetSD.implRead(StreamDecoder.java:453) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:183) at java.io.InputStreamReader.read(InputStreamReader.java:167) at java.io.BufferedReader.fill(BufferedReader.java:136) at java.io.BufferedReader.readLine(BufferedReader.java:299) at java.io.BufferedReader.readLine(BufferedReader.java:362) at nl.cwi.monetdb.mcl.io.BufferedMCLReader.readLine(BufferedMCLReader.java:96) at nl.cwi.monetdb.mcl.io.BufferedMCLReader.waitForPrompt(BufferedMCLReader.java:169) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:1819) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1798) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at nl.cwi.monetdb.jdbc.MonetStatement.executeQuery(MonetStatement.java:404) at nl.cwi.monetdb.jdbc.MonetDatabaseMetaData.getEnv(MonetDatabaseMetaData.java:85) at nl.cwi.monetdb.jdbc.MonetDatabaseMetaData.getDatabaseProductVersion(MonetDatabaseMetaData.java:205) at nl.cwi.monetdb.client.JdbcClient.main(JdbcClient.java:453)
In the log file itself, I see:
RD 1194902363422: read final block: 45 bytes RX 1194902363422: 0uKOgYZqIe:mserver:8:SHA1,MD5,crypt,plain:LIT RD 1194902363422: inserting prompt TD 1194902363436: write final block: 63 bytes TX 1194902363436: BIG:afmstt:{SHA1}87067aeaf05af17c7ef082da2e53f097cd7972ab:sql:: RD 1194902363440: read final block: 0 bytes RX 1194902363440: RD 1194902363440: inserting prompt TD 1194902363443: write final block: 48 bytes TX 1194902363444: sSET TIME ZONE INTERVAL '-05:00' HOUR TO MINUTE; RD 1194902363446: read final block: 0 bytes RX 1194902363446: RD 1194902363447: inserting prompt TD 1194902363460: write final block: 15 bytes TX 1194902363460: Xreply_size 250 RD 1194902363461: read final block: 0 bytes RX 1194902363462: RD 1194902363462: inserting prompt TD 1194902363462: write final block: 46 bytes TX 1194902363462: sSELECT "name", "value" FROM sys.env() as env; RD 1194902363465: read final block: 1693 bytes RD 1194902363466: the following incomplete block was received: RX 1194902363466: &1 0 41 2 41 % .env, .env # table_name % name, value # name % varchar, varchar # type % 17, 109 # length [ "gdk_arch", "32biti686-redhat-linux-gnu" ] [ "gdk_version", "1.20.0" ] [ "monet_pid", "23113" ] [ "prefix", "/home/awsim2/MonetDB" ] [ "exec_prefix", "/home/awsim2/MonetDB" ] [ "gdk_dbname", "demo" ] [ "gdk_dbfarm", "/home/awsim2/MonetDB/var/MonetDB5/dbfarm" ] [ "gdk_debug", "0" ] [ "gdk_mem_bigsize", "262144" ] [ "gdk_vm_minsize", "137438953472" ] [ "gdk_alloc_map", "no" ] [ "gdk_mem_pagebits", "14" ] [ "gdk_vmtrim", "yes" ] [ "monet_admin", "adm" ] [ "monet_prompt", ">" ] [ "monet_welcome", "yes" ] [ "monet_mod_path", "/home/awsim2/MonetDB/lib/MonetDB5:/home/awsim2/MonetDB/lib/MonetDB5/lib:/home/awsim2/MonetDB/lib/MonetDB5/bin" ] [ "monet_daemon", "no" ] [ "host", "localhost" ] [ "mapi_port", "0" ] [ "mapi_noheaders", "no" ] [ "mapi_debug", "0" ] [ "mapi_clients", "2" ] [ "sql_debug", "0" ] [ "sql_logdir", "/home/awsim2/MonetDB/var/MonetDB5/sql_logs" ] [ "xquery_logdir", "/home/awsim2/MonetDB/var/MonetDB/xquery_logs" ] [ "standoff_ns", "http://monetdb.cwi.nl/standoff" ] [ "standoff_start", "start" ] [ "standoff_end", "end" ] [ "config", "/home/awsim2/MonetDB/etc/monetdb5.conf" ] [ "gdk_embedded", "no" ] [ "mero_msglog", "/home/awsim2/MonetDB/var/log/merovingian.log" ] [ "mero_errlog", "/home/awsim2/MonetDB/var/log/merovingian.log" ] [ "mero_timeinterval", "600" ] [ "mero_exittimeout", "7" ] [ "mal_init", "/home/awsim2 RD 1194902363466: read final block: 9879 bytes
Fabian Groffen wrote:
On 12-11-2007 13:10:04 -0800, jsolderitsch wrote:
I can also use netbeans on the linux box to connect to the localhost'd database as well.
BUT I cannot use netbeans on the Mac to connect to the centos DB.
This weird. Can you try the following from your Mac to the CentOS box:
mjclient -h centosbox -Xdebug /var/tmp/mac-to-centos.log
and copy/paste the contents of /var/tmp/mac-to-centos.log in a mail to the list?
The fact that the jdbc driver did not build due to ant not found -- could that have deeper repercussions?
None at all. JDBC natively speaks the "wire protocol", like mclient uses.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 12-11-2007 13:23:26 -0800, jsolderitsch wrote:
OK. When I run the command you state below, I see on the terminal:
jjsmacpro:~/MonetDB/bin jjs$ ./mjclient -lsql -h'10.5.100.39' -uafmstt -Xdebug /var/tmp/mac-to-centos.log password:
A fatal exception occurred: java.lang.IndexOutOfBoundsException java.lang.IndexOutOfBoundsException at java.io.BufferedInputStream.read(BufferedInputStream.java:306) at nl.cwi.monetdb.mcl.net.MapiSocket$BlockInputStream.readBlock(MapiSocket.java:680)
Thanks a lot!
RD 1194902363466: read final block: 9879 bytes
This indeed exceeds the BLOCKsize (8096), and hence causes trouble, and may be the reason why on Windows problems occur around the same point.
So -- the good news is my problem is not completely operator error.
But the bad news is that something is broken at a level for which there is no immediate work-around so I can't do what I set out to do -- at least with the sources I used to build: MonetDB-Mars-SuperBall-SR4
Let me know if you foresee an improvement to this situation -- say in a nightly build.
Would I be more likely to have success if my jdbc client was running on another platform -- linux or Windows instead of a Mac?
Jim
Fabian Groffen wrote:
On 12-11-2007 13:23:26 -0800, jsolderitsch wrote:
OK. When I run the command you state below, I see on the terminal:
jjsmacpro:~/MonetDB/bin jjs$ ./mjclient -lsql -h'10.5.100.39' -uafmstt -Xdebug /var/tmp/mac-to-centos.log password:
A fatal exception occurred: java.lang.IndexOutOfBoundsException java.lang.IndexOutOfBoundsException at java.io.BufferedInputStream.read(BufferedInputStream.java:306) at nl.cwi.monetdb.mcl.net.MapiSocket$BlockInputStream.readBlock(MapiSocket.java:680)
Thanks a lot!
RD 1194902363466: read final block: 9879 bytes
This indeed exceeds the BLOCKsize (8096), and hence causes trouble, and may be the reason why on Windows problems occur around the same point.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 12-11-2007 13:42:12 -0800, jsolderitsch wrote:
So -- the good news is my problem is not completely operator error.
But the bad news is that something is broken at a level for which there is no immediate work-around so I can't do what I set out to do -- at least with the sources I used to build: MonetDB-Mars-SuperBall-SR4
Let me know if you foresee an improvement to this situation -- say in a nightly build.
Would I be more likely to have success if my jdbc client was running on another platform -- linux or Windows instead of a Mac?
Well, not really. The problem now is to determine who is at fault. JDBC thinks it gets a too large block, but the question remains whether the server really sends a too large block or not. I've never been able to reproduce it, meaning I can't just put the debugger on it to pinpoint who is at fault here.
The debug needs to be done on the server side in stream.mx, however, for that code I need Niels to be able to quickly analyse it to see if it is theoretically possible at all that too big blocks are being sent, or that maybe somewhere some bitshifting doesn't take something into account which it should have...
I tried the reverse direction with mjclient: going from the centos install back to the database running on my Mac and I get the same errors. This was after I added ant to my centos install so I could build the jdbc jar there.
So the problem is not a quirk of Mac to Linux. It is quite repeatable in either direction.
Thanks for taking the time to look into this.
Jim
Fabian Groffen wrote:
Well, not really. The problem now is to determine who is at fault. JDBC thinks it gets a too large block, but the question remains whether the server really sends a too large block or not. I've never been able to reproduce it, meaning I can't just put the debugger on it to pinpoint who is at fault here.
The debug needs to be done on the server side in stream.mx, however, for that code I need Niels to be able to quickly analyse it to see if it is theoretically possible at all that too big blocks are being sent, or that maybe somewhere some bitshifting doesn't take something into account which it should have...
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 12-11-2007 20:18:19 -0800, jsolderitsch wrote:
I tried the reverse direction with mjclient: going from the centos install back to the database running on my Mac and I get the same errors. This was after I added ant to my centos install so I could build the jdbc jar there.
So the problem is not a quirk of Mac to Linux. It is quite repeatable in either direction.
Thanks for taking the time to look into this.
I just committed a fix for this. Hopefully it fixes your issue. Please fetch http://www.cwi.nl/~fabian/troep/monetdb-1.6-jdbc.jar and try it out on your setting.
Yes!
The new jar works from inside Aqua Data Studio -- connecting to the Linux Monet DB from Aqua Data Studio running on the Mac. I see the demo DB now and all of the schemas within -- just like localhost.
I first tried mjclient but that fails because it wants a jdbcclient.jar and the one you built is missing a main class -- even after I adjusted the script to compensate and use the new jar instead.
I will report back here is there are any further.
I was getting to switch to mysql :-(
Thanks very much
Jim
Fabian Groffen wrote:
On 12-11-2007 20:18:19 -0800, jsolderitsch wrote:
I tried the reverse direction with mjclient: going from the centos install back to the database running on my Mac and I get the same errors. This was after I added ant to my centos install so I could build the jdbc jar there.
So the problem is not a quirk of Mac to Linux. It is quite repeatable in either direction.
Thanks for taking the time to look into this.
I just committed a fix for this. Hopefully it fixes your issue. Please fetch http://www.cwi.nl/~fabian/troep/monetdb-1.6-jdbc.jar and try it out on your setting.
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 13-11-2007 12:03:30 -0800, jsolderitsch wrote:
Yes!
The new jar works from inside Aqua Data Studio -- connecting to the Linux Monet DB from Aqua Data Studio running on the Mac. I see the demo DB now and all of the schemas within -- just like localhost.
Actually, what you may be interested in, is what revealed this bug. The bug actually was wrong use of basically a non-blocking read. The problem here was that the code assumed a blocking read. It appeared to go well in our entire testing suite and desktops, basically because local and our tested network connections were fast enough to have the TCP buffers filled fast enough to have the non-blocking read get what it needs (at max 8K). In your case it seems that the network connection is too slow for this. This may be due to firewalls, or just a very busy network stack, but just so you are aware of this. This also explains why it worked locally. Anyway, the fix I made was basically to make the read blocking.
I first tried mjclient but that fails because it wants a jdbcclient.jar and the one you built is missing a main class -- even after I adjusted the script to compensate and use the new jar instead.
If you want, I can just give you the jdbcclient.jar as well.
I will report back here is there are any further.
I was getting to switch to mysql :-(
Oh noes!!!!!! ;)
I would not mind getting an updated jdbcclient jar as well.
Interesting news about the non-ideal network in my case. The linux host is actually a VMware can installed on the network somewhere. There are several of these in simultaneous operation on the same physical box so network characteristics are unpredictable. I usually access this can via nxclient (NoMachine). I also sometimes use a VPN connection from home (my DSL account) to work with all of the firewalling that this arrangement includes. We also have regular network annoyances -- like our Outlook clients losing contact with the Exchange server. I suspect that there is a general network misalignment of some kind. I guess I will open a trouble ticket with out IT department.
So I am glad to have "arranged" a testing environment to reveal a lurking misbehavior.
I assume this fix is actually the right solution for the monetdb jdbc implementation, rather than a work-around for my particular situation and that it will be included in the next MonetDB release.
Fabian Groffen wrote:
On 13-11-2007 12:03:30 -0800, jsolderitsch wrote:
Yes!
The new jar works from inside Aqua Data Studio -- connecting to the Linux Monet DB from Aqua Data Studio running on the Mac. I see the demo DB now and all of the schemas within -- just like localhost.
Actually, what you may be interested in, is what revealed this bug. The bug actually was wrong use of basically a non-blocking read. The problem here was that the code assumed a blocking read. It appeared to go well in our entire testing suite and desktops, basically because local and our tested network connections were fast enough to have the TCP buffers filled fast enough to have the non-blocking read get what it needs (at max 8K). In your case it seems that the network connection is too slow for this. This may be due to firewalls, or just a very busy network stack, but just so you are aware of this. This also explains why it worked locally. Anyway, the fix I made was basically to make the read blocking.
I first tried mjclient but that fails because it wants a jdbcclient.jar and the one you built is missing a main class -- even after I adjusted the script to compensate and use the new jar instead.
If you want, I can just give you the jdbcclient.jar as well.
I will report back here is there are any further.
I was getting to switch to mysql :-(
Oh noes!!!!!! ;)
This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On 13-11-2007 13:22:23 -0800, jsolderitsch wrote:
I would not mind getting an updated jdbcclient jar as well.
http://www.cwi.nl/~fabian/troep/jdbcclient.jar
Interesting news about the non-ideal network in my case. The linux host is actually a VMware can installed on the network somewhere. There are several of these in simultaneous operation on the same physical box so network characteristics are unpredictable. I usually access this can via nxclient (NoMachine). I also sometimes use a VPN connection from home (my DSL account) to work with all of the firewalling that this arrangement includes. We also have regular network annoyances -- like our Outlook clients losing contact with the Exchange server. I suspect that there is a general network misalignment of some kind. I guess I will open a trouble ticket with out IT department.
Ahhh, well those kind of setups are legal to produce some lag... I was just imagining it to be your big server and thought maybe you don't know that there is a possible speed reduction going on over the wires...
So I am glad to have "arranged" a testing environment to reveal a lurking misbehavior.
I assume this fix is actually the right solution for the monetdb jdbc implementation, rather than a work-around for my particular situation and that it will be included in the next MonetDB release.
It indeed is a correct fix, as we saw the same happening with Windows. Thanks to your log I was actually able to pin-point the problem this time and fix it. It has been committed and we plan on making a little sub-component bugfix release out of it.
So once again, thanks for the report.
On 12-11-2007 12:20:15 -0800, jsolderitsch wrote:
How do I try mclient this way? I guess I need to read the docs more closely?
mclient --lang=sql --host=myserver
I have Sun java but ant was not in my path -- I need to fix this.
Only relevant if you want to build the jdbc driver, which in your case is already built on your Mac.
participants (3)
-
Fabian Groffen -
jsolderitsch -
Niels Nes