Are you using the table output step or the MonetDB bulk loader step?


We experienced stability problems with MonetDB from time to time, especially when bulk loading to a MonetDB server that runs for days on end without being stopped and started again.  That's in combination of dropping large tables, recreating and bulk loading or delete and reloads via bulk loading.  It just seemed like the best in practice use for MonetDB was starting clean, creating tables, doing a large single load and making sure you restart the server at some point each day.  Otherwise the ETL would lock up randomly or the server would stop responding to queries or annoyingly stop accepting connections from any new clients.

I'm interested in what the developers suggest as a way to nail down what's happening.  It's not as simple as running a command and getting the wrong result, at least in my case.  Hopefully you find a more easily reproducible problem.

Sent from my iPhone

On Jul 23, 2014, at 4:34 PM, Ali Salem <sarafandee@gmail.com> wrote:

Hello,

I have recently started using MonetDB for a BI project, and it's doing pretty well. However, I receive a connection reset error each time I run an ETL process (I use Pentaho PDI) to populate my dimensional schema. This error is reported by the MonetDB JDBC driver

Connection reset(mserver still alive?)

This usually happens after a random amount of time, 30 min, 45 min, 1 hour, etc.

Any pointers related to this would be very helpful.


Specs
-------
Ubuntu 12.04
8 GB Ram
500 GB Space
Pentaho PDI (community edition)
Monetdb5 (installed using apt-get)

Thank you.
_______________________________________________
users-list mailing list
users-list@monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list