MonetDB crashing due to out of memory - monetdbd[2247] 1.7 (Aug2018-SP2)
Hi,
The Moentdb is crashing every couple of weeks due to out of memory in our environment. What I have noticed that MonetDB is eating memory and not releasing it at all once we brought up the MonetDB server. I am not sure if this is how MonetDB works or is it a bug. This is running on monetdbd[2247] 1.7 (Aug2018-SP2) version. Also wondering is there way to limit the memory usage of MonetDB.
Can you guys help me to resolve this issue.
[root@xxx ~]# monetdb status name state health remarks INVPRDB R 6h 67% 3d mapi:monetdb://xxxxx:50000/INVPRDB FSPPRDB R 6h 50% 6w mapi:monetdb://xxxxx:50000/FSPPRDB [root@xxxxx ~]# free -g --- Current utilization total used free shared buff/cache available Mem: 31 0 22 0 7 30 Swap: 3 0 3
[cid:image003.png@01D5CBCA.6268DF10]
[cid:image002.jpg@01D3E7B3.57185110] Suresh Devarakonda 84.51http://www.8451.com/° TDO - Database Support Team D: 513.632.3692 M: 859.512.1839 A: 100 W. 5th Street, Cincinnati, Ohio 45202
Cincinnati | Chicago | New York | Portland Facebookhttps://www.facebook.com/8451group/?ref=aymt_homepage_panel LinkedInhttps://www.linkedin.com/company/84-51/?trk=biz-companies-cym Instagramhttps://www.instagram.com/84.51/ Twitterhttps://twitter.com/8451group Please consider the environment before printing this email.
Hai Suresh,
First of all, I’d recommend you to upgrade your MonetDB installation to the most recent one, i.e. Nov2019-SP1. There are many improvements related to your problem since Aug2018-SP2. Also, the version you’re using is no longer supported by the open-source team.
Please let us know if upgrade helps. But below, a bit more info. inlined.
On 15 Jan 2020, at 23:44, Suresh Devarakonda Suresh.Devarakonda@8451.com wrote:
Hi,
The Moentdb is crashing every couple of weeks due to out of memory in our environment.
Did it really crash, or did MonetDB give error messages and stop executing the query? Crash always indicates a problem in MonetDB, but if it’s the second case, it’s expected.
What I have noticed that MonetDB is eating memory and not releasing it at all once we brought up the MonetDB server. I am not sure if this is how MonetDB works or is it a bug.
MonetDB is supposed to free up the memory when it no longer use it, which often happens towards the end of a query execution.
For further investigation, we need more information after you have upgraded to Nov2019-SP1. In general, we’ll need information with which we can reproduce the problem, e.g. data + queries.
This is running on monetdbd[2247] 1.7 (Aug2018-SP2) version. Also wondering is there way to limit the memory usage of MonetDB.
Please beware that depending on your data sizes and (concurrent) queries, MonetDB might run faster into out-of-memory problem, if you limit the amount of memory it may use,
How about putting MonetDB in a VM?
There are also some undocumented kernel configurations for this, which we don’t recommend to our users lightly…
Can you guys help me to resolve this issue.
If you need professional support, please contact the supporting company MonetDB Solutions.
Regards, Jennie
[root@xxx ~]# monetdb status name state health remarks INVPRDB R 6h 67% 3d mapi:monetdb://xxxxx:50000/INVPRDB FSPPRDB R 6h 50% 6w mapi:monetdb://xxxxx:50000/FSPPRDB [root@xxxxx ~]# free -g --- Current utilization total used free shared buff/cache available Mem: 31 0 22 0 7 30 Swap: 3 0 3
<image003.png>
<image002.jpg> Suresh Devarakonda 84.51° TDO - Database Support Team D: 513.632.3692 M: 859.512.1839 A: 100 W. 5th Street, Cincinnati, Ohio 45202
Cincinnati | Chicago | New York | Portland Facebook LinkedIn Instagram Twitter Please consider the environment before printing this email.
users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
participants (2)
-
Suresh Devarakonda -
Ying Zhang