Hi Stefan,
Sure, I will provide you more information on this. As an initial suggestion i wanted to know if there is any such issues reported on load via Script or such automated process.
Meanwhile, apart from COPY INTO, if there is an update/insert in a bulk quantity will it impact? Or will there be a crash? Or any restrictions.
I will send across more details shortly.
Thanks, Sreejith
-----Original Message----- From: users-list [mailto:users-list-bounces+sreejith.sharma=harman.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Tuesday, March 27, 2018 2:31 PM To: Communication channel for MonetDB users users-list@monetdb.org Subject: [EXTERNAL] Re: DB Crashing Post Data Load
Sreejith,
I'm afraid with the information you provide, we cannot help much (if at all).
In general, there are no specific setting or limitation for parallel loading, other than that the latter, if performed using MonetDB's standard COPY INTO statements, is governed by MonetDB transaction processing according to MonetDB's optimistic concurrency protocol. This might results in abortions due to (potential) conflicts, but should not lead to crashes.
Given that we have no idea what you shell scripts, ControlM process and or .dat files look like, or how they work, we cannot say anything about them.
Also, you log snippet only shows the restart message after the crash. It would (have) be(en) more informative to see also all message since (and including) the last successful client connection before the crash until (and including) the first successful client connection after the restart.
Best, Stefan
----- On Mar 27, 2018, at 8:35 AM, Sreejith Sharma Sreejith.Sharma@harman.com wrote:
All,
We have a scenario where we load the data via the shell scripts from .dat file using ControlM process. We notice the DB crashes intermittently post the load. Is there any limitation or settings on multiple session loads? Or what happens if load is parallel?
2018-03-27 00:21:54 MSG merovingian[45726]: database 'TEST_MDP' has crashed after start on 2018-03-13 05:04:41, attempting restart, up min/avg/max: 2m/4d/2w, crash average: 1.00 1.00 0.80 (35-9=26
MonetDB : 11.27.13
OS : CentOS 6
Regards,
Sreejith
users-list mailing list users-list@monetdb.org https://clicktime.symantec.com/a/1/od7ycXzppJwdKmOgw1rF5PoX_Hscr2CjOkS bn186pdI=?d=hbamF-lcLpfR-OkG58xLj1z9Si17W7xMgtlEOjYHKeNLGJbqYFgqUQqg2G 2cx5D0zEBi9cUE8SWqcGQ74vtETClfUOq64nIjJxZfpOGaZvH9HxQijaH0eVl1WdTy2kVM OpD1wfMGQ4CrccxVrYFrBn_dArSgEqEJruv6nYdV_tEqED3ivYmtCphUNOS7M8hHA_dZXo 9W5EbKdv9tvUhm_yKQ-Qt7KwfBL0vDaye_2S4s8Z4hUHVnlKf--BDarSTdEbQmi76poB0D U-7230ujJgMC-QW5S2MMpQ6RbWpPYDXYk5ccwpptCShd3-Sq3BhoCU5ygDXX6hBcV25jaM EfyDmgSBiTLW_uo2kusoJLPgQKzk9XOxB3L-RrRv_71JaEsbymiVGt0Y0mqnPaa4KvOFNv 9Rp06sWhxi5czTI2QW_RsQA%3D&u=https%3A%2F%2Fwww.monetdb.org%2Fmailman%2 Flistinfo%2Fusers-list