Hello All,
We had a crash reported on our MonetDB database, Below are the error messages. Can you share any insights on the below reported issue. There were no memory/cpu crunch during the crash, System had ample resource available.
MonetDB Version - Jul2017-SP4
2018-07-03 06:33:40 ERR TSV_PROD_DB_A315293https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315293: #GDKmmap(327680) fails, try to free up space memory in use=48376596752,virtual memory in use=102304729360https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/memory+in+use%3D48376596752%2Cvirtual+memory+in+use%3D102304729360 2018-07-03 06:33:40 ERR TSV_PROD_DB_A315293https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315293: #GDKmmap(327680) fails, try to free up space memory in use=48368938424,virtual memory in use=102295694776https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/memory+in+use%3D48368938424%2Cvirtual+memory+in+use%3D102295694776 2018-07-03 06:33:40 ERR TSV_PROD_DB_A315293https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315293: #GDKmmap(327680) fails, try to free up space memory in use=48367612864,virtual memory in use=102294369216https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/memory+in+use%3D48367612864%2Cvirtual+memory+in+use%3D102294369216 2018-07-03 06:33:40 ERR TSV_PROD_DB_A315293https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315293: #GDKmmap(327680) fails, try to free up space memory in use=48374211792,virtual memory in use=102300968144https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/memory+in+use%3D48374211792%2Cvirtual+memory+in+use%3D102300968144 2018-07-03 06:33:47 ERR TSV_PROD_DB_A315293https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315293: #GDKmmap(524288) fails, try to free up space memory in use=48312652864,virtual memory in use=103295521856https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/memory+in+use%3D48312652864%2Cvirtual+memory+in+use%3D103295521856 2018-07-03 06:34:33 MSG merovingian315279https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315279: database 'TSV_PROD_DB_A' has crashed after start on 2018-07-02 04:52:12, attempting restart, up min/avg/max: 2h/6d/4w, crash average: 1.00 0.60 0.20 (14-8=6) 2018-07-03 06:34:38 ERR control315279https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315279: !monetdbd: an internal error has occurred 'unknown or impossible state: 4' 2018-07-03 06:34:40 ERR merovingian315279https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315279: client error: unknown or impossible state: 4 2018-07-03 06:34:40 ERR control315279https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315279: !monetdbd: an internal error has occurred 'unknown or impossible state: 4' 2018-07-03 06:34:41 ERR merovingian315279https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315279: client error: unknown or impossible state: 4 2018-07-03 06:34:41 ERR control315279https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/315279: !monetdbd: an internal error has occurred 'unknown or impossible state: 4'
What was running during the crash ? : Users were dropping, recreating tables and loading data.
monetadmin@lnx1535 ~https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/monetadmin%40lnx1535+~$ cat /etc/redhat-release CentOS Linux release 7.4.1708 (Core) monetadmin@lnx1535 ~https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/monetadmin%40lnx1535+~$ free -g total used free shared buff/cache available Mem: 1007 199 419 1 388 804 Swap: 31 0 31 monetadmin@lnx1535 ~https://monetdbsolutions.atlassian.net/wiki/display/SUPPORT/monetadmin%40lnx1535+~$ cat /proc/cpuinfo|grep -i processor|wc -l 128
Thank You, Gautham