[Monetdb-developers] mclient running out of memory, crashing mserver5

sylver_b sylver_b at yahoo.com
Wed Jan 21 00:47:16 CET 2009


Hi,

I've finally found a better way to bulk load records via perl & odbc - a lot more stable.

However, I've noticed many times mclient crashing mserver5 when loading records via the interactive interface. For instance, I tried to load about 130 inserts from a sql file using this command :
mclient -lsql -d mydb < public_sysuser.sql

After few seconds I started to see :

#BBPTRIM: memtarget=17978753 vmtarget=0
#BBPTRIM_EXIT: memsize=24100864,vmsize=273741960
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
#BBPTRIM_ENTER: memsize=275281456,vmsize=275166768
#BBPTRIM: memtarget=19273201 vmtarget=0
#BBPTRIM_EXIT: memsize=24100864,vmsize=275158816
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
[ 1     ]
#BBPTRIM_ENTER: memsize=276161752,vmsize=276047064
#BBPTRIM: memtarget=20153497 vmtarget=0
#BBPTRIM_EXIT: memsize=24100864,vmsize=276056368
[ 1     ]
#BBPTRIM_ENTER: memsize=276322608,vmsize=276207920
#BBPTRIM: memtarget=20314353 vmtarget=0
#BBPTRIM_EXIT: memsize=24100864,vmsize=276198064

Top is showing :

top - 23:26:14 up 249 days,  9:57,  5 users,  load average: 0.00, 0.20, 0.45
Tasks:  96 total,   1 running,  95 sleeping,   0 stopped,   0 zombie
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   4025600k total,  2433324k used,  1592276k free,   191788k buffers
Swap:  9502408k total,       92k used,  9502316k free,  1993392k cached

I don't think i'm running out of memory. I had to stop and restart mserver5, flush the table, then re-run the command - all the records were inserted. Also I noticed this type of messages on the mserver5 console when piping records through the mclient (over 1million records) . It seems that the mclient is quiet instable (cf my post about "COPY, terminating connection" few months ago).

So, is there a way to increase the memory limit  or make sure mserver5 won't crash when running bash inserts via a cron job ? 

Please advise,
Thank you
SB


      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.monetdb.org/pipermail/developers-list/attachments/20090120/e2926293/attachment.html>


More information about the developers-list mailing list