after.
| @ changeset: 58970:61791f176083 | | user: Sjoerd Mullender sjoerd@acm.org | | date: Mon Mar 14 12:39:03 2016 +0100 | | summary: Approved after changeset 604ae9397192.
On Mon, Mar 14, 2016 at 12:57 PM, Sjoerd Mullender sjoerd@acm.org wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
On 14/03/16 12:50, Lefteris wrote:
The latest default checkout gives me the following error:
Latest before or after the merge I did this morning (changeset d47fadbc0f0c)?
mserver5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut:
Assertion `(v[i] & 0x80) == 0' failed.
#0 0x00007ffff49f39c8 in raise () from /lib64/libc.so.6 #1 0x00007ffff49f565a in abort () from /lib64/libc.so.6 #2 0x00007ffff49ec187 in __assert_fail_base () from /lib64/libc.so.6 #3 0x00007ffff49ec232 in __assert_fail () from /lib64/libc.so.6 #4 0x00007ffff72dcf12 in strPut (h=0x7fffc414b680, dst=0x7fffd4acbc80, v=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,1
00000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,5600000 5,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"...)
at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306
#5 0x00007ffff737c2c7 in BUNappend (b=0x7fffc414b3e0, t=0x7fffd4acbdd0, force=0 '\000') at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_bat.c:1059 #6 0x00007ffff7a8ab76 in tablet_error (task=0x7fffd5ccf710, row=1783, col=127, msg=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,1
00000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,5600000 5,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"...,
fcn=0x7fff94003120 "3/2/2016,LOANS,LAA,STLLO,1000586,12060,***-**-0586,***-**-0007,abc-*d
e-LAA,-30587274.52,30000000,INR,-61759247.44,7/11/2014,1/7/2015,,N,14000 007,50000007,56000005,1,FR25711,ACCNT,7/10/2014,3/2/2016,7/"...)
at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:720
#7 0x00007ffff7a8d869 in SQLload_parse_line (task=0x7fffd5ccf710, idx=1783) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1109 #8 0x00007ffff7a8db3c in SQLworker (arg=0x7fffd5ccf710) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1152 #9 0x00007ffff4d87555 in start_thread () from /lib64/libpthread.so.0 #10 0x00007ffff4ac1ded in clone () from /lib64/libc.so.6
The fix has not been ported to default? or a different issue?
Lefteris
On Mon, Mar 14, 2016 at 12:23 PM, Sjoerd Mullender <sjoerd@acm.org mailto:sjoerd@acm.org> wrote:
On 14/03/16 11:14, Lefteris wrote:
Hi Souri,
I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into.
The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.
while trying to load the data. And the trace reads
#4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306
So I suspect to be a parse error that is not treated as it is supposed to.
This indicates that there is a non-UTF-8 character in the input. Of course, there should not be an assertion error if wrong input is given, so that problem has been fixed in changeset c5460cc0b66b. What then remains is the bad input.
Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it.
Lefteris
On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi <souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com
<mailto:souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com>>
wrote:
Hello Team,
I had shared all the data with Lefteris. When database crashes we restore it from the backup.
Thank you
Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com http://www.usain.com
-----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi
mailto:users-list-bounces%2Bsouri.ratnaparkhi
<mailto:users-list-bounces%2Bsouri.ratnaparkhi
mailto:users-list-bounces%252Bsouri.ratnaparkhi>=usain.com@monetdb.o
rg
<mailto:usain.com@monetdb.org mailto:usain.com@monetdb.org>] On
Behalf Of Stefan Manegold Sent:
Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes.
Dear Souri,
as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it.
We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general.
If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets.
If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table?
Best, Stefan
----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com
<mailto:souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com>
wrote:
Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.
No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.
What could be the reason? Is 126 cols an issue? Please help. We
are stuck.
(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))
OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)
Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)
Thank you
Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com
_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org <mailto:users-list@monetdb.org mailto:users-list@monetdb.org> https://www.monetdb.org/mailman/listinfo/users-list
-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ http://www.CWI.nl/~manegold/
http://www.CWI.nl/~manegold/ | Science
Park 123 (L321) | | +31 (0)20 592-4212 tel:%2B31%20%280%2920%20592-4212 tel:%2B31%20%280%2920%20592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org
<mailto:users-list@monetdb.org mailto:users-list@monetdb.org>
_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
Sjoerd Mullender -----BEGIN PGP SIGNATURE----- Version: GnuPG v2
iQEcBAEBCAAGBQJW5qcfAAoJEISMxT6LrWYgTrkIAJIgt7A9HUR7PMLdyCQsQ2wl C82MqGTrNP8a8Jvxxq0uLQz7ykhILVtvXRphOX6nXjTHbw/+UFVbOAtqOPiCW8zw p1ogiaxpeMUpzdkbqPqVdC2fcYSEoD9DxlSLMfF98Fyp07C5/n8GLWdGGBLdrQk0 mdrbL+YSgak3BxB/B2aukhKEadWo8rQsPFVpZMnEGGy9sYrIfzop3BJdESPsggfk glkvTBDbuz051bw8X3jWCqOgdswpbkaytUMR5nwQAanbK8HBjcpHbEPiidK3U9Wc sMxoBzPfkra9EhSfDRRDB4clU423xrE+tnjtz48sTFnawLUqPnNYZTB5CMmt1/Y= =GTEk -----END PGP SIGNATURE----- _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list