Re: Re: failed to import record too long: Loading 1.5 Terabyte table
You need to use the correct record delimiter i.e. newline instead of space.
-------- Original message --------From: Mahmoud Mohsen mmohsen35@gmail.com Date: 8/18/17 19:40 (GMT+01:00) To: users-list@monetdb.org Subject: Re: Re: failed to import record too long: Loading 1.5 Terabyte table
Dear Stefan, Thank you very much for your quick reply, so this is the first line of the file "lineitem.tbl", so no need to use an offset I think
1|310378689|15378705|1|17|29786.89|0.04|0.02|N|O|1996-03-13|1996-02-12|1996-03-22|DELIVER IN PERSON|TRUCK|egular courts above the| as for the version, I am using: MonetDB Database Server Toolkit v1.1 (Dec2016-SP5). So can this may be the cause of the error... an old version?
I am looking forward hearing from you,
Best regards, Mahmoud Mohsen
In fact, the record delimier must be pipe plus newline, i.e., '|\n' .
Hence, your copy into command should look as follows:
COPY INTO lineitem FROM '/vol1/tpch-dbgen/2000/lineitem.tbl' USING DELIMITERS '|', '|\n' LOCKED;
Best, Stefan
----- On Aug 18, 2017, at 8:18 PM, Stefan Manegold stefan.manegold@cwi.nl wrote:
You need to use the correct record delimiter i.e. newline instead of space.
-------- Original message -------- From: Mahmoud Mohsen mmohsen35@gmail.com Date: 8/18/17 19:40 (GMT+01:00) To: users-list@monetdb.org Subject: Re: Re: failed to import record too long: Loading 1.5 Terabyte table
Dear Stefan ,
Thank you very much for your quick reply,
so this is the first line of the file "lineitem.tbl", so no need to use an offset I think
1|310378689|15378705|1|17|29786.89|0.04|0.02|N|O|1996-03-13|1996-02-12|1996-03-22|DELIVER IN PERSON|TRUCK|egular courts above the|
as for the version, I am using: MonetDB Database Server Toolkit v1.1 (Dec2016-SP5).
So can this may be the cause of the error... an old version?
I am looking forward hearing from you,
Best regards,
Mahmoud Mohsen
users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
Unfortunately input files often contain errors. They are collected in a predefined table that contains a copy of the failed line and line number in the source file. The rejects table should be explicitly cleared before you load a new file.
Just issue the following instructions after your bulk load.
SELECT * from sys.rejects;
CALL sys.clearrejects();
On 18/08/2017 21:28, Stefan Manegold wrote:
In fact, the record delimier must be pipe plus newline, i.e., '|\n' .
Hence, your copy into command should look as follows:
COPY INTO lineitem FROM '/vol1/tpch-dbgen/2000/lineitem.tbl' USING DELIMITERS '|', '|\n' LOCKED;
Best, Stefan
----- On Aug 18, 2017, at 8:18 PM, Stefan Manegold stefan.manegold@cwi.nl wrote:
You need to use the correct record delimiter i.e. newline instead of space.
-------- Original message -------- From: Mahmoud Mohsen mmohsen35@gmail.com Date: 8/18/17 19:40 (GMT+01:00) To: users-list@monetdb.org Subject: Re: Re: failed to import record too long: Loading 1.5 Terabyte table
Dear Stefan ,
Thank you very much for your quick reply,
so this is the first line of the file "lineitem.tbl", so no need to use an offset I think
1|310378689|15378705|1|17|29786.89|0.04|0.02|N|O|1996-03-13|1996-02-12|1996-03-22|DELIVER IN PERSON|TRUCK|egular courts above the|
as for the version, I am using: MonetDB Database Server Toolkit v1.1 (Dec2016-SP5).
So can this may be the cause of the error... an old version?
I am looking forward hearing from you,
Best regards,
Mahmoud Mohsen
users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
participants (2)
-
Martin Kersten
-
Stefan Manegold