Dear Mahmoud,

how do the first two lines of your lineitem.tbl look like?

If the first line is not actual data but headers, you'd need to explicitly skip that using the OFFSET feature of COPY INTO.

Why we (nowadays?) get this possibly misleading error message, I don't know ...

(I assume you're using the latest Jul2017-SP1 release, aren't you?)

Best,

Stefan

----- On Aug 18, 2017, at 11:54 AM, Mahmoud Mohsen mmohsen35@gmail.com wrote:

Hello,

I'm trying to load a table with 1.5 Terabytes of data, the command I'm using

COPY INTO lineitem FROM '/vol1/tpch-dbgen/2000/lineitem.tbl' USING DELIMITERS '|', ' ' LOCKED;

The physical memory I'm using is 256G, the swap is 2.2 terabytes, the dbfarm is located within area has 4 Terabytes of free storage.

The message I'm getting:

"Failed to import table 'lineitem', record too long"

So what could be a possible solution to this problem,

Thank you a lot in advance,

Mahmoud Mohsen

---

users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

I haven't seen this specific problem, but I have had problems importing large tables with other errors.

Would it be possible for MonetDB to return a more informative error message? Maybe the line number of the offending line??

-----Original Message----- From: users-list [mailto:users-list-bounces+david.b.anderson=citi.com@monetdb.org] On Behalf Of Mahmoud Mohsen Sent: Friday, August 18, 2017 5:55 AM To: users-list@monetdb.org Cc: gabrielcampero@gmail.com Subject: failed to import record too long: Loading 1.5 Terabyte table

Hello,

I'm trying to load a table with 1.5 Terabytes of data, the command I'm using

COPY INTO lineitem FROM '/vol1/tpch-dbgen/2000/lineitem.tbl' USING DELIMITERS '|', ' ' LOCKED;

The physical memory I'm using is 256G, the swap is 2.2 terabytes, the dbfarm is located within area has 4 Terabytes of free storage.

The message I'm getting:

"Failed to import table 'lineitem', record too long"

So what could be a possible solution to this problem,

Thank you a lot in advance,

Mahmoud Mohsen

_______________________________________________ users-list mailing list users-list@monetdb.org https://urldefense.proofpoint.com/v2/url?u=https-3A__www.monetdb.org_mailman...