Classification: UNCLASSIFIED Caveats: NONE
Hi all,
I'm currently trying to compare the performance of R's quantile function to that of MonetDB's. I have a table loaded with the TPC-H benchmark's data (scale factor of 50). I'm trying to return ~300 million rows of data (select l_extendedprice from lineitem), and although I have 256G of RAM, I'm getting the following:
Error in paste(0)("",resp, collapse="") : Result would exceed 2^31-1 bytes
The R statement is : x = dbGetQuery(conn, "select l_extendedprice from lineitem")
Forgive me if this is a simplistic questions, as I am fairly new to R and don't know which avenue to take next. I took a look at bigmemory, but don't know quite how to return a result from monetdb and have it use a big.matrix. Note: the l_extendedprice is a floating (double) value.
Any suggestions?
Cheers.
Glover George
Classification: UNCLASSIFIED Caveats: NONE