Hello
I became very interested in MonetDB during my research, and I am considering developing my own MAL compiler for a system based on a data model my research group is working on in the future. For now, I've been trying to understand MAL and how the COPY INTO command works in MonetDB
Initially, I wish to do a large bulk load from an array in memory directly into MonetDB. My first "closed box" approach was to do the following:
-Create a binary integer file containing milions of integers in /dev/shm/ named teste.bin. It is a memory based device, so the data is expected to be in main memory.
-Create a table in MonetDB: CREATE TABLE teste (val INT);
-Try to do BINARY COPY FROM: COPY BINARY INTO teste FROM ('/dev/shm/teste.bin').
When I try to this I get the error:
Failed to attach file /dev/shm/teste.bin BATattach: cannot rename heapfile !OS: Invalid cross-device link
After that I understood that monetdb basically moves the entire file around, which can't be done with data from another device.
I wish to know if there is any sort of functionality in MonetDB or even a MAL module that would allow me to read from some sort of shared memory buffer (kind vague I know) directly into a BAT file. The MAL program for the COPY command has an sql.importTable and sql.append calls, so I wonder if there is some variant of those that would allow me to load binary data from a memory buffer?
Thanks in Advance