I have been reading about MonetDB for a few days now, and have played
around with it some and it seems to solve some of the ultra complex
queries that I'd like to do in a time that is amazing. Congrats! One
thing, though, that confuses me is some scaling issues.
The data set that I'm looking at is potentially in the billions of
traditional rows, with about 50 columns, so from my understanding
that'd be 50 different BATs each with a billion or more items. My
concern is that OIDs seem to be restricted to 2^32-1, although from
looking at virtual OIDs, it's unclear whether in my situation that
would be useful?
Any thoughts on stuffing that much data into the system, especially
how it might impact dealing with VM issues? I'm more than happy to
say "this is the wrong approach" or system for this problem, as this
is obviously a non-normal case.
Chris
--
| Christopher Petrilli
| petrilli(a)gmail.com
