On Fri, May 29, 2009 at 11:35:12AM +0100, Rob Wickert wrote:
How many tuples are in your 60GB dataset, i.e., your table "raw_data"? Of which datatype is attribute "keyword"? How many distinct values are there / do you expect in column "keyword"?
This depends on the amount and kind of data as well as the type of queries. While we manage to run 100GB TPC-H on a 8 GB machine, generally "the more the better" does apply...
There are aprox 28 million keywords (varchar(100)) out of 680 million row table. Yes I know 3GB is not ideal and I wasn't expecting blindingly fast queries until we bump up the memory, but I wasn't expecting the memory mapping issue. There's plenty of space on the disk
- 151GB;
Rob,
also for this one, could you please upgrade to the latest May2009 release (http://monetdb.cwi.nl/Development/Releases/May2009/), try again, preferably prefixinng your query in mclient with "TRACE " to produce a performance trace that will give us more hints, where the problem occurs, and report?
Thanks, Stefan
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users