Mag Gam wrote:

I have limited memory on our system 16GB of memory and our tables have more than 2 billion records. The underlying storage is extremely fast (300MB/sec read and write and rewrite), therefore I would like to depend mainly on the storage versus placing everything in memory.

Is there an option with MonetDB which will let me only allocate 25% of the database into memory and rest seek disk?

no, MonetDB will take the memory it sees fit. You database is memory mapped, which means it brings only to memory what is needed.

You may have to enlarge your swap space on your system to accommodate complicated queries, i.e., with lots of intermediates.

Martin

TIA

---

The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environment may not be a perfect world - but thanks to Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 Series Scanner you'll get full speed at 300 dpi even with all image processing features enabled. http://p.sf.net/sfu/kodak-com _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

Mag Gam wrote:

I have limited memory on our system 16GB of memory and our tables have more than 2 billion records. The underlying storage is extremely fast (300MB/sec read and write and rewrite), therefore I would like to depend mainly on the storage versus placing everything in memory.

If you have the option to assign complete logical volume [unpartitioned] as swap this could improve your performance; depending on what storage solution you use. But as Martin mentioned you wil already benefit from memory and disks because of the mmaps. Just don't forget that your disks also require memory too :)

The following is interesting respect to manually tuning under Linux: http://www.westnet.com/~gsmith/content/linux-pdflush.htm

Stefan