February 2007 - users-list

[MonetDB-users] BAT Memory Usage
by Guillermo Arbeiza 05 Jul '07

05 Jul '07

Hello everyone, We are evaluating Monet right now to store and analyze a huge quantity of data. We have several facts collection that range from 1 million row, 200 cols. to way over 300 million rows and over 10.000 columns. We are aware of memory limitations of current Monet version and looking forward to the new one but in the meantime we'd like to do some performance and load tests. In order to know which data we will be able to store, we need to know how much memory will use a BAT depending on the datatype and the number of elements we want to store in it. Is there a lineal relation between those variables (ie. 8 bytes oid, 8 bytes int => 16 bytes per element) or do Monet encode data using intervals or such? Thank you in advance and kudos for your big efforts, Guillermo Arbeiza, Open Sistemas de Información e Internet garbeiza(AT)opensistemas.com ---------------------------------------------------------------------- Mensaje enviado por el servidor de openSistemas (www.opensistemas.com)

3 2

[MonetDB-users] shrinking BATs and distributed/streaming MonetDB
by Shahbaz 01 Mar '07

01 Mar '07

I was finally able to install monetdb and put data into it (on OSX), although I don't have any performance numbers to report back just yet. -If i delete or even drop a large table from MDB5, many of the BAT files remain on the file system. Is there a command that deflates/shrinks or completely removes to files? I wasn't able to find anything in the docs -According to previous messages on the mailing list and some other docs, MonetDB 5 is supposed to work with distributed databases (Armada?). I don't see anything regarding this in the docs either, is it coming soon? -I am very (VERY) interested in the ability to have a cluster/grid of MDB servers which let me distribute data and computation while providing an easy to use interface for end users and admins. Along with that, if we get the ability to process streaming data (such as stock quotes), MonetDB will become king of Wall Street :) -I see that one of the recommended projects for students is to extend MonetDB to process time series data. If someone is looking at this, please take a look at this paper: http://citeseer.ist.psu.edu/610025.html (AQuery for ordered data). Thanks

2 3

[MonetDB-users] □■monetdb-users@lists.sourceforge.net様あて
by ★交際 28 Feb '07

28 Feb '07

monetdb-users(a)lists.sourceforge.xn--net-fc2g 貴方様に好条件のお相手が見つかりました。今回特別に検索結果とともに以下の優待が受けられます。 (1)秘密交際を望む男性には女性を、女性には男性を、それぞれの希望で、　　アプローチを受けていただくかどうかを選択できます。 (2)検索条件にあった方にだけの特別優待です。これを受け取った方にだけに　　優先権利があります。 (3)お相手の方に、貴方様への連絡用メールアドレスをお渡ししています。　　期限付きですが、直接にお相手からのメールを受け取ることができます。 http://www.u-l-tra.com/rm1120 無料参加型ですから、お気軽に女性または男性のお誘いをお受け下さい。秘密募集の特別優待の件ということで、通常よりもお話が順調に進むかと思います。それでは、でお二人だけの時間をお過ごし下さい。 >>>>> 秘密交際募集掲示板サポート >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 　　優待案内(No.14870)をお送りしましたのは事務局担当、私、三浦、　　そして全国11拠点となった秘密交際クラブを宜しくお願いします。

1 0

[MonetDB-users] repository
by Isagani SIRGENSON 28 Feb '07

28 Feb '07

Have, an article with this. Purge function if previously, existed at title deletion! Here it may yet be visible because. Sound and videolook other pages within that. At, title deletion log see why my from? Our sister dictionary wikimedia commons repository images music sound. Name please search for in check. Article with this exact name please search for, in. Other, pages within that link! Wait few minutes try purge. An article with, this exact name please search? Existed at, title deletion log see. Deletion, log see why my from. Log see, why my from discussion view toolssign. Titleif page was recently created here it. California wikipedia the free to navigation does not. Log see why my from discussion, view toolssign. With this exact name please search for in. It may yet be visible because. Not have an article with this. Images music sound and videolook other pages within, that. Navigation does not have an article. Wikimedia commons, repository, images! Free to navigation does not have? Music sound and, videolook other pages within, that. Be visible because of delay.

1 0

[MonetDB-users] note we unable
by Rebin Urena 27 Feb '07

27 Feb '07

Ng collection february, johnson. Helpful durability fun hallie june. Christmas always im glad kind. Stockships from sold ez pawn shop or turn, on. Soon available related searches promotions free shipping? Heel, sandals, long black patent. At checkout, heres how apply, features, inch glamorous dressed. Your stuffbuy corporate developers web. When, spend qualifying offered enter code. Guides baby registry wedding, someones list.

1 0

[MonetDB-users] Bättre luft för bättre hälsa
by ITWorks VårtVal 27 Feb '07

27 Feb '07

- This mail is in HTML. Some elements may be ommited in plain text. - Tel: +46 (0)8 625 46 40 ULTRA-TYST LUFTRENARE FÖR KONTOR OCH HEM Lider du av allergiska besvär på våren? Besväras du av illaluktande ämnen på din arbetsplats eller i hemmet? En luftrenare kan göra underverk på din hälsa! Vi rekommenderar pollenallergiska personer att ställa ett luftfilter vid anslutning till arbetsplatsen och i sovrummet Lukt- och dammsensorer känner automatiskt av luftmiljön Renar luften från pollen, damm och partiklar Anti-bakteriellt filter minskar infektionsrisken i gemensamma utrymmen I princip ljudlös - perfekt för sovrummet eller andra ljudkänsliga miljöer Elegant design och låg vikt (endast 7 kg) Mycket lättanvänd med fjärrkontroll Tvättbart filter 2 års fabriksgaranti >> Beställ eller läs mer genom att klicka här! Tips: Vill du köpa Blu-ray eller äkta HDTV? E-posta vartval(a)itweurope.com så hjälper vi dig med leverans. Avbetalning och leasing OK! Om du inte vill ha fler erbjudanden från ITWorks, skicka ett e-brev till removeme(a)itweurope.com med ärende "remove" If you do not want to recieve any more e-mails from ITWorks sales, please send a message to removeme(a)itweurope.com with subject "remove"

1 0

[MonetDB-users] Bug fix release of MonetDB suite
by Sjoerd Mullender 26 Feb '07

26 Feb '07

The MonetDB team at CWI, The Netherlands, is happy to announce the availability of a new bug-fix release for the major "Venus" release. New versions of all components of the MonetDB suite are released. MonetDB/XQuery The handling of updates was incomplete. Several memory mapping and concurrency problems have been fixed. Moreover, empty pages that resulted from deletion of nodes are now properly handed back to the system for reuse. MonetDB/XRPC Security and concurrency handling has been improved. MonetDB/SQL Foreign key constraint checking fixed; View in view dependencies bug fixed; Resolved crashes caused by large views; Prepared statements with more than 30 arguments now work. MonetDB/API Haskell and TCL libraries were broken and have been removed; Perl and Python libraries were broken and have been fixed. The current version of the protocol is not compatible with the previous version. Bugs fixed: [ 1579510 ] XQ: update error for "(1,2)/." [ 1590523 ] XQ: substring-after [ 1636828 ] fork() behaves strangely [ 1637867 ] XQ: seqcast int? to numeric unsupported [ 1639108 ] mserver crashes on delete query [ 1640248 ] PF: ~500 tests randomly fail on Solaris x86 [ 1644245 ] M5 & SQL5: various tests hang/timeout on Darwin [ 1648303 ] database dump does not save/restore auto-increment sequences [ 1650469 ] SQL: Armada sinks MonetDB ships [ 1651567 ] yet another delete bug, foreign key related [ 1651599 ] caching of inserts causes extreme memory consumption [ 1655818 ] SQL:Error inserting float in numeric column using JDBC [ 1655857 ] XQ: call to builtin function crashes XRPC client [ 1659889 ] SQL: sequence not restored properly [ 1644610 ] Conflict between normal query and XRPC query (and many more that hadn't been reported) -- Sjoerd Mullender

1 0

[MonetDB-users] cannot start MonetDB5 server on Windows anymore
by Jos van Dongen 26 Feb '07

26 Feb '07

Does anyone has this error and how can I get rid of it?. I’m running on Windows Server 2003 (on a different machine using XP I got the same error after rebooting the machine). It looks like some references are missing. C:\Program Files\CWI\MonetDB5>m5server !ERROR: force_move: link(bat\BACKUP\1541.buns,bat15\1541.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1541.desc,bat15\1541.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1543.buns,bat15\1543.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1543.desc,bat15\1543.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1545.buns,bat15\1545.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1545.desc,bat15\1545.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1547.buns,bat15\1547.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1547.desc,bat15\1547.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1547.theap,bat15\1547.theap)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1551.buns,bat15\1551.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1551.desc,bat15\1551.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1554.buns,bat15\1554.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1554.desc,bat15\1554.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1556.buns,bat15\1556.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1556.desc,bat15\1556.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1560.buns,bat15\1560.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1560.desc,bat15\1560.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1562.buns,bat15\1562.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1562.desc,bat15\1562.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1562.theap,bat15\1562.theap)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1612.buns,bat16\1612.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1612.desc,bat16\1612.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1614.buns,bat16\1614.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1614.desc,bat16\1614.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1614.theap,bat16\1614.theap)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1616.buns,bat16\1616.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1616.desc,bat16\1616.desc)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1620.buns,bat16\1620.buns)=-1 !OS: No such file or directory !ERROR: force_move: link(bat\BACKUP\1620.desc,bat16\1620.desc)=-1 !OS: No such file or directory !ERROR: BBPrecover: recovery failed. Please check whether your disk is full or w rite-protected. !FATAL: BBPinit: cannot properly process bat\BACKUP. Thanks in advance for any help on this subject! Regards, Jos van Dongen -- No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.446 / Virus Database: 268.18.3/700 - Release Date: 24-2-2007 20:14

3 2

[MonetDB-users] xrpc clients
by oliver oli 25 Feb '07

25 Feb '07

hello, i'm trying to understand the design of monetdb/xquery, how it works and what are my options to use it with python / ruby. xrpc is a soap interface, is it possible to use monetdb/xquery with any soap client? in other words: could it be an alternative to the mapi interface

2 3

[MonetDB-users] More OS X problems
by Dean 25 Feb '07

25 Feb '07

OK, I just tried this: ./monetdb-install.sh --prefix=/opt/monetdb --enable-sql --enable-xquery --nightly=current -j2 Building the latest code and got the following error: /bin/sh ../../../libtool --tag=CC --mode=link gcc -g -O2 -Wall -Wextra -std=c99 -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wno-uninitialized -o libMonetODBC.la -rpath /opt/monetdb/lib -export-symbols ODBC.def libMonetODBC_la-ODBCConvert.lolibMonetODBC_la- ODBCDbc.lo libMonetODBC_la-ODBCDesc.lo libMonetODBC_la-ODBCEnv.lolibMonetODBC_la- ODBCError.lo libMonetODBC_la-ODBCStmt.lo libMonetODBC_la-ODBCUtil.lolibMonetODBC_la- SQLAllocConnect.lo libMonetODBC_la-SQLAllocEnv.lo libMonetODBC_la- SQLAllocHandle.lo libMonetODBC_la-SQLAllocStmt.lo libMonetODBC_la- SQLBindCol.lo libMonetODBC_la-SQLBindParameter.lo libMonetODBC_la- SQLBrowseConnect.lo libMonetODBC_la-SQLBulkOperations.lo libMonetODBC_la- SQLCancel.lo libMonetODBC_la-SQLCloseCursor.lo libMonetODBC_la- SQLColAttribute.lo libMonetODBC_la-SQLColAttributes.lo libMonetODBC_la- SQLColumnPrivileges.lo libMonetODBC_la-SQLColumns.lo libMonetODBC_la- SQLConnect.lo libMonetODBC_la-SQLCopyDesc.lo libMonetODBC_la- SQLDataSources.lo libMonetODBC_la-SQLDescribeCol.lo libMonetODBC_la- SQLDescribeParam.lo libMonetODBC_la-SQLDisconnect.lo libMonetODBC_la- SQLDriverConnect.lo libMonetODBC_la-SQLDrivers.lo libMonetODBC_la- SQLEndTran.lo libMonetODBC_la-SQLError.lo libMonetODBC_la-SQLExecDirect.lolibMonetODBC_la- SQLExecute.lo libMonetODBC_la-SQLExtendedFetch.lo libMonetODBC_la- SQLFetch.lo libMonetODBC_la-SQLFetchScroll.lo libMonetODBC_la- SQLForeignKeys.lo libMonetODBC_la-SQLFreeConnect.lo libMonetODBC_la- SQLFreeEnv.lo libMonetODBC_la-SQLFreeHandle.lo libMonetODBC_la- SQLFreeStmt.lo libMonetODBC_la-SQLGetConnectAttr.lo libMonetODBC_la- SQLGetConnectOption.lo libMonetODBC_la-SQLGetCursorName.lo libMonetODBC_la- SQLGetData.lo libMonetODBC_la-SQLGetDescField.lo libMonetODBC_la- SQLGetDescRec.lo libMonetODBC_la-SQLGetDiagField.lo libMonetODBC_la- SQLGetDiagRec.lo libMonetODBC_la-SQLGetEnvAttr.lo libMonetODBC_la- SQLGetFunctions.lo libMonetODBC_la-SQLGetInfo.lo libMonetODBC_la- SQLGetStmtAttr.lo libMonetODBC_la-SQLGetStmtOption.lo libMonetODBC_la- SQLGetTypeInfo.lo libMonetODBC_la-SQLMoreResults.lo libMonetODBC_la- SQLNativeSql.lo libMonetODBC_la-SQLNumParams.lo libMonetODBC_la- SQLNumResultCols.lo libMonetODBC_la-SQLParamData.lo libMonetODBC_la- SQLParamOptions.lo libMonetODBC_la-SQLPrepare.lo libMonetODBC_la- SQLPrimaryKeys.lo libMonetODBC_la-SQLProcedureColumns.lo libMonetODBC_la- SQLProcedures.lo libMonetODBC_la-SQLPutData.lo libMonetODBC_la- SQLRowCount.lo libMonetODBC_la-SQLSetConnectAttr.lo libMonetODBC_la- SQLSetConnectOption.lo libMonetODBC_la-SQLSetCursorName.lo libMonetODBC_la- SQLSetDescField.lo libMonetODBC_la-SQLSetDescRec.lo libMonetODBC_la- SQLSetEnvAttr.lo libMonetODBC_la-SQLSetParam.lo libMonetODBC_la-SQLSetPos.lolibMonetODBC_la- SQLSetScrollOptions.lo libMonetODBC_la-SQLSetStmtAttr.lo libMonetODBC_la- SQLSetStmtOption.lo libMonetODBC_la-SQLSpecialColumns.lo libMonetODBC_la- SQLStatistics.lo libMonetODBC_la-SQLTablePrivileges.lo libMonetODBC_la- SQLTables.lo libMonetODBC_la-SQLTransact.lo ../../mapilib/libMapi.la -L/opt/monetdb/lib -lstream -liconv libtool: link: symbol file `ODBC.def' does not exist make[7]: *** [libMonetODBC.la] Error 1 make[6]: *** [all] Error 2 make[5]: *** [all-recursive] Error 1 make[4]: *** [all] Error 2 make[3]: *** [all-recursive] Error 1 make[2]: *** [all] Error 2 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 making MonetDB-client failed I'll keep trying!

2 1