[Monetdb-developers] IMPORTANT: imminent change to repositories
This is a heads up. Read this. It affects all developers (however, developers only fixing bugs on the stable branch can postpone reading this).
MonetDB Repository Split Into Three
This whole story *only* affects the CURRENT branch, the STABLE branch is totally unaffected by the changes described here.
This change is *imminent*. It will probably happen today. There will be CVS tags before and after.
The MonetDB repository will be split into three repositories. One repository will contain the fundamentals of MonetDB (GDK) and other common stuff that is used by all other subprojects (src/common). This repository remains called MonetDB. Another repository will be clients. This repository contains all client libraries and programs. It is independent from the GDK part of MonetDB, but it does depend on the common libraries. The final repository will be MonetDB4 which contains the MIL-specific part of the old MonetDB repository.
The new layout of the MonetDB family is the following repositories: - buildtools contains the stuff that is needed to compile any of the following from CVS; - MonetDB containing GDK and common, i.e. stuff that forms the core of the MonetDB family and stuff that is generally useful (src/common); - clients contains libraries and programs that connect to the various servers, i.e. the Mapi library (in several languages), ODBC, JDBC. - MonetDB4 contains the MonetDB4-specific parts, i.e. stuff like the MIL parser and execution engine (src/monet), and the MonetDB4 modules; - MonetDB5 (still at CWI repository as monet5, to be moved to SourceForge "soon") contains the MonetDB5-specific parts, i.e. stuff like the MAL parser and execution engine and the MonetDB5 modules; - sql contains the SQL frontend; - pathfinder contains the XQuery frontend.
And then there are of course the other repositories amdb, xml, template, etc.
Dependencies
This is written in the suggested order of compilation and installation.
When compiling from CVS, you always need buildtools, and this needs to be compiled and installed first.
MonetDB does not depend on anything else.
clients depends on MonetDB (specifically on src/common).
MonetDB4 depends on MonetDB and clients. It depends on clients only for the embedded library and programs using that library.
MonetDB5 depends on MonetDB and clients (and *not* on MonetDB4). It depends on clients only for the embedded library and programs using that library.
sql depends on MonetDB, clients, and MonetDB4; but if you want MonetDB5 support, also on MonetDB5 (the dependency should become: at least one of MonetDB4 and MonetDB5, i.e. either one or both backends).
pathfinder depends on MonetDB, clients, and MonetDB4; but if you want MonetDB5 support, also on MonetDB5 (the dependency should become: at least one of MonetDB4 and MonetDB5, but the port to MonetDB5 needs to be finished first...).
Other Changes
The scripts bootstrap, de-bootstrap, and conf/conf.bash have been moved to the buildtools repository. Replacement scripts have been put in place that use the scripts that get installed when buildtools is installed.
A C source file should now include the project's own config.h file (i.e. pf_config.h for pathfinder, mal_config.h for MonetDB5, etc.) as the first include in the C file. The config.h file should not be included in H files that get installed and used by other projects. In particular, gdk.h and monet_utils.h now no longer include monetdb_config.h.
A project's configure script now has to perform all the configure tests that are needed for .h files that are included from other projects. Most of the required tests for the stuff in MonetDB are now done in the call to AM_MONETDB_COMMON (if any are missing, that is a (lowish priority) bug and should be fixed).
Future Changes
The changes described here have not happened. They are thoughts for future work.
More configure and header file cleanup. In an ideal world, we have header files that are used externally which do not contain and #ifdef HAVE_* sections, and header files that are used internally that can contain such sections. Also, it should be possible to figure out at configure time from the already installed parts either the correct options (such as how wide the OID type is), or that the given options are not compatible with the installed parts (and give a configure error). Currently it is the developer's responsibility to make sure that configure options are compatible.
On Mon, Jan 01, 2007 at 11:36:10AM +0100, Arjen P. de Vries wrote:
MonetDB does not depend on anything else.
In directory MonetDB, I had to link conf/rules.mk to rules.mk for making to start working;
What was/is the exact problem ?
The link should (must!) not be necessary, in case you have all your sources up-to-date --- at least for me and nightly testing everything (i.e., buildtools, MonetDB, clients, MonetDB4, MonetDB5, template, sql, pathfinder) works out-of-the-box, now --- amdb, xml, pruning still need (quite?) some work (volunteers?) --- well, me and nightly testing use conf/conf.bash to set the environment and use different build- & prefix- directories for each CVS module --- individual build-directories are highly advised (if not mandatory), a shared prefix-directory should work fine; conf/conf.bash should not be required in case you have <prefix>/bin in your path.
Stefan
later more,
Arjen
Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=D... _______________________________________________ Monetdb-developers mailing list Monetdb-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers
Happy new year!
With new challenging monetdb problems :-)
On 01/01/07, Stefan Manegold Stefan.Manegold@cwi.nl wrote:
On Mon, Jan 01, 2007 at 11:36:10AM +0100, Arjen P. de Vries wrote:
MonetDB does not depend on anything else.
In directory MonetDB, I had to link conf/rules.mk to rules.mk for making to start working;
What was/is the exact problem ?
The problem is that rules.mk was not created, and that make includes *.mk and therefore refused to continue.
Sorry, but I have *really* no time to dig into it deeper - I should not even be compiling right now, but be rewriting my proposal! am just reporting my problems so people could investigate if they think it makes sense. And yes, they could also just ignore it because the test environment does not have these problems, fine with me.
The link should (must!) not be necessary, in case you have all your sources up-to-date --- at least for me and nightly testing everything (i.e., buildtools, MonetDB, clients, MonetDB4, MonetDB5, template, sql, pathfinder) works out-of-the-box, now --- amdb, xml, pruning still need (quite?) some work (volunteers?) --- well, me and nightly testing use conf/conf.bash to set the environment and use different build- & prefix- directories for each CVS module --- individual build-directories are highly advised (if not mandatory), a shared prefix-directory should work fine; conf/conf.bash should not be required in case you have <prefix>/bin in your path.
I use . conf/conf.bash, and a separate build dir per project.
The problem occurred already for the first one, i.e., MonetDB.
Stefan
later more,
Arjen
Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=D... _______________________________________________ Monetdb-developers mailing list Monetdb-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers
-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |
On Tue, Jan 02, 2007 at 11:12:15AM +0100, Arjen P. de Vries wrote:
Happy new year!
Happy new year!
With new challenging monetdb problems :-)
On 01/01/07, Stefan Manegold Stefan.Manegold@cwi.nl wrote:
On Mon, Jan 01, 2007 at 11:36:10AM +0100, Arjen P. de Vries wrote:
MonetDB does not depend on anything else.
In directory MonetDB, I had to link conf/rules.mk to rules.mk for making to start working;
What was/is the exact problem ?
The problem is that rules.mk was not created, and that make includes *.mk and therefore refused to continue.
- make sure you have the latest buildtools indtalled and in your PATH (& PYTHONPATH). - make sure you don't have any legacy MonetDB related (non-empty) BUILD and/or PREFIX dirs lying around.
Sorry, but I have *really* no time to dig into it deeper - I should
well, I didn't mean to ask for any deeper analysis.
The very error message was enough.
Stefan
not even be compiling right now, but be rewriting my proposal! am just reporting my problems so people could investigate if they think it makes sense. And yes, they could also just ignore it because the test environment does not have these problems, fine with me.
The link should (must!) not be necessary, in case you have all your sources up-to-date --- at least for me and nightly testing everything (i.e., buildtools, MonetDB, clients, MonetDB4, MonetDB5, template, sql, pathfinder) works out-of-the-box, now --- amdb, xml, pruning still need (quite?) some work (volunteers?) --- well, me and nightly testing use conf/conf.bash to set the environment and use different build- & prefix- directories for each CVS module --- individual build-directories are highly advised (if not mandatory), a shared prefix-directory should work fine; conf/conf.bash should not be required in case you have <prefix>/bin in your path.
I use . conf/conf.bash, and a separate build dir per project.
The problem occurred already for the first one, i.e., MonetDB.
Stefan
later more,
Arjen
Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=D... _______________________________________________ Monetdb-developers mailing list Monetdb-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers
-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |
--
CWI, room C1.16 Centre for Mathematics and Computer Science Kruislaan 413 Email: Arjen.de.Vries@cwi.nl 1098 SJ Amsterdam tel: +31-(0)20-5924306 The Netherlands fax: +31-(0)20-5924312 ===================== http://www.cwi.nl/~arjen/ ====================
Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=D... _______________________________________________ Monetdb-developers mailing list Monetdb-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers
Hmm, pretty stuck now; which one do you give highest priority?
I have buildtools installed, but not sure if there are no traces of an older one... would on older installed MonetDB in MONETDB_PREFIX be a problem?
On 02/01/07, Stefan Manegold Stefan.Manegold@cwi.nl wrote:
On Tue, Jan 02, 2007 at 11:12:15AM +0100, Arjen P. de Vries wrote:
Happy new year!
Happy new year!
With new challenging monetdb problems :-)
On 01/01/07, Stefan Manegold Stefan.Manegold@cwi.nl wrote:
On Mon, Jan 01, 2007 at 11:36:10AM +0100, Arjen P. de Vries wrote:
MonetDB does not depend on anything else.
In directory MonetDB, I had to link conf/rules.mk to rules.mk for making to start working;
What was/is the exact problem ?
The problem is that rules.mk was not created, and that make includes *.mk and therefore refused to continue.
- make sure you have the latest buildtools indtalled and in your PATH (& PYTHONPATH).
- make sure you don't have any legacy MonetDB related (non-empty) BUILD and/or PREFIX dirs lying around.
Sorry, but I have *really* no time to dig into it deeper - I should
well, I didn't mean to ask for any deeper analysis.
The very error message was enough.
Stefan
not even be compiling right now, but be rewriting my proposal! am just reporting my problems so people could investigate if they think it makes sense. And yes, they could also just ignore it because the test environment does not have these problems, fine with me.
The link should (must!) not be necessary, in case you have all your sources up-to-date --- at least for me and nightly testing everything (i.e., buildtools, MonetDB, clients, MonetDB4, MonetDB5, template, sql, pathfinder) works out-of-the-box, now --- amdb, xml, pruning still need (quite?) some work (volunteers?) --- well, me and nightly testing use conf/conf.bash to set the environment and use different build- & prefix- directories for each CVS module --- individual build-directories are highly advised (if not mandatory), a shared prefix-directory should work fine; conf/conf.bash should not be required in case you have <prefix>/bin in your path.
I use . conf/conf.bash, and a separate build dir per project.
The problem occurred already for the first one, i.e., MonetDB.
Stefan
later more,
Arjen
Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=D... _______________________________________________ Monetdb-developers mailing list Monetdb-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers
-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |
--
CWI, room C1.16 Centre for Mathematics and Computer Science Kruislaan 413 Email: Arjen.de.Vries@cwi.nl 1098 SJ Amsterdam tel: +31-(0)20-5924306 The Netherlands fax: +31-(0)20-5924312 ===================== http://www.cwi.nl/~arjen/ ====================
Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=D... _______________________________________________ Monetdb-developers mailing list Monetdb-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers
-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |
participants (3)
-
Arjen P. de Vries -
Sjoerd Mullender -
Stefan Manegold