[MonetDB-users] Information about Loader

newer
[MonetDB-users] Normalization

older
[MonetDB-users] Clustering,...

Lowterm

18 Jul 2011 18 Jul '11

3:47 p.m.

Hi,

I need some information about MonetDB Loader. Where can I find it? Is there any documentation about it?

Thanks

-- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32084241.html Sent from the monetdb-users mailing list archive at Nabble.com.

Show replies by date

Ying Zhang

18 Jul 18 Jul

4:47 p.m.

New subject: [MonetDB-users] Information about Loader

Hi,

I'm not if I understand your "MonetDB Loader" correctly. I guess you want to load data into monet. To populate your database with a small amount of data, you can just use the INSERT statement. For fast loading of a large amount of data, monet provides commands for bulk I/O. Please have a look at this page: http://www.monetdb.org/Documentation/Manuals/SQLreference/CopyInto

Regards,

Jennie

On Mon, Jul 18, 2011 at 08:47:52AM -0700, Lowterm wrote:

...

Hi,

I need some information about MonetDB Loader. Where can I find it? Is there any documentation about it?

Thanks

View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32084241.html Sent from the monetdb-users mailing list archive at Nabble.com.

AppSumo Presents a FREE Video for the SourceForge Community by Eric Ries, the creator of the Lean Startup Methodology on "Lean Startup Secrets Revealed." This video shows you how to validate your ideas, optimize your ideas and identify your business strategy. http://p.sf.net/sfu/appsumosfdev2dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

Lowterm

5:13 p.m.

New subject: [MonetDB-users] Information about Loader

Hi,

thanks for your reply. I need some general information about how it works.

Thanks

-- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32084868.html Sent from the monetdb-users mailing list archive at Nabble.com.

Martin Kersten

5:58 p.m.

New subject: [MonetDB-users] Information about Loader

On 7/18/11 7:13 PM, Lowterm wrote:

...

Hi,

thanks for your reply. I need some general information about how it works.

See for the use cases. http://www.monetdb.org/Documentation/Manuals/SQLreference/CopyInto http://www.monetdb.org/Documentation/Cookbooks/SQLrecipies/Attach

Implementation wise it exploits multi-core loading. The source code gives all the glory details ;)

regards, Martin

...

Thanks

Lowterm

19 Jul 19 Jul

8:15 a.m.

New subject: [MonetDB-users] Information about Loader

Hi,

thanks. But I need another information for example: How fast is the MonetDB-Bulk-Loader and How fast is the MonetDB-Bulk-Loader in comparison to an insert statement. Is there another or faster commands/way except copy into.

Thanks

Lowterm wrote:

...

Hi,

I need some information about MonetDB Loader. Where can I find it? Is there any documentation about it?

Thanks

-- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32089117.html Sent from the monetdb-users mailing list archive at Nabble.com.

Stefan Manegold

9:18 a.m.

New subject: [MonetDB-users] Information about Loader

In general, bulk loading is considerably (much) faster than insert statements.

The details depend on many parameters, among others the hardware (CPU type, number of CPU cores, amount of memory, bandwidth and latency of I/O subsystem, etc.), the operating system, and the data characteristics (data types, number of columns, number of records, data volume, etc.).

Experimental assessment is required to reveal specific dateils.

Stefan

On Tue, Jul 19, 2011 at 01:15:41AM -0700, Lowterm wrote:

...

Hi,

thanks. But I need another information for example: How fast is the MonetDB-Bulk-Loader and How fast is the MonetDB-Bulk-Loader in comparison to an insert statement. Is there another or faster commands/way except copy into.

Thanks

Lowterm

9:32 a.m.

New subject: [MonetDB-users] Information about Loader

Hi Stefan,

thanks. That is clear. However, this applies for all other loader from other databases. But what MongoDB loader different from the others. Why should I just opt for this loader. What distinguishes the MonetDB-loader?

Thanks

Stefan Manegold wrote:

...

In general, bulk loading is considerably (much) faster than insert statements.

The details depend on many parameters, among others the hardware (CPU type, number of CPU cores, amount of memory, bandwidth and latency of I/O subsystem, etc.), the operating system, and the data characteristics (data types, number of columns, number of records, data volume, etc.).

Experimental assessment is required to reveal specific dateils.

Stefan

On Tue, Jul 19, 2011 at 01:15:41AM -0700, Lowterm wrote:

...
Hi,

thanks. But I need another information for example: How fast is the MonetDB-Bulk-Loader and How fast is the MonetDB-Bulk-Loader in comparison to an insert statement. Is there another or faster commands/way except copy into.

Thanks

-- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

Magic Quadrant for Content-Aware Data Loss Prevention Research study explores the data loss prevention market. Includes in-depth analysis on the changes within the DLP market, and the criteria used to evaluate the strengths and weaknesses of these DLP solutions. http://www.accelacomm.com/jaw/sfnl/114/51385063/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

-- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32089531.html Sent from the monetdb-users mailing list archive at Nabble.com.

4687

Age (days ago)

4688

Last active (days ago)

List overview

Download

6 comments

4 participants

tags (0)

participants (4)

Lowterm
Martin Kersten
Stefan Manegold
Ying Zhang