[MonetDB-users] how to run TPC-H benchmark on MonetDB
hi,
I am a beginner of MonetDB. I want to run TPC-H benchmark on MonetDB. I found there are SQL queries and related files under monetdb source folder <monetdb-source>/sql/src/benchmark/tpch. I ran the script 'run.all'. But that gave me many errors and did not succeed. Can anyone describe briefly the steps I need to carry out in order to run TPC-H benchmark? Any documentations I can refer to is highly appreciated.
Thank you.
First of all, thanks for using MonetDB.
If you are only interested on the results, in this link you can find the results for the TPC-H benchmark on MonetDB. http://monetdb.cwi.nl/projects/monetdb//SQL/Benchmark/TPCH/
Regards, Romulo
xxiao wrote:
hi,
I am a beginner of MonetDB. I want to run TPC-H benchmark on MonetDB. I found there are SQL queries and related files under monetdb source folder <monetdb-source>/sql/src/benchmark/tpch. I ran the script 'run.all'. But that gave me many errors and did not succeed. Can anyone describe briefly the steps I need to carry out in order to run TPC-H benchmark? Any documentations I can refer to is highly appreciated.
Thank you.
xxiao wrote:
hi,
I am a beginner of MonetDB. I want to run TPC-H benchmark on MonetDB. I found there are SQL queries and related files under monetdb source folder <monetdb-source>/sql/src/benchmark/tpch. I ran the script 'run.all'. But that gave me many errors and did not succeed. Can anyone describe briefly the steps I need to carry out in order to run TPC-H benchmark? Any documentations I can refer to is highly appreciated.
Thank you.
Dear Xxiao
The platform you are working on should be reported to be more specific on the answer.
The TPC-H benchmarks work on Linux systems. They are ran every night with the Mtest.py utility. The results are visible on the web: http://monetdb.cwi.nl/testing/projects/monetdb/Current/sql5/.mTests103/index...
Please have a look at your installation and ensure yourself that the system is installed properly. Thereafter, you might use Mtest.py --help for more information.
On Wed, Sep 26, 2007 at 01:25:17PM -0700, xxiao wrote:
hi,
I am a beginner of MonetDB. I want to run TPC-H benchmark on MonetDB. I found there are SQL queries and related files under monetdb source folder <monetdb-source>/sql/src/benchmark/tpch. I ran the script 'run.all'. But that gave me many errors and did not succeed. Can anyone describe briefly the steps I need to carry out in order to run TPC-H benchmark? Any documentations I can refer to is highly appreciated.
Thanks for trying MonetDB.
The run.all script is mostly used internal but you could adapted. 1) it requires a running MonetDB/SQL server 2) Then you need to load the data (use the load.sh script for this) By default this will load the 0.01 scale factor of the tpc-H benchmark (the only scale factor for which the data is in the source repository). You could generate different sizes using the dbgen tool inside the dbgen subdirectory.
3) Now run.all should work.
Niels
Thank you.
-- View this message in context: http://www.nabble.com/how-to-run-TPC-H-benchmark-on-MonetDB-tf4524693.html#a... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Hi, Niels
Thank you for your reply.
I succeeded in loading data by load.sh and executing queries by run.all. Then, I want to compare my query execution result against the reference result, which is provided in xx.ans.
How can I generate the same format as xx.ans? Furthermore, a visual inspection of my query execution results indicate that my results does not match the results stated in xx.ans files.
For example, 01.sql results are as follows:
% sys.lineitem, sys.lineitem, sys.lineitem, sys.lineitem, sys., sys., sys.lineitem, sys., sys., sys.lineitem # table_name % l_returnflag, l_linestatus, sum_qty, sum_base_price, sum_disc_price, sum_charge, avg_qty, avg_price, avg_disc, count_order # name % varchar, varchar, bigint, decimal, decimal, decimal, double, double, double, int # type % 1, 1, 6, 17, 21, 21, 22, 22, 22, 5 # length [ "A", "F", 380456, 532348211.65, 505822441.4861, 526165934.000839, 25.575154611454693, 35785.709306937351, 0.050081339069642378, 14876 ] [ "N", "F", 8971, 12384801.37, 11798257.2080, 12282485.056933, 25.778735632183906, 35588.509683908051, 0.047758620689655168, 348 ] [ "N", "O", 742802, 1041502841.45, 989737518.6346, 1029418531.523350, 25.454987834549879, 35691.129209074395, 0.049931119564099929, 29181 ] [ "R", "F", 381449, 534594445.35, 507996454.4067, 528524219.358903, 25.597168165346933, 35874.006532680178, 0.049827539927526504, 14902 ]
My MonetDB versions are: monetdb-config --version 1.21.0 monetdb-clients-config --version 1.21.0 monetdb4-config --version 4.21.0 MonetDB/SQL module v2.21.0
hardware: uname -a Linux mmdb.sl113 2.6.18-1.2798.fc6xen #1 SMP Mon Oct 16 15:11:19 EDT 2006 i686 athlon i386 GNU/Linux
thanks a lot for your inputs.
Xiang
Niels Nes wrote:
On Wed, Sep 26, 2007 at 01:25:17PM -0700, xxiao wrote:
hi,
I am a beginner of MonetDB. I want to run TPC-H benchmark on MonetDB. I found there are SQL queries and related files under monetdb source folder <monetdb-source>/sql/src/benchmark/tpch. I ran the script 'run.all'. But that gave me many errors and did not succeed. Can anyone describe briefly the steps I need to carry out in order to run TPC-H benchmark? Any documentations I can refer to is highly appreciated.
Thanks for trying MonetDB.
The run.all script is mostly used internal but you could adapted.
- it requires a running MonetDB/SQL server
- Then you need to load the data (use the load.sh script for this) By default this will load the 0.01 scale factor of the tpc-H benchmark (the only scale factor for which the data is in the source repository). You could generate different sizes using the dbgen tool inside the
dbgen subdirectory.
- Now run.all should work.
Niels
Thank you.
-- View this message in context: http://www.nabble.com/how-to-run-TPC-H-benchmark-on-MonetDB-tf4524693.html#a... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
On Thu, Sep 27, 2007 at 08:37:56AM -0700, xxiao wrote:
Hi, Niels
Thank you for your reply.
I succeeded in loading data by load.sh and executing queries by run.all. Then, I want to compare my query execution result against the reference result, which is provided in xx.ans.
The xx.ans are coming from the tpc-h website and are for the scale factor 1. For the 0.01 we have output in the subdirectory Tests (this is tested every night).
For other sizes the do not have output available (nor has the tpc).
Niels
How can I generate the same format as xx.ans? Furthermore, a visual inspection of my query execution results indicate that my results does not match the results stated in xx.ans files.
For example, 01.sql results are as follows:
% sys.lineitem, sys.lineitem, sys.lineitem, sys.lineitem, sys., sys., sys.lineitem, sys., sys., sys.lineitem # table_name % l_returnflag, l_linestatus, sum_qty, sum_base_price, sum_disc_price, sum_charge, avg_qty, avg_price, avg_disc, count_order # name % varchar, varchar, bigint, decimal, decimal, decimal, double, double, double, int # type % 1, 1, 6, 17, 21, 21, 22, 22, 22, 5 # length [ "A", "F", 380456, 532348211.65, 505822441.4861, 526165934.000839, 25.575154611454693, 35785.709306937351, 0.050081339069642378, 14876 ] [ "N", "F", 8971, 12384801.37, 11798257.2080, 12282485.056933, 25.778735632183906, 35588.509683908051, 0.047758620689655168, 348 ] [ "N", "O", 742802, 1041502841.45, 989737518.6346, 1029418531.523350, 25.454987834549879, 35691.129209074395, 0.049931119564099929, 29181 ] [ "R", "F", 381449, 534594445.35, 507996454.4067, 528524219.358903, 25.597168165346933, 35874.006532680178, 0.049827539927526504, 14902 ]
My MonetDB versions are: monetdb-config --version 1.21.0 monetdb-clients-config --version 1.21.0 monetdb4-config --version 4.21.0 MonetDB/SQL module v2.21.0
hardware: uname -a Linux mmdb.sl113 2.6.18-1.2798.fc6xen #1 SMP Mon Oct 16 15:11:19 EDT 2006 i686 athlon i386 GNU/Linux
thanks a lot for your inputs.
Xiang
Niels Nes wrote:
On Wed, Sep 26, 2007 at 01:25:17PM -0700, xxiao wrote:
hi,
I am a beginner of MonetDB. I want to run TPC-H benchmark on MonetDB. I found there are SQL queries and related files under monetdb source folder <monetdb-source>/sql/src/benchmark/tpch. I ran the script 'run.all'. But that gave me many errors and did not succeed. Can anyone describe briefly the steps I need to carry out in order to run TPC-H benchmark? Any documentations I can refer to is highly appreciated.
Thanks for trying MonetDB.
The run.all script is mostly used internal but you could adapted.
- it requires a running MonetDB/SQL server
- Then you need to load the data (use the load.sh script for this) By default this will load the 0.01 scale factor of the tpc-H benchmark (the only scale factor for which the data is in the source repository). You could generate different sizes using the dbgen tool inside the
dbgen subdirectory.
- Now run.all should work.
Niels
Thank you.
-- View this message in context: http://www.nabble.com/how-to-run-TPC-H-benchmark-on-MonetDB-tf4524693.html#a... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
--
Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- View this message in context: http://www.nabble.com/how-to-run-TPC-H-benchmark-on-MonetDB-tf4524693.html#a... Sent from the monetdb-users mailing list archive at Nabble.com.
This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
participants (4)
-
Martin Kersten -
Niels Nes -
Romulo Goncalves -
xxiao