Sure,

The following is the trace result of the last release which takes 87msec
+------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| usec | statement                                                                                                                                       |
+======+=================================================================================================================================================+
|    4 | X_1=0@0:void := querylog.define("trace create remote table rmt_tbl8 (c1 int) on \\'mapi:monetdb://127.0.0.1:50000/voc3/sys/data\\';":str, "defa |
:      : ult_pipe":str, 10:int); #[1] (0) QLOGdefineNaive 1 <- 2 3 15                                                                                    :
|   78 | sqlcatalog.create_table("sys":str, "rmt_tbl8":str, 0x7f22dc193190:ptr, 0:int); #[2] (0) SQLcreate_table 13 <- 8 10 12 6                         |
|    1 | sql.exportOperation(); #[3] (0) mvc_export_operation_wrap 14                                                                                    |
+------+————————————————————————————————————————————————————————————————————————+

And this is the trace result of the older version which takes 4msec

+------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| usec | statement                                                                                                                                       |
+======+=================================================================================================================================================+
|  212 | X_1=0@0:void := querylog.define("trace create remote table rmt_tbl9 (c1 int) on \\'mapi:monetdb://127.0.0.1:50000/voc3/sys/data\\';":str, "defa |
:      : ult_pipe":str, 10:int);                                                                                                                         :
|  666 | sqlcatalog.create_table("sys":str, "rmt_tbl9":str, nil:ptr, 0:int);                                                                             |
|  103 | sql.exportOperation();                                                                                                                          |
+------+-------------------------------------------------------------------------------------------------------------------------------------------------+

On 10 Jul 2020, at 5:31 PM, Ying Zhang <Y.Zhang@cwi.nl> wrote:

maybe you can prefix the queries with TRACE to look deeper into the execution of these queries to see where the time was spent?

On 10 Jul 2020, at 16:22, Ioannis Foufoulas <johnfouf@di.uoa.gr> wrote:

Probably not, but I ‘m trying to figure out why in versions prior to Aug.2018  I ‘m getting this:

sql>CREATE REMOTE TABLE rmt_tbl (c1 int) ON 'mapi:monetdb://127.0.0.1:50000/voc3/sys/data';
operation successful
sql:0.000 opt:0.359 run:0.473 clk:4.634 ms

While in versions after Aug. 2018 I have:
sql>CREATE REMOTE TABLE rmt_tbl (c1 int) ON 'mapi:monetdb://127.0.0.1:50000/voc3/sys/data';
operation successful
sql:0.000 opt:0.068 run:0.057 clk:87.766 ms

On 10 Jul 2020, at 4:51 PM, Ying Zhang <Y.Zhang@cwi.nl> wrote:



On 10 Jul 2020, at 15:26, Ioannis Foufoulas <johnfouf@di.uoa.gr> wrote:

Hi,
I am trying to develop a Python client which sends queries to different Monetdb servers and transfers the results between them using the remote tables functionalities.
I’ve seen than my main overhead is execution of CREATE REMOTE TABLE statement. It requires 70-90msec  so in cases with many transfers and fast and small queries this
makes a difference. After looking at some older versions I’ve seen that the creation of a remote table was very fast before August 2018 (this is when authentication added).
Is there any hint on this? Could the. authentication strategy change in someway so that it runs faster or is it possible to select among different authentication methods for the remote tables?

Not sure if that’s the cause of the overhead, but better authentication was indeed added since Aug2018 (https://www.monetdb.org/blog/remote-tables-auth)

Jennie


Best,
Yannis


_______________________________________________
users-list mailing list
users-list@monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________
users-list mailing list
users-list@monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________
users-list mailing list
users-list@monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________
users-list mailing list
users-list@monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list