mymarilyn/aioch

How to execute queries on the clickhouse cluster simultaneously

ghuname opened this issue · 0 comments

Hi,

Let's say that I have 10 nodes clickhouse server.
Let's say that I have 50 queries that I would like to execute on each node's distributed table and get results (in pandas dataframe).

I have seen an example on https://docs.python.org/3/library/asyncio-queue.html (bottom of the page), but I don't know how to use aioch for the same purpose.

My situation is that I should have 50 queries (sleep_for), and 10 tasks.

As soon as one query is finished free server should take another query and execute it.

Has someone done something like that?

Regards.