analyseether/ether_sql

While using mode parallel the settings specified while switching on the celery workers is used to perform sync

Opened this issue · 0 comments

Describe the bug
While using mode parallel the settings specified while switching on the celery workers is used to perform sync. This is not a desired behaviour since this might cause several errors.

Either use a common configuration file or stop scraping if the settings varibles beteen the two processes are not same.

To Reproduce
Steps to reproduce the behavior:
Start celery with default settings

ether_sql celery start -c2

Start the scraping with non default settings
ether_sql --settings=PersonalSettings scrape_block_range --end_block_number=100 --mode=parallel

The scraping will be performed using the default settings and not the setting specified during second command.

Expected behavior
We expect the same setting to be used for both celery and scraping