TeamHG-Memex/scrapy-rotating-proxies

Possibility to use proxies from DB?

fparareda opened this issue · 1 comments

Hello, I would like to ask you if you have a way to connect your marvelous middleware with a DB (sql or no-sql). Do you think that it is possible and useful?

Thank you in advance

You can get proxies from wherever you want, like this:

def get_proxy_list():
    # Request your DB here
    return proxy_list

ROTATING_PROXY_LIST = get_proxy_list()