tasos-py/Search-Engines-Scraper

How to use proxy server?

matalab opened this issue · 2 comments

Hello, can you please explain how to set and use a proxy?

Sure, it's easy. If you use the CLI script you can use the -proxy argument,

$ python search_engines_cli.py -e google -q "query" -proxy "http://127.0.0.1:8080"

and if you import it use the 1st argument in the constructor,

proxy = "http://127.0.0.1:8080"
engine = Google(proxy)

Thank you, both for the answer and for your great package!
Do you have any recommendation on free and paid proxy lists/APIs?