18520339/facebook-data-extraction

Proxy List Exception

ReemOmer opened this issue · 1 comments

Hi, thanks for sharing this great project. While I am trying to test it using Tor browser configuration, and setting:
USE_PROXY = False in crawler.py file. I keep getting the following error:

raise ProxyListException("list is empty") http_request_randomizer.requests.errors.ProxyListException.ProxyListException: list is empty
in the requestProxy.py file. Anything that probably went wrong?
Also, is there any tutorial that covers the configuration when using Tor as a browser to collect data?

Thanks

Hi, sorry for the late replying. You can solve it according to this link and tell me if it works.
About the tutorial, I cant find any as you mentioned, so I just did lots of research by myself to implement these scripts.
Btw, you can try the first method, I think it's the easiest way to extract data now.