BS4 error from samair proxy parser

Question

BS4 error from samair proxy parser

Hessu1337 opened this issue 7 years ago · 4 comments

File "/usr/lib/python3.6/site-packages/http_request_randomizer/requests/proxy/requestProxy.py", line 55, in __init__ self.proxy_list += parsers[i].parse_proxyList() File "/usr/lib/python3.6/site-packages/http_request_randomizer/requests/parsers/SamairProxyParser.py", line 42, in parse_proxyList headings = [th.get_text() for th in table.find("tr").find_all("th")] AttributeError: 'NoneType' object has no attribute 'find'

Answer 1 · 2017-07-05T17:35:25.000Z

Hello @Hessu1337

Samair proxy provider looks unreachable to me. For instance, http://samair.ru/proxy/time-01.htm page returns a 404 error - that's why the specific proxy provider is skipped when I am listing all the available proxies. Are you sure the provider is reachable?

Cheers,
Panagiotis

Answer 2 · 2017-07-05T18:49:06.000Z

Hi @pgaref ,

It's reachable for me, I made a pull request with bs4 findAll fix and working like a charm here.

Answer 3 · 2017-07-05T18:59:04.000Z

Hello @Hessu1337

I guess they introduced geo-restrictions. May I ask the location(country) of your parser?
Thanks for the PR, please check some inline comments.

Cheers,
Panagiotis

Answer 4 · 2017-07-05T19:43:48.000Z

Of course, the ip location is based in France.