ptrstn/dailyblink

Error: Detected a Cloudflare version 2 Captcha challenge, This feature is not available in the opensource (free) version.

antifarben opened this issue · 11 comments

antifarben commented

I'm getting a CloudflareChallengeError but it seems that there's no mention on what to do now?

Downloading the free daily Blinks...

cloudscraper.exceptions.CloudflareChallengeError: Detected a Cloudflare version 2 Captcha challenge, This feature is not available in the opensource (free) version.

Do you have any advice?

dodo041 commented

For me the tool returns a 403 status code, which I assume is an issue also occuring because of Cloudflare:

  File "...\Python\Python37\site-packages\dailyblink\blinkist.py", line 79, in request_category_urls
    response.raise_for_status()
  File "...\Anaconda3\lib\site-packages\requests\models.py", line 940, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://www.blinkist.com/de/nc/books/

I assume this, beacuse I tried to make such a downloading tool by myself, and previous tests with an online REST client showed the same results, with the response showing a Cloudflare site. See this link: https://reqbin.com/j13jf3l2 and check the "HTML" tab on the right side.

Maybe this is worth a new issue, if not related to the actual comment?

stirl021 commented

cloudscraper.exceptions.CloudflareCaptchaProvider: Cloudflare Captcha detected, unfortunately you haven't loaded an anti Captcha provider correctly via the 'captcha' parameter.

EugenZimmermann commented

I had this cloudflare issue a couple of times now. Just repeat the starting the script until it runs. Sometimes it takes up to 5 to 6 times for me.

  • 👍2
ptrstn commented

I was able to reproduce this issue. As @EugenZimmermann mentioned you can just run the script again and it should (eventually) work.

I am not sure yet what causes this issue. If anyone has a hint, let me know.

ptrstn commented

If this problem continues to grow, other approaches to bypass the cloudfront protection should be explored.

Some possibilities are discussed here:

I think it would come down to using browser based methods, like trying to fetch the data with selenium or assisted scraping.

ptrstn commented

I have implemented a workaround for this issue in #13. It now tries to repeat the download attempt up to 10 times with a waiting time of 2 seconds in between.

fugohan commented

Maybe it would be better if to randomize the waiting time?

ptrstn commented

Maybe it would be better if to randomize the waiting time?

Thanks for your suggestion.

While I understand your argument, I still think its unnecessary and would add redundant complexity to the code base.
Most of the time the first attempt works anyways.

mapitas commented

I'm facing same issue.

[i] : Trying to login as (*****)
cloudscraper.exceptions.CloudflareChallengeError: Detected a Cloudflare version 2 Captcha challenge, This feature is not available in the opensource (free) version.

Any suggestion?

ptrstn commented

I'm facing same issue.

[i] : Trying to login as (*****) cloudscraper.exceptions.CloudflareChallengeError: Detected a Cloudflare version 2 Captcha challenge, This feature is not available in the opensource (free) version.

Any suggestion?

did you update the tool?

python -m pip install --upgrade --user git+https://github.com/ptrstn/dailyblink
  • ❤️1