Option to provide headers and cookies
nekromoff opened this issue · 1 comments
nekromoff commented
Would it be possible to add an option to provide any generic HTTP headers (currently only User-agent is available) and cookies via CLI?
Cookies could be included as files or in other reasonable way. Even YAML could work for this similar to existing authentication options.
nekromoff commented
I needed this mostly for cookies, but I found solution by using Javascript to hide cookie banners:
https://shot-scraper.datasette.io/en/stable/screenshots.html#executing-custom-javascript
https://shot-scraper.datasette.io/en/stable/screenshots.html#tips-for-executing-javascript