Add custom options to guzzle client
jg-development opened this issue · 4 comments
The crawler is very nice, but I am missing the option to add custom (or more) options to the guzzle client.
Like the option to use a custom user agent/custom headers or just the verify flag to false.
Is this a possible future option?
The underlying Crawler accepts Guzzle options via the constructor.
I'd accept a simple, non-breaking, fully tested PR that adds one of more of the following:
- a command option that sets the verify flag to false.
- a command option that sets the user agent
- a command option that can pass any arbitrary to the Crawler.
For this, I have to make changes to spatie/crawler as both verify and user-agent aren't accepted in the constructor (as to my knowledge, have to do some more digging). Can make that PR too if required 👍
Ya but crawler constructor is just passing this args to Guzzle client constructor and these things need to be set in header and other places. I will PR with passing it to the constructor