sindresorhus/capture-website

Referer should be configurable

JaimeObregon opened this issue · 1 comments

JaimeObregon commented

Puppeteer's page.goto options are currently hardcoded:

	await page[isHTMLContent ? 'setContent' : 'goto'](input, {
		timeout: timeoutInSeconds,
		waitUntil: 'networkidle2'
	});

But certain pages, such as news articles from ft.com, display different content depending on the user request' referer header.

I'd suggest exposing page.goto options as a configurable object.

sindresorhus commented

I think it's better to just expose a referer option.

  • 👍1