Scraping-knife is an aggregating tool that provides an easy way to add libraries to a web page when you scraping the page.
npm install --save scraping-knifeFor example we can inject scraping-knife to web page by puppeteer
const browser = await puppeteer.launch();
const page = await browser.newPage();
await page.setBypassCSP(true);
await page.goto(pageUrl);
await page.addScriptTag({
path: require.resolve('scraping-knife')
});
const results = await page.evaluate(async () => {
return SK.$('#some-id').text();
});
await page.close();
await browser.close();
console.log(results);