lawzava/scrape

Wait indefinitely with --js option

stauvel opened this issue · 0 comments

The app sticks on c.Wait() https://github.com/lawzava/scrape/blob/master/scraper/scrape.go#L70 when I try the --js option.
Any idea ?

I use chromium under Windows 10 and the following command :

scrape --js --debug #default website

In debug logs I have a kind of js error, but it doesn't help me :

[000039] 1 [     5 - scraped] map["url":"https://lawzava.com/contact/"] (6.8101774s)
2020/10/01 16:58:47 executing chromedp: could not retrieve attribute "innerHTML": exception "Uncaught" (1:10): TypeError: Cannot read property 'innerHTML' of undefined
    at <anonymous>:2:11
    at <anonymous>:3:4

The mail is well collected in scrapedEmails variable...