CRutkowski/Kijiji-Scraper

does not pull entire description

Opened this issue · 1 comments

If the post contains a lengthy description it will not pull all the information because a show more button appears in the kijiji ad. A possible solution for this would be to look if that button exists then parse the information after it is clicked.

Another solution, more simple.

There is an exemple in node here :
https://github.com/DanLatimer/kijiji-scraper/blob/b5b69a95e8c1619465cd8c4ba55784a9b5c8a3dd/classes/ad.js#L61

This would trigger one request per ad to load full add page and parse infos, it'll take a little bit more of time