felipecsl/wombat

How to go over multiple subpaths

Closed this issue · 0 comments

I'd like to go over a lot of pages (thousands) and supply their path parameter to the base_url, because I've got them already. But I don't see any example how to do something like that. Is this a good use case for wombat ? Next I'd like to store scraped text from pages into one giant JSON.