problem scraping index page (Scraping 0 instances)
Opened this issue · 1 comments
okliv commented
hi!
if i try to lookup this page alma-ata.alm.slando.kz
for links h3.large a.link
to go next
scraper = Upton::Scraper.new('http://alma-ata.alm.slando.kz/','h3.large a.link')
all i get with scraper.verbose = true
is
Stashing disabled. Will download from the internet.
Downloading from http://alma-ata.alm.slando.kz/
Downloaded http://alma-ata.alm.slando.kz/
sleeping 30 secs
Scraping 0 instances
but from js console on this page i see this
> $('h3.large a.link').size()
> 30
looks like an error somewhere
drwl commented
I'm using upton (0.3.3)
and running it works for me.
Stashing disabled. Will download from the internet.
Downloading from http://alma-ata.alm.slando.kz/
Downloaded http://alma-ata.alm.slando.kz/
sleeping 1 secs
Scraping 30 instances
Stashing enabled. Will try reading http://alma-ata.alm.olx.kz/obyavlenie/ogromnyy-televizor-po-skromnoy-tsene-ID4fwdh.html#4c7502b736;promoted data from cache.
Cache of http://alma-ata.alm.olx.kz/obyavlenie/ogromnyy-televizor-po-skromnoy-tsene-ID4fwdh.html#4c7502b736;promoted unavailable. Will download from the internet...