inikulin/ineed

Ineed question

PPR35 opened this issue · 2 comments

PPR35 commented

Hi, just started using ineed. Maybe i'm doing something wrong, but the same code gives me different results :

  • sometimes, it works as expected, and retrieves the data i'm looking for.
  • sometimes, without raising an error, i get not result from the collect() method. It looks as if the wasn't even a connection to the target site.

Is there a limitation in ineed that prevents connecting too often to a site?

inikulin commented

Hi,

There is no limitation for connections in ineed. ineed uses request library to fetch page, so there should not be any surprises in this area.

On some websites same page can return different results if site vendor enabled A/B-testing. Also, have you checked err argument of the from() method? Maybe there was some network error or site itself denies often connections or there was denail of service?

Can you, please, provide a link to the page you are testing on?

PPR35 commented

Thanks for the quick answer. I jumped on my keyboard too quickly, after several tests with other sites, it seems it is my site that has a problem.
Sorry for the disturbance, and thank for making this piece of code available.