dvishal485/flipkart-scraper-api

Page Issues

Opened this issue · 3 comments

Search Result gives limited number of product details , how to move on to next page ?

This feature can be added by changing url to fetch with appropriate parameters.
I don't make any changes right now. Feel free to diy and submit a PR!

I have observed a few points, mentioning here instead of creating another issue
when I searched for Lizol what happened

  • got 40 results whereas Flipkart it shows 32 results
  • A few products were not available on the page but were present in the JSON response, I tried the links, product was available in the link
  • for a few of them original/current prices differed between JSON and real website prices

I wanted to know, if all these are bugs or if the API is intentionally built this way
and I want to use this API to build something, is this legal to use the information of Flipkart?

@dvishal485

I have observed a few points, mentioning here instead of creating another issue when I searched for Lizol what happened

  • got 40 results whereas Flipkart it shows 32 results
  • A few products were not available on the page but were present in the JSON response, I tried the links, product was available in the link
  • for a few of them original/current prices differed between JSON and real website prices

I wanted to know, if all these are bugs or if the API is intentionally built this way and I want to use this API to build something, is this legal to use the information of Flipkart?

@dvishal485

It maybe the case that flipkart fetched more products when on different account (based on activity) / different device/browser/on-scroll. I cannot be sure about this without a proper debug.

If you want to detect the same yourself then I would suggest you to save the response fetched by the scraper as html and review the number of products in that html page.

To best of my opinion, scraper is behaving as expected, unless the 8 products which are not there in the scraper list are not placed different or are extreme edge cases (like sponsored products having different views, or being the last 4 products, or some other differentiating factor than others)