/automation-ebay-crawler

A crawler that supplies details on related search terms and product information from the SERP, such as ID, position, title, price, sponsorship status, shipping details, and image url.

Primary LanguageTypeScript

Automation Ebay Crawler

This crawler, built with NodeJS, TypeScript and Puppeteer, is designed to fetch valuable information from eBay's Search Results Page (SERP) based on a specified search term.

The crawler supplies details on related search terms and product information from the SERP, such as ID, position, title, price, sponsorship status, shipping details, and image url.

Get a glimpse of the Crawler in action

Short-Demo.mp4

Requirements

  • NodeJS version 16.4+

Command lines:

  • The essential commands for running and developing the project:

    • npm install
      Install all the necessary packages for running and developing the project.
    • npm run start
      For running the project.

  • Additional commands that are optional

    • npm run build
      Builds and compiles TypeScript code into JavaScript files.

The technologies used in this project include:

  • Nodejs : the project is javascript based, serving as the runtime for typescript.
  • TypeScript : the project is implemented using typescript, incorporating interfaces and ensuring type safety.
  • Puppeteer : the project utilizes puppeteer, a library for automated browser actions and web scraping.

Author

:octocat: Afek Sakaju