This is a web scraper. Scrapes websites kitapyurdu, idefix, and d&r. Fetches book data from there and inserts it into our firebase database.
NodeJS has to be installed on your device.
Clone this repo into your computer.
$ git clone https://github.com/osmanbahtiyar/Book-Store-Scraper.git
Install dependencies
$ npm install
Run the scrapper
$ npm run scrap
In default, the scraper fetches data and inserts them into our firestore database. If you want to change our database with your database. Get the config.json file from firestore and paste it into the scraper folder. Then change the 'require' part of the code below. const serviceAccount = require('your json path here')
const serviceAccount = require('your json path here')