This is a digital library on books of Goodreads based on scrappers.
- Scraping data given user-specified number of books and authors (recommend less than 200 books and less than 50 authors)
- Export scrapped data
- Import a json file to the database
- Send a query and return a list of books/authors
- Visit a simple API of my database
The database is on firebase
Here is a quick introduction on how to start the program.
To make sure this program gets executed well, here are some prerequisites that need to be followed on the machine.
Linux system
PyCharm
Python 3.7
firbase and its dependency
beautiful soup 4 and its dependency
You can choose to download the .zip file directly or use the command below to download the source files of the game
git clone https://github.com/QikaiYang/DigitalLibrary.git
Unzip the .zip file and open ~/src/Main/Main.py in studio and execute it.
My API support 4 kinds of query - PUT, GET, DELETE, POST. THe formats are as below:
- POST - ~/books/post
OR
~/authors/post - GET - ~/books
OR
~/authors - DELETE - ~/books/delete
OR
~/authors/delete - PUT - ~/books/put
OR
~/authors/put