My aim in this repo is web scraping on various e-commerce sites. Now, I'm pulling data from only 1 site right, but I aim to increase this number in the future.
Scrapped data is converted to dataframe and stored in postgresql.
Json Parser added. You can fetch features Json format and convert into dataframe.
You don't need any change in Json_class.py. Run JsonRun.py for all word list.İf you want change word list your categorys.
1-Increasing the number of scrapped e-commerce
2-Increasing performance (JSON format) ✔️
3-Increase the optimization of the retrieved data ✔️
4-Conversion to a more modular structure