Scrapy the detail and lowest price of amazon best seller product by python spider
In developing........, welcome to join !
Some code has apply to pricejot.com. https://www.pricejot.com/
install python3.6 pip install -r requirements.txt
if you are contributer recommend to php install pipreqs run "pipreqs /path/to/project" if you add some packages in your code
- list page https://www.amazon.com/Best-Sellers/zgbs/ update every two hours.
- price detail page https://www.amazon.com/gp/offer-listing/B01FCTAEK4
- Scrapy the reviews by asin https://www.amazon.com/Libratone-ONE-Click-Caribbean-Green/product-reviews/B00ZU33BBC
- Scrapy the detail by asin pool(50%)
- Scrapy the category of level 1 from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
- Scrapy the asin in the best seller asin from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
- Scrapy the keywords rank by asin
- python https://bop.molun.net/
- scrapy https://docs.scrapy.org/en/latest/
Email：huangdingzhi@foxmail.com Wechat:dzdzhuang
Based on Python 3.6
The MIT License(http://opensource.org/licenses/MIT)
Please feel free to use and contribute to the development.
If you have any ideas or suggestions to improve Amazon-scrapy, welcome to submit an issue/pull request.
您的支持是我们坚持的最大动力。
| Backer | Fee |
|---|---|
| Jet.Zhang | ￥18.88 |
| Mike | ￥18.88 |
| 飞龙 | ￥5 |