tducret/amazon-scraper-python

amazon2csv.py unable to generate output.csv with data extracting from Amazon

Opened this issue · 2 comments

Hi author/ tducret,

I download all your files and attempted to run python setup.py install. Next, i tried running amazon2csv.py followed your instruction steps found in https://github.com/tducret/amazon-scraper-python which says " You can also pass a search url (if you added complex filters for example), and save it to a file ".

However, on Windows command prompt windows session when i run this command " amazon2csv.py --url="https://www.amazon.com/s/ref=nb_sb_noss_2?url=search-alias%3Daps&field-keywords=python+scraping" > output.csv ", my output.csv file is generated however there's no data found inside the output.csv file. Any advise what steps have i missed out which resulted to the output.csv file being empty (ie: no data extracting from url = https://www.amazon.com/s/ref=nb_sb_noss_2?url=search-alias%3Daps&field-keywords=python+scraping" ) ?

See below screenshot as a proof / reference

image

Hi @clementks
Sorry about that, but Amazon is definitely stronger than me. It's very hard to keep pace with their anti-scraping protections.
I'd really appreciate if somebody wanted to update the code though.

Hi tducret,

Thanks for your advice/response, in other words, u are implying that your amazon scraping program upon you upload to github, back then it works fine and able to export into csv file.

Pardon me as i'm not proficient in OO in Python, may i ask you if i were to perform web scrapping on another website (ie: https://www.walmart.com/), what product attributes does it need/require so that i can get your advice on what to modify init.py, client.py etc ? I learnt a great deal on OO in Python from your program, which i would like to use it for my other project development. Hence, thanks a lot for your sharing by uploading into github