To user scrappers you sould install scrapy
library.
Run in terminal:
pip install scrapy
Run scrapper with the next command:
scrapy runspider scrapper_name.py -o out_put_file_name.json
.
where scrapper_name
- scrapper file name
out_put_file_name
- file name to output.
You can also user several output file extentions ('json', 'jsonlines', 'jl', 'csv', 'xml', 'marshal', 'pickle').
To find out more, go to the scrapy official documentation - https://doc.scrapy.org/en/latest/