crawl apartment and update the database. It also finds the closest Caltrain station and returns its distance.
targetsite: https://sfbay.craigslist.org/search/apa
- scrapy
- python3
- README.md (current file)
- result.csv
- result file
- craigslit_apt/
- scrapy project
scrapy crawl cl # run crawler
(source) mongo2csv # from mongo to result.csv