Scrapy Crunchbase
Using Scrapy to get company profiles from http://crunchbase.com
The profile includes following information:
- Business Name
- Category
- Phone
- Website
- About
- Street Address
- City
- State
- Zip Code
- Country
See crunchbase_data_sample.csv for sample data
Usage
Using this command to crawl and store data in CSV format:
scrapy crawl CrunchbaseSpider -o crunchbase_data.csv -t csv