To run locally:
npm install
&& node app.js
Modify the ./data/query.json
file:
{
"city": "portland",
"county": "mlt",
"type": "roo",
"filters" : {
"max_price": 800,
"min_price": 400,
"neighborhoods": [
{"name": "buckman", "points": 15},
....
],
"keywords": [
{"slug": "music", "points": 10},
....
]
}
}
The city
, county
, and type
are all components of the url you want to search against. Together they combine the url that you would use to access the search on craigslist. The type
can either be "roo"
for roomshares or "apa"
for apartments.
http://portland.craigslist.org/search/roo
/scrape
will scrape the data for the 100 most recent listings and save them as a json file
/results
will display the most recently scraped data in a web ui