This is a scrapy based bot that will scrape lagou.com for real-time jobs matching specific criteria, then alert you in Slack.
This will let you quickly see the best new jobs at the first time. You can adjust the settings to change your job name keywords and cities.
Look in settings.py
for a full list of all the configuration options. Here's a high level overview:
CITY_NAMES
-- the city of the jobs you want to look inJOB_NAMES
-- the subsection of Craigslist housing that you want to look in.SLACK_CHANNEL
-- the Slack channel you want the bot to post in.
Before using this bot, you'll need a Slack team, a channel for the bot to post into, and a Slack API key:
- Create a Slack team, which you can do here.
- Create a channel for the jobs to be posted into. Here's help on this.
- Get a Slack API token, which you can do here. Here's more information on the process.
- Create a file called
private.py
in this folder.- Add a value called
SLACK_TOKEN
that contains your Slack API token. See 'private.py.example' for example. - Add any other values you want to
private.py
.
- Add a value called
- Install Python 3 and other required package.
- Install the Python requirements with
pip3 install -r requirements.txt
. - Update
proxies.json
withpython3 proxies.py
. - Run the program with
python main_loop.py
. Results will be posted to your channel if successful.