Software Dev Job Auto Apply & Scraper
A script to scrape company job sites hosted on Greenhouse for job listings and automatically apply to each job using pre-populated data.
Inspiration
Job hunting is rough. Having to answer the same generic questions 1000 times is even rougher. You can't automate every site, but one was good enough for me! Thank you to https://github.com/harshibar for making this easier.
Installation
- Install [ChromeDriver]
pip install ChromeDriverManager
- Install [Selenium]:
pip install selenium
- Install [BeautifulSoup]:
pip install beautifulsoup4
Usage
To scrape jobs:
- Put in your companies of interest (their greenhouse url) in
scraper_and_scraped_urls/job_websites_to_scrap.txt
. It comes by default with 100+ companies in the file. - Run
python webScraper.py
. URLs found will be saved toscraped_jobs.txt
.
To auto apply:
- Put in your information in
form_input_basic_info.py
. - Run
python main.py
- Sometimes you might encounter applications that ask for information that isn't included in this script, so you'll have to manually fill those out.
- You also may encounter captcha. Currently looking for a solution for this (VERY OPEN TO SUGGESTIONS AND HELP!). I'm thinking of implementing a anti-captcha solver service.
Thanks
- Selenium - A tool designed for QA testing, but that actually works great for making these types of bots
- Beautiful Soup - A tool to scrape HTML/XML content (that saved be big time with this project)
- Harshi harshibar - The base of where I started for this project.