This project contains Python scripts to scrape job data from LinkedIn, Indeed, and Rekrute. The data is saved into CSV and Excel files.
Make sure you have the following installed:
- Python 3.x
pip
(Python package installer)- Latest version of [Google Chrome]. To update it, Open Google Chrome then Click the three vertical dots (Menu) in the top-right corner, select
Help
>About Google Chrome
and Chrome will automatically check for updates and install them. After the update, clickRelaunch
.
-
Clone the repository:
git clone https://github.com/zaim001/findMyJob.git cd findMyJob
-
Create a virtual environment:
python -m venv venv
-
Activate the virtual environment:
- On Windows:
.\venv\Scripts\activate
- On macOS and Linux:
source venv/bin/activate
- On Windows:
-
Install the required packages:
pip install -r requirements.txt
-
(optional) if you have
distutils
issues.pip install setuptools
The LinkedIn job scraper script (linkedin-jobs.py
) collects job data from LinkedIn.
-
Run the script:
python linkedin-jobs.py
-
Follow the prompts to enter the job title and location.
-
The script will scrape the job data and save it into
linkedin.csv
andlinkedin.xlsx
.
The number of scrapped linkedin jobs is limited.
The Indeed job scraper script (indeed.py
) collects job data from Indeed
-
Run the script:
python indeed.py
-
Follow the prompts to enter the job title and location.
-
The script will scrape the job data and save it into
indeed.csv
andindeed.xlsx
.
The Indeed job scraper script (rekrute.py
) collects job data from Indeed
-
Run the script:
python rekrute.py
-
Follow the prompts to enter the job title and location.
-
The script will scrape the job data and save it into
rekrute.csv
andrekrute.xlsx
.