A web scraping API for scraping jobs
This project is a Python-based job scraping tool that extracts job listings from the Times Jobs website and sends daily email notifications containing the scraped data. The tool utilizes Beautiful Soup for web scraping and smtplib for email automation.
- Scrapes job listings from the Times Jobs website.
- Sends daily email notifications with the scraped job data.
- Handles errors and exceptions gracefully.
- Stores scraped data in CSV format for further analysis.
-
Clone the repository to your local machine:
git clone https://github.com/db-keli/J_scraper.git
-
Navigate to the project directory:
cd J_scraper
-
Install the required Python dependencies:
pip install -r requirements.txt
-
Run the
schedule.sh
script to start the job scraping and email automation process:sudo ./schedule.sh
Modify the scrape.py
file to customize the following settings:
- Email sender and recipient addresses
- SMTP server settings
- Times Jobs website URL
Modify the schedule.sh
file to schedule the time spaces to run this script
This project is licensed under the MIT License - see the LICENSE file for details.
Contributions are welcome! Please fork the repository and submit a pull request.
For questions, issues, or feedback, please contact Dompeh Kofi Bright.