Welcome to the Wuzzuf Job Scraper project! This web scraping tool is designed to extract job listings, including titles, companies, locations, and job details, from the Wuzzuf job portal. The project allows users to collect data in real-time and analyze job market trends or specific roles.
This project leverages Python and web scraping libraries to collect job listings from Wuzzuf. It is useful for job seekers, recruiters, or data analysts who want to gather insights on job trends, analyze skills demand, or search for specific roles in Egypt's job market.
The scraper uses the following technologies:
- Python 3.8+
- BeautifulSoup: For HTML parsing
- Requests: For sending HTTP requests
- Pandas: For data manipulation and saving results to CSV
- Jupyter Notebook: For running and testing scripts
- Job Listings: Scrapes job titles, company names, locations, and links to job descriptions.
- Customizable Filters: Filter jobs by category, location, or company.
- Real-Time Data: Pulls current job postings from the Wuzzuf website.
- CSV Export: Save scraped job data in CSV format for further analysis.
- Clone the repository:
git clone https://github.com/username/wuzzuf-job-scraper.git
- Install the required libraries:
pip install -r requirements.txt
- Open the
wuzzuf_scraper.pyfile and set your scraping parameters (e.g., job title, location). - Run the script:
python wuzzuf_scraper.py
- The scraped data will be saved as a CSV file in the project directory.
For more detailed usage instructions, check out the code documentation in the script.
- Automated Scheduling: Implement job scraping on a schedule using cron jobs or Python schedulers.
- Data Visualization: Add visualizations for job market trends (e.g., demand per location, popular companies).
- Additional Filters: Expand filter options to include job type (full-time, part-time) and salary ranges.