PyTeStatistics

This project was created for data scraping and data analysis of Python developer jobs on the site djinni.co. It builds graphs for detailed study and data analysis.

👩‍💻 Installation & Run

🧠 Set up the environment

On Windows:

python -m venv venv 
venv\Scripts\activate

On macOS:

python3 -m venv venv 
source venv/bin/activate

👯 Set up requirements

pip install -r requirements.txt

👩‍ Set up config.py

You can change that file to reorder days of week or change what technologies you want to count.

🍈 How that works...

🧠 Scrapping:

  • You can run python .\Scrapper\data_scrapper.py to start process.
  • Now you will get a new .csv database in DataCollection folder.

😋 Work with data:

  • You can run python .\Analysis\data_processor.py to start process. It will check if database exists, if not will start scrapping.
  • In DataCollection folder you will get folder with current date, inside will be plots.
  • All diagrams will be compiled to single one - combined_plot.png. combined_plot.png
  • And there will be separate diagrams. experience_distribution.png location_distribution.png postings_per_day.png technology_mentions.png

😋 GL HF!