Tool to Scrape Data from Stepstone
- Install Python (3.9 recommended)
- Install pipenv (
pip install pipenv
) - Switch into project directory
- run
pipenv install
and wait! - run
pipenv shell
- run
jupyter lab
- In "Jupyter lab" select "Stepscrape.ipynb"
- Un-Comment Cell [...]
- Restart Kernel and run all cells
- Comment Cell [...]
- Un-Comment-Cell[...]
- Restart Kernel and run all cells
##To change parameters (EG Search-Query)
- Switch entry "Requirements Engineer" to desired value urls = [build_stepstone_search_query("Requirements Engineer", i) for i in range(10)]