LIn Scraper
Disclaimer
Scraping data off of LinkedIn is against their User Agreement. This is purely intended for educational purposes.
Acknowledgements
Thanks to David Craven who I took inspiration from (link here)
What is this?
This is a tool capable of scraping linkedin profiles
Dependencies
It is based on selenium and BeautifulSoup
How to use
First, download the Chrome Driver from here and extract it to your favourite location.
Create a python3 virtual environment following this.
Within the virtual environment
pip install -r requirements.txt
Edit the conf.json
config file accordingly specifying the chrome bin path, e.g. by typying
which google-chrome
in a UNIX shell command line, the chrome driver path, the desired queries
and so forth.
Finally, to scrape users run
python scrape_users.py --conf conf.json
or jobs
python scrape_jobs.py --conf conf.json