Camlink Timetable Scraper
Description
Uses the Selenium library with Beautiful Soup to log in, scrape Camosun College student timetable information by term, and export the data to a CSV or JSON file. An example of how the info can be used to build a weekly class schedule can be seen here.
Instructions
1) Download Chrome WebDriver
Mac (via homebrew): brew install chromedriver
Windows: ChromeDriver download site (place .exe file in C:\Windows folder)
2) Install Dependencies
Selenium
[python3 -m] pip install selenium
Beautiful Soup
[python3 -m] pip install beautifulsoup4
Usage
python[3] scrape_camlink.py [-v] [-json]
Prompts for Camlink username, password and the school term to search for (ex. 2019W). Exports a CSV file to the current directory, named "camosunCourses[schoolterm].csv".
-v is the verbose flag, will cause the program print out more info about what's happening as it runs.
If the -json flag is set, the program will additionally output a document with the same name into the current directory in json format.