- Scrape courses and programs, and export data into JSON files.
- Build prerequisite/corequisite trees
- Convert JSON files into SQL files
Open terminal and run the main.py file.
cd web_scraper/app
python3 main.py
- Install PostgreSQL
- Create a user with password, and grant it all privileges.
- user: mytestuser
- password: My6$Password
- Create a database
- database: zot4plandb
- Import files in the following order:
- create_tables.sql
- courses.sql
- programs.sql
- general_education.sql
- courses_in_ge.sql
- full_text_search.sql