Script for scraping the accreditations for FINKI (FCSE).
If you have Poetry, you can use poetry install, otherwise, pip install -r requirements.txt.
[poetry run] python -m app [-f ...] [-c ...] [-l ...] [-y ...] [-e ...]
Arguments:
-cor--cycle: select the cycle of the courses you want to scrape (1, 2, 3, default is all)-yor--year: select the accreditation year of the courses you want to scrape (2023, 2018, 2013, default is all)-lor--limit: select the number of courses you wish to scrape (default is 0 to scrape all)-eor--export: select the .csv file with the results to clean up (this interrupts the normal flow of the script, by only cleaning up an existing file, and not scraping)-for--file: set the name of the file that will be saved after scraping (default:output.csv)
The script also looks for a file called cookies.json in the root of the project. It should contain the cookies for the session of the site. Here is an example Chrome extension capable of dumping all cookies used by a page. If you do end up using the given Chrome extension, keep in that mind you should also:
- Change the domain of all cookies to
iknow.ukim.mk - Set the
sameSiteproperty of all cookies to"None"
if you want the scraper to work.