Scrape for Fall 2023 Schedule

Question

Scrape for Fall 2023 Schedule

zhumingcheng697 opened this issue 2 years ago · 6 comments

zhumingcheng697 commented 2 years ago

Fall 2023 schedule is on Albert now!

Answer 1 · 2023-04-14T22:50:07.000Z

The data source is borked, NYU IT added reCaptcha.

Answer 2 · 2023-05-08T20:30:18.000Z

Can we use https://bulletins.nyu.edu/course-search/ instead?

Answer 3 · 2023-05-09T02:47:42.000Z

Hopefully yes, although its still in beta which is not very exciting.

Thanks for finding this!

Answer 4 · 2023-06-15T01:57:55.000Z

I just developed https://nyu.myschedule.xyz/#/ NYU course schedule days ago, including Fall 2023 courses. I'm planning to use schedge api to get the history courses.

Answer 5 · 2023-06-15T02:15:24.000Z

@onehumanbeing nice! If you'd like, you can open a PR and add a link to your project to Schedge's README.

As a sidenote, where are you getting your data from? Bulletins seems to be empty, and sis.nyu.edu is captcha'd. Are you scraping using a real NYU login?

Answer 6 · 2023-06-15T04:54:59.000Z

@A1Liu Yep I just saw this repo and maybe I will finish coding and open a PR maybe in today.
I'm got the data just from sis.nyu.edu.
Though it's captcha'd, selenium works. you can just finish the captcha only once per scraping by yourself and let selenium listen to the element and start working. You can contact me by linkedin on my github page and I'm open to share my code or cache files to you as a contributor. No NYU Account is needed.