anilabhadatta/educative.io_scraper

Error and Bug

sshift56 opened this issue · 16 comments

program crashes in pages with "/project" in the end of the url
error

https://www.educative.io/courses/javascript-in-detail-from-beginner-to-advanced/find-mutual-friends/project

Bug when resuming download, it always starts in first topic of the course.
This line causes the bug
bug
so i put a comment on it, to fix it temporarily.

@sshift56 should be fixed, please check by recloning
also i will recommend you to redownload chrome binary and driver and delete the userdatadirectory

@sshift56 should be fixed, please check by recloning also i will recommend you to redownload chrome binary and driver and delete the userdatadirectory

I found another error, when getting "courseCollectionsJson" it never counts mini projects , but i fixed it. I added "PATH_EXTERNAL_PROJECT" in ApiUtility.py line 78.
Capture

@sshift56 thanks will add this
can you send me the topic link where you received this error?

@sshift56 which specific topic did you get the error in this module?

@anilabhadatta I got the error when getting the API Urls. This i the error
Capture

I only got this error with course/module with projects/mini projects.

Module/Course with projects:
https://www.educative.io/module/cpp-basics
https://www.educative.io/module/El5jyzfnwVG47mJ67/10370001/4924227523444736

@sshift56 did you try cloning the latest commit?

@sshift56 should be fixed in latest commit, v 3.2.1, i have tested and working.

@sshift56 will check

@sshift56 fixed in latest commit

@anilabhadatta another error,
Capture

Still encountering this error, the github repo either deleted by the owner or made it private.
So I rewrite the downloadWebpackBin fucntion, to fix it temporarily.
Capture

@sshift56 attach educativescraper.log

@sshift56 Please clone the latest commits before creating an issue here.
To my knowledge, the issue should be fixed but I need some data.
Always make sure to attach the EducativeScraper.log file here, I will get the information regarding the workflow.
Thanks.

@sshift56
fixed in latest commit, please do git pull for new changes.
added recursive method of saving the files, should not cause issues now

@sshift56 @anhpho another bug fix was added related to downloadWebPackbiin v3.3.1