- To use this you'll need BeautifulSoup library installed on your machine. Download it using the command
sudo apt-get install python3-bs4
- Just navigate to the directory where you have cloned/downloaded this.
- Type
$ python3.5 crawl2.py
. Hit enter in your terminal. - Now just enter the username of the user whose answers you have to fetch.
- Creates a user directory with the username and saves each file with the question code name.
- Supports JAVA, C, C++ and python formats. All the other file types are downloaded as .txt files.
- Gives the ongoing fetching details along with the time taken to fetch each answer.
I would highly appreciate any suggestions and pull requests aimed at improving the Crawler.