Developed a Web-App using Streamlit and BeautifulSoup that can scrap GitHub and Display the Top Repositories in each Topic.
We will scrape the Github topic page to collect the names of the Top Topic titles, their description and their url. To do this:
- We will use requests library to collect the html file for the topic page.
- We will then create a soup using BeautifulSoup which will have all the html tags present in it.
- Right click on any of the topic title and select inspect.
- We will note the tag and the class in which the title of the topic is present. This tag and class will be same for every topic.
- We will then provide this tag to bs4 and find_all('p') tags which we require.
- We will do this similar steps to collect the description and url.
- We will then put all these info into a pandas dataframe.
- Then we will define some functions that can do all the above steps automatically.
- We will define another set of functions that can find out info(username, repo_name, starts, url) about the top Repositories in any topics.
We will develop a web app using Streamlit, which will allow us to select a Topic for which it will provide us information of the Top Repositories.
Note:- To Run this web app, please download main.py file and run it in the terminal by using the command, streamlit run main.py.