/scrape-up

A web-scraping-based python package that enables you to scrape data from various platforms like GitHub, Twitter, Instagram, or any useful website.

Primary LanguagePythonMIT LicenseMIT

Scrape Up

An alternative to API, this project is a web-scraping-based python package that enables you to scrape data from various platforms like GitHub, Twitter, Instagram, or any useful website.



           


Contribute to this project under JWoC 2023.

image

JWoC (JGEC Winter of Code) is a begineer friendly open-source coding event organised annually by JGEC which helps students to plunge into Open Source contribution and get the realm of Software Development.

We happily welcome any meaningful change or modification to this project. Before start contributing, we recommend you go through the CONTRIBUTING.md file, where all the guidelines have been mentioned that will guide you to make your contribution.


How to use?

  • Install the package from pip
pip install scrape-up --upgrade
  • Scrape the required information, for example one want to extract number of followers of a user.
# Import the required module
from scrape_up import github

# Instantiate an object with username provided.
user =  github.Users(username="nikhil25803")

# Cal the followers function
print(user.followers())

# Output - '59'

You can check all the methods that we provide here

The goal 🎯

While working on a project, we often ran into a situation where we faced issues like request timeout, rate limit, etc. But leveraging the power of web scrapping, we are here with a solution. This project is a web-scraping-based Python tool that you may use as an alternative to APIs to scrape data from a variety of sites, including GitHub, Twitter, Instagram, and any helpful website.