web-scrapping
There are 200 repositories under web-scrapping topic.
VarunS2002/Python-NSE-Option-Chain-Analyzer
The NSE has a website which displays the option chain in near real-time. This program retrieves this data from the NSE site and then generates useful analysis of the Option Chain for the specified Index or Stock. It also continuously refreshes the Option Chain and visually displays the trend in various indicators useful for Technical Analysis.
tinyfish-io/agentql
AgentQL is an AI-powered query language for web scraping and automation. It uses natural language selectors to find data on any page, including authenticated content. AgentQL queries are self-healing as UI changes and work across similar sites. Users can define structured data output, making AgentQL versatile for developers and data scientists.
narkhedesam/Proxy-List-Scrapper
Proxy List Scrapper
mldsveda/PyScrappy
All-in-one Web Scrapper for Python
spyboy-productions/PhantomCrawler
Boost website hits by generating requests from multiple proxy IPs.
OpenJarbas/PySychonaut
Unofficial python api for Erowid, PsychonautWiki and AskTheCaterpillar
sallamy2580/python-web-scrapping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
gugarosa/leaflyer
🍀 Scraps data from Leafly and collects amazing weed-based meta-data.
yuis-ice/jseval
Evaluate JavaScript on a URL through headless Chrome browser.
Or-i0n/sololearnlib
Library that retrieves public data from sololearn.com
PB2204/Covid-19
This Is A Web Scraping Projects With Covid-19 Data From 2 Very Popular & Authentic Websites
Hrushi11/Yellow-Pages-End-API
This repository contains the code for completely scraping the yellow pages website to get the details of all the categories from all the cities in America and then turning all of the data into an api to be used later.
shayan-azizi/TV-Show-Downloader
I was a little lazy in downloading the series I wanted. So I made it automatic.
yashkathe/Download-ComicBooks-API
Unoffical api to get comic books from various publishers. Published on NPM !
zeus-habash/Scraping-jobs-from-Indeed
This Repository is for scraping jobs from Indeed
gentildpinto/rails-web-scrapper
O Rails WEB SCRAPER é um projeto com a finalidade de extrair dados de filmes do site YIFY Torrents - YTS.
gugarosa/jucesp_rpa
🤖 An RPA-based tool for extracting information over JUCESP.
arv-anshul/campusx
Get all the resources like Notes and Notebooks provided in CampusX Courses.
bitArtisan1/netDigger
A .NET 8.0 C# WPF desktop application for web scraping data into structured databases with a modern UI, comprehensive logging and optimized high performance.
gayanukabulegoda/Web-Scraping-Starter-Kit
Repository designed to help freshers easily grasp the basics of web scripting, offering simple guides and examples to build a strong foundation.
kingtroga/linkedin_scraper
This Python script automates interactions with LinkedIn Sales Navigator using Selenium WebDriver. It can log into LinkedIn, navigate through lists of prospects, send messages, and manage contacts based on specific criteria.
pdrm83/rotten_tomatoes_scraper
How to scrape the Rotten Tomatoes website and extract metadata from actor and movie pages.
rushikeshamale/song-scraper
This python web scraping script is use to download top 21 Bollywood songs of Today/Yesterday/Week/Month/All from www.mymp3song.site.
shakewingo/FurnitureRecommenderSystem
An end-to-end development of living room furniture recommender system based on both text and image Latent Dirichlet Allocation (LDA)
devotuoma/British-Airline-Sentiment-Analysis
This repository contains a project to analyze customer feedback data for British Airways (BA) and uncover insights about the airline. It includes code, data, and documentation for data scraping and preparation, data analysis, and presentation of results and recommendations.
Kadetron/Exticz
A scrapping tool which is used for crawling and extracting href links from a website
Napolitain/liquipedia-calendar
A Go / Memcached server which web scrappes matches from Liquipedia when accessed by an iCal URL. Events generated are included in standard calendar apps.
olucaslopes/BNMP-Scraper
Navega pela API do Portal BNMP coletando dados
ShihabYasin/concurrent-webscrapping-python
Web Scraping with Python and Selenium ( Concurrent, Parallel, AsyncIO versions compare ) .
heatingma/VidFetch
An open-source dataset download tool to obtain copyright-free videos from various free video websites.
imamhossain94/annex-bubt-scraping-script
A powerful annex BUBT, BUBT Soft, and BUBT website scraping script.
rajatt95/Playwright_TS_WebScrapping
Automation Testing | Web | Playwright | Typescript | VS Code | Get Data | Set Data in txt file | Viewport | Context | Web Scrapping
ReaperZ0v/csgo-stats-scraper
A web scraper coded in python for scraping the gaming stats for counter strike global offensive (CSGO) and exporting to CSV
tejack3098/College-Data-Scrapper
web application that scrapes data from college websites and creates a dataset of various features of the college
yasharya2901/Python-Price-Scrapper
The Python Price Scraper is a tool that fetches product information (name and price) from Amazon and Flipkart product pages using their URLs.