scrapper
There are 805 repositories under scrapper topic.
je-suis-tm/web-scraping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
markowanga/stweet
Advanced python library to scrap Twitter (tweets, users) from unofficial API
Xonshiz/comic-dl
Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.
iw4p/proxy-scraper
scrape proxies from more than 5 different sources and check which ones are still alive
baptisteArno/tinking
🧶 Extract data from any website without code, just clicks.
champmq/TheScrapper
Scrape emails, phone numbers and social media accounts from a website.
rodrigogs/xvideos
xvideos API library
keethesh/UdemyCourseGrabber
Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
DiegoCaraballo/Email-extractor
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
Bishalsarang/Leetcode-Questions-Scraper
Scrape Algorithm Questions from leetcode and generate html and epub file
CuriousLearner/GeeksForGeeksScrapper
Scrapes g4g and creates PDF
Joel2B/XVideos-PornHub-RedTube-API
This script scrapes the HTML from different web pages to get the information from the video (XVideos, PornHub, RedTube) and you can use it in your own video player.
fernandod1/Instagram-to-discord
Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!
voliveirajr/seleniumcrawler
An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
badoux/goscraper
Golang pkg to quickly return a preview of a webpage (title/description/images)
narkhedesam/Proxy-List-Scrapper
Proxy List Scrapper
akasakaid/TiktokDownloader
Source code of tiktok video downloader without watermark based on telegram
lscofield/node-urlresolver-api
A complete nodejs API to extract streaming sites video direct URLs
MLArtist/WebScraper
Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.
lfreneda/statusinvest
:money_with_wings: statusinvest.com.br stocks info web scraper
shurco/goClone
🌱 goClone - clone websites in seconds
5hirish/tweet_scrapper
Scrape the Twitter frontend API without any authentication and restriction.
filipemeneses/fatec-api
API for SIGA from Centro Paula Souza made for students to create things based in their profile data
clouedoc/goquotes
A Go scraper aimed at scrapping quotes.
endenwer/tradingview-ws
TradingView data fetcher through websockets.
Romi666/komikku-api
REST API Manga bahasa indonesia
ZKAW/website-cloner
Basic website cloner written in Python
Potelo/laravel-block-bots
Block crawlers and high traffic users on your site by IP using Redis
DreamCobbler/fiction-dl
A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.
nicolaspascual/mercadona-scrapper
Scrapper for the web page of mercadona. It downloads all current products into a csv file
kastaid/getter
Get and put users (scraping) to the target group/channel efficiently, correctly and safety.
maforget/Bedetheque-Scrapper-2
Script that scapes data from Bedetheque.com for ComicRack
kant2002/ncrawler
Web Crawler written in C#
satyawikananda/waifu-generator
Let's pick up your favorite waifu just from the API
anshulrgoyal/imdb-scrapper
This is small project it provide many good api for search ,scrapping ,trending