data-scraper

There are 45 repositories under data-scraper topic.

  • egbertbouman/youtube-comment-downloader

    Simple script for downloading Youtube comments without using the Youtube API

    Language:Python1.1k26132253
  • web-scraping

    je-suis-tm/web-scraping

    Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

    Language:Python8212811186
  • aixblock-ai-dev-platform-public

    AIxBlock-2023/aixblock-ai-dev-platform-public

    An On-Chain Open-Source Platform for Rapid AI Model Productization Using Decentralized Resources with Flexibility and Scalability

    Language:TypeScript896210
  • kaymen99/ai-web-scraper

    AI web scraper built with Crawl4AI for extracting structured leads data from websites.

    Language:Python461011
  • sallamy2580/python-web-scrapping

    Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

    Language:Python30202
  • AmbitionlessFr1end/h-manga-downloader

    A script for downloading hentai manga/doujin files and storing them in a folder. It is made with python.

    Language:Python10001
  • danielfrees/scrapemed

    ScrapeMed: Data scraping for PubMed Central.

    Language:Python10101
  • h26k2/node-gui-scraper

    A GUI Based Web-Scraper for scraping e-commerce website using NodeJS

    Language:JavaScript10202
  • r7avi/Google-Maps-Data-Scrapper

    Google Maps/Place Business Data Scrapper, Scrape data from any google business listed on google maps. Get Name, Address, Phone Number, Plus Code, Reviews, Longitude and Latitude etc. Scrape Emails from Available Websites and Docker Support for automation.

    Language:Python8110
  • clippy

    abtsousa/clippy

    A robust file downloader and scraper for NOVA School of Science and Technology's own e-learning platform, CLIP.

    Language:Python7101
  • ranbot-ai/instagram-scraper

    A Nodejs script that scrapes data from instagram profiles.

    Language:TypeScript7200
  • FoamoftheSea/tda_scraper

    A web-scraper which uses selenium webdriver to obtain in-depth data from TD Ameritrade website for use with python.

    Language:Jupyter Notebook6103
  • logan-lauton/nba_webscrape

    web scrapes performed for Kaggle datasets.

    Language:Jupyter Notebook6101
  • bitArtisan1/netDigger

    A .NET 8.0 C# WPF desktop application for web scraping data into structured databases with a modern UI, comprehensive logging and optimized high performance.

    Language:C#5101
  • farukalamai/yelp-scraper-scrapy-python

    Yelp Restaurant data scraping using python, scrapy spider

    Language:Python4222
  • JasonG7234/NBA-Draft-Model

    This is a Python college basketball data scraper + draft model.

    Language:Python4100
  • logan-lauton/nfl_webscrape

    web scrape performed for Kaggle dataset.

    Language:Jupyter Notebook4201
  • Police-Data-Accessibility-Project/docs

    Documentation for the Police Data Accessibility Project.

  • ortanaV2/Data-Scraper

    A data-scraper that makes it possible to filter out the most important information from huge amounts of text based data.

    Language:Python3100
  • SabujXi/Python-Scraper-and-Data-Analysts-Admin-Panel-in-Django

    A data scraper from texas govt site and a helping web app for managing, reviewing and editing the data

    Language:Python210
  • ShahrozAtiq/Hevy-Exercises-Data-Scraper

    This bot automates the process of logging into the Hevy website using your email and password, navigating to the exercises section, and extracting detailed data for each exercise. The extracted attributes include: Name Equipment Primary Muscle Secondary Muscle Source Source Type Thumbnail The data is systematically stored in a CSV file

    Language:Python2110
  • DanMesh/ParkrunData

    Data scraper for Parkrun results

    Language:Java1000
  • encoreshao/puppeteer-typescript-starter

    The most basic Puppeteer TypeScript starter

  • JDoe0222/Fake_Job_Scraper

    This is a Repository to show an example of using the BeautifulSoup4 Tool to automate a job search

    Language:Python1100
  • lucifermorningstar1305/scrappy

    Web Scrapper for any website

    Language:Python1100
  • luka-j/UpisScraper

    Crawls upin.mpn.gov.rs for data.

    Language:Java1200
  • mertaybat/boardgamegeek-downloader

    Boardgamegeek data downloader

    Language:TypeScript1100
  • ohiTuna/DATA2000

    tool for scraping state physician DATA2000 waiver counts from SAMHSA

    Language:Go1100
  • ProMahmudul/goodreads-book-scraper

    The "GoodReads Book Scraper" is a project developed using Laravel 11 framework. This tool aims to extract and organize data from the popular book review platform, GoodReads. With its intuitive interface and powerful scraping capabilities, users can effortlessly gather information such as book original titles, language, ISBN, and published data.

    Language:PHP1100
  • ranbot-ai/web-scraper

    A NodeJS script that scrapes metadata from public websites | 2025

    Language:TypeScript1100
  • eVowIO/Data-Tracking-Sentinel

    eVow.io Data Tracking Sentinel

  • adil6572/pages24-scraper

    Pages24 Scraper is a Python tool designed to efficiently extract valuable information from the Pages24 website. This scraper simplifies the process of collecting diverse data, including names, URLs, addresses, and more, from Pages24 listings.

    Language:Python
  • adil6572/PropertyPulse

    PropertyPulse is a versatile web scraping tool designed to streamline the process of gathering real estate data from various websites.

    Language:Jupyter Notebook10
  • adil6572/qbcc-local-contractor-scraper

    This Python-based web scraper automates the collection of contractor details from the Queensland Building and Construction Commission's (QBCC) website, simplifying data gathering for analysis and database creation in the construction industry.

    Language:Python10
  • Antkky/Go_Crypto_Scraper

    Highly efficient crypto data scraper built on go, works on multiple exchanges at once

    Language:Go
  • Antkky/Python_Crypto_Scraper

    Python crypto data scraper that scrapes across multiple exchanges

    Language:PowerShell