data-scraping
There are 599 repositories under data-scraping topic.
je-suis-tm/web-scraping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
ScriptSmith/reaper
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Voldrix/onlyfans-dl-2
OnlyFans content downloader v2
drshahizan/special-topic-data-engineering
This course presents to the students recent research and industrial issues pertaining to data engineering, database systems and technologies. Various topics of interests that are directly or indirectly affecting or are being influenced by data engineering, database systems and technologies are explored and discussed.
zohaibbashir/Google-Maps-Scrapper
This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.
ohsusannamarie/Instant-Data-Scraper-Chrome-Extension-v0.1.7
Instant Data Scraper packed Chrome extension v0.1.7 (WITH LinkedIn scraping functionality)
dddat1017/Scraping-Youtube-Comments
Scrape comments from any Youtube video
sushil-rgb/AmazonMe
Introducing AmazonMe, a Python-based web scraper designed to extract data from amazon.com using the requests and beautifulSoup libraries. It simplifies navigation and makes it easy to gather information from Amazon’s website efficiently.
SwatiModi/e-commerce-web-scraper
Scraping details of products from ecommerce websites using python
deedy/cbse_schools_data
Cleaned, scraped data of all 20,367 CBSE schools, primarily in India, in 2018. Data scraped from: cbseaff.nic.in/cbse_aff/schdir_Report/userview.aspx
MuhammadAmir5670/psx-data-reader
A scraper for downloading Pakistan stock exchange's data into Python Pandas DataFrame.
kb22/GitHub-User-Insights-using-API
The project involves using the GitHub API using user authentication to fetch information such as commits and repositories for that specific user and store them as CSV files for data collection and analysis.
LakshyaKhatri/Bookshelf-Reader-API
A browsable REST API for recognizing book spines in an image.
lspahija/torchestrator
Spin up Tor containers and then proxy HTTP requests via these Tor instances
serpapi/google-search-results-java
Google Search Results JAVA API via SerpApi
Atharva-Phatak/Analysing-Glassdoor-Jobs
Data Analysis of Job Postings on Glassdoor.
simonw/disaster-data
Data scraped by https://github.com/simonw/disaster-scrapers
zero-to-mastery/Complete-Python-Developer-Manual
Class notes for Andrei Neagoie's Complete Python Developer course through Zero to Mastery.
furkankose/bilkent-scheduler
Bilkent Scheduler is an open-source tool designed to assist students at Bilkent University in planning their course schedules.
ccubc/ChargeUp
optimizing locations of electric vehicle charging stations in the city of Toronto
sallamy2580/python-web-scrapping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
slavaspirin/Toronto-housing-price-prediction
Building Toronto Housing dataset from scratch to predict real estate prices
Decodo/Web-Scraping-API
Web Scraping API code examples for Python, PHP and Node.js
pinouche/investment_analysis
DCA analysis on the s&p 500
rileynwong/spotify-analysis
Data analysis on my monthly playlists
yuis-ice/jseval
Evaluate JavaScript on a URL through headless Chrome browser.
chaitanyarahalkar/Financial-Info-Extractor
Extract financial information in CSV format for companies compliant to the NSE
Decodo/eCommerce-Scraping-API
eCommerce Scraping API code examples for Python, PHP and Node.js
lidimayra/raspagem-de-dados-fatec
:notebook: Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí
Vyary/exile-profit
This script engages with APIs to collect data and conduct fundamental computations for identifying the optimal approach to generate profits within the game. It also comes with a preconfigured and continuously updating Google Sheet for seamless utilization.
somdeep/Statball
Statball - Football soccer stats analyser from top 5 european leagues with data obtained by web scraping from Fbref and Statsbomb
yashrane/DiscordScraper
Collects and Analyzes textual data scraped from a Discord chat server
bilalahhmedd/ebay-products-scraper
This is ebay products scrapper to scrap images and metadata details of products from ebay.com
fdd4s/matterport-downloader
Download Skybox panoramic photos of Matterport houses
fdd4s/streetview-dl
Street View 360 panos downloader
easonlai/facebook_post_scraping_and_text_analytics
This is demo repo to demostrate how to scrape post data from Facebook by Python with library facebook_scraper. And then use Azure Text Analytics to perform sentiment analysis for post text content.