url-scraper
There are 25 repositories under url-scraper topic.
Smartproxy/Smartproxy
HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.
oxylabs/google-shopping-scraper
Google Shopping Scraper can scrape and parse various Google Shopping page types to collect structured e-commerce data.
oxylabs/amazon-review-scraper
Amazon Review Scraper for hassle-free review data extraction, including authors, titles, descriptions, ratings, dates, and more.
oxylabs/amazon-asin-scraper
Amazon ASIN Scraper for effortless product ASIN extraction.
oxylabs/etsy-scraper
Etsy Scraper for collecting prices, titles, descriptions, specifications, reviews, and other product information from etsy.com
oxylabs/ebay-scraper
eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay
r3dxpl0it/Damn-Small-URL-Crawler
A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website
its0x08/duckduckgo
A simple DuckDuckGo URL scraper.
komodoooo/Arb-tool
Old toolkit
oxylabs/web-scraping-php
A tutorial and code samples of web scraping with PHP
JohnScooby/DuckDuckGo-Scraper
A Simple Script To Scrape DuckDuckGo Search Results Using Python And Selenium WebDriver.
krishcdbry/url-scraper
Url scraper which takes the text input and finds the links/urls, scraps them using cheerio and will returns an object with original text, parsed text (using npm-text-parser) and array of objects where each object contains scraped webpage's information.
Gertje823/Microsoft-stream-url-scraper
Scrape all video urls of Microsoft Stream
oxylabs/scrape-images-from-website
Scrape Images From a Website with Python
oxylabs/walmart-scraper
Walmart Scraper for extracting product prices, titles, descriptions, specifications, ratings and reviews from walmart.com
zauberware/url_checker
Quick lookup for HTTP Status codes of a Sitemap!
Cyber-Dioxide/Link-Hawk
A software for scrapping emails from the entire website. Link Hawk crawls over the entire site and grabs emails from the given domain and its subdomains too.
harindujayakody/fetches-all-links
Here's a simple Python program that fetches all links from a given webpage and saves the links in a text file.
Mark10111/Amz-scrape
This Amazon Web Scraper script is designed to extract product information from Amazon.com search pages. It retrieves data such as product titles, prices, ASIN, ratings, and review counts.
amndzdzdz/Web-Crawler
A python web crawler that crawls URLs and scrapes their webpages. Specifically for Yahoo news articles.
kaanbasal/url-scraper
Fetch all links recursively from given url
oxylabs/how-to-build-web-scraper
Step by step guide to building a web scraper with Python
AIessa/Crawling-Twitter-and-Webscraping
This repository contains scripts to crawl Twitter for user profiles and scrape web-data using Python libraries.
hmzasif/scraping_urls
Scraping URLs from web pages using a Rails backend, paired with a Vue.js single-page application.
friol/italianScene
Tools to make a list of all the Italian demoscene productions