apify
There are 181 repositories under apify topic.
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
apify/apify-cli
Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.
apify/apify-sdk-js
Apify SDK monorepo
apify/apify-sdk-python
The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.
apify/actor-scraper
House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
apify/apify-client-python
Apify API client for Python
superryeti/Hands-on-WebScraping
This repo is a part of blog series on several web scraping projects where we will explore scraping techniques to crawl data from simple websites to websites using advanced protection.
VaclavRut/actor-amazon-crawler
Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.
maxCopell/tripadvisor-scraper
Scrape Tripadvisor restaurant, hotels, and places.
MrXujiang/crawel
基于Apify+node+react搭建的有点意思的爬虫平台
JuroOravec/crawlee-one
Professional scrapers that provide full control to the users. Crawlee One builds on top of Crawlee and Apify and extends them with features for robust and highly configurable web scrapers.
apify/super-scraper
Generic REST API for scraping websites. Drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!
bernardro/actor-youtube-scraper
Apify actor to scrape Youtube search results. You can set the maximum videos to scrape per page as well as the date from which to start scraping.
apify/actor-content-checker
You can use this act to monitor any page's content and get a notification when content changes.
sauermar/web-browser-recorder
Web application for recording, management and editing of inteligent RPA workflows using Playwright technology
metalwarrior665/actor-google-sheets
No more dealing with Google API. Simple Node.js program to automate access to Google Sheets.
lhotanok/actor-ticketmaster-scraper
Apify actor for scraping events from Ticketmaster based on their categories
pocesar/actor-shopify-scraper
Automate monitoring prices on the most popular solution for building online stores and selling products online. Crawl arbitrary Shopify-powered online stores and extract a list of all products in a structured form, including product title, price, description, etc
apify/apify-zapier-integration
Apify integration for Zapier
devblack/curlx
CurlX a basic Curl syntax
metalwarrior665/actor-rust-scraper
Experimental scraper in Rust suited for running locally or on the Apify platform. Inspired by Apify SDK.
apify/actor-scrapy-executor
Apify actor to run web spiders written in Python in the Scrapy library
metalwarrior665/actor-article-extractor-smart
Combines Apify's crawling system and article parsing with unfluff library.
pocesar/actor-twitter-scraper
Scrape any Twitter user profile. Extract tweets, retweets, replies, favorites, and conversation threads with no Twitter API limits
lhotanok/zalando-scraper
Apify actor extracting data from Zalando
petrpatek/airbnb-scraper
Apify public actor for scraping Airbnb homes.
pocesar/apify-login-session
Grab a session for any website for usage on your own actor
apify-projects/store-website-checker
Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.
apify/actor-legacy-phantomjs-crawler
The actor implements the legacy Apify Crawler product. It uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of JavaScript code.
cermak-petr/act-anti-captcha-recaptcha
Apify act for solving google recaptcha using the anti-captcha.com service.
Nikolay-Lysenko/servifier
An easy-to-use tool for making web service with API from your own Python functions.
orgupdate/Apify-Linkedin-Jobs-Scraper
The latest and most advanced LinkedIn Job Scraper. Our LinkedIn Jobs Scraper extracts real-time job postings at scale from all over the world. A new research tool built for recruitment, insights and HR.
ScaleLeap/zine-not-amazon-scraper
How to Scrape Amazon Search Results
orgupdate/Apify-Google-Jobs-Scraper
The latest and most advanced Google Job Scraper. Our Indeed, Linkedin, and Google Jobs Scraper rolled into one. This scraper extracts real-time job postings at scale from any active Google Jobs search results from all over the world. A new research tool built for recruitment, insights and HR.
orgupdate/Apify-Indeed-Jobs-Scraper
The latest and most advanced Indeed Job Scraper. Our Indeed Jobs Scraper extracts real-time job postings at scale from all over the world. A new research tool built for recruitment, insights and HR.