Pinned Repositories
crawler
Library for Rapid (Web) Crawler and Scraper Development
graphics
Only images to show on github readme pages
html-2-text
Convert HTML to formatted plain text.
laravel-crawler
Laravel adapter for the crwlr/crawler package.
package-template
Template repository for new crwlr packages
query-string
A library for convenient handling of query strings used in HTTP requests.
robots-txt
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
schema-org
Extract schema.org objects from HTML documents
url
Swiss Army knife for urls.
utils
Utilities that are needed in multiple crwler packages.
crwlr.software's Repositories
crwlrsoft/crawler
Library for Rapid (Web) Crawler and Scraper Development
crwlrsoft/url
Swiss Army knife for urls.
crwlrsoft/query-string
A library for convenient handling of query strings used in HTTP requests.
crwlrsoft/schema-org
Extract schema.org objects from HTML documents
crwlrsoft/robots-txt
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
crwlrsoft/laravel-crawler
Laravel adapter for the crwlr/crawler package.
crwlrsoft/html-2-text
Convert HTML to formatted plain text.
crwlrsoft/utils
Utilities that are needed in multiple crwler packages.
crwlrsoft/package-template
Template repository for new crwlr packages
crwlrsoft/.github
crwlrsoft/graphics
Only images to show on github readme pages
crwlrsoft/crawler-ext-browser
Extension for the crwlr/crawler package containing steps utilizing a headless browser.
crwlrsoft/crwl-ext-browser
Extension configurations for integration of crwlr/crawler-ext-browser into the crwl.io app.
crwlrsoft/crwl-extension-utils
Utils for extension packages for the crwl.io app.