leopardslab/CrawlerX
CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is a web platform that can be used to crawl URLs in different kind of protocols in a distributed way.
SCSSApache-2.0
Issues
- 0
Cannot build docker - Failed to build Twisted
#184 opened by anhnt12 - 2
- 0
[GSoC 2021] Integrate Django Celery Beat to manage and schedule Crawler jobs
#118 opened by sajithaliyanage - 0
- 0
- 0
- 0
[Epic for GSoC 2021] Complete Improvements of CrawlerX web application
#106 opened by sajithaliyanage - 0
[Epic for GSoC 2021] Complete CrawlerX Kubernetes Deployment with Helm
#100 opened by sajithaliyanage - 0
[GSoC 2021] Enable tor web URL support for CrawlerX
#101 opened by beshiniii - 0
- 0
- 0
- 0
- 0
- 0
- 0
- 0
- 2
- 0
Create Dockerfiles for CrawlerX modules
#46 opened by sandagomipieris - 1
- 0
.gitignore problem
#56 opened by ffalpha - 0
Missing forgot password functionality
#63 opened by ffalpha - 0
Exposing web app's firebase configuration
#58 opened by ffalpha - 0
Console warnings in Crawlerx App
#60 opened by ffalpha - 2
- 3
- 1
- 1
- 1
- 1
Create Projects section in front-end to manage multiple projects per user
#6 opened by sajithaliyanage - 1
- 1
Create crawler Job section in the Project section to schedule multiple jobs per project
#7 opened by sajithaliyanage - 1
- 1
- 1