fast-crawler/fastcrawler
Modern, fast (high-performance) asynchronous scraping framework based on standard Python type hints and Pydantic.
MIT
Pinned issues
Issues
- 0
- 0
Test Client
#45 opened by ManiMozaffar - 0
Impl DI Container & Dependency Injection
#66 opened by ManiMozaffar - 0
Improve dependency manager
#13 opened by ManiMozaffar - 0
Abstraction layer in Spider
#57 opened by ManiMozaffar - 1
Rename config class to Spider
#46 opened by ManiMozaffar - 0
Dev utilties
#23 opened by ManiMozaffar - 0
Logging handler
#19 opened by ManiMozaffar - 0
Parser perfomance issue
#56 opened by ManiMozaffar - 0
Define batching impl
#63 opened by ManiMozaffar - 0
doc src scheduler
#32 opened by ManiMozaffar - 0
Change unit tests to use pytest
#44 opened by ManiMozaffar - 0
implement File saver
#62 opened by ManiMozaffar - 0
Implement retry middleware
#61 opened by ManiMozaffar - 0
user agent pool middleware
#60 opened by ManiMozaffar - 0
doc src for parser
#33 opened by ManiMozaffar - 0
kafka saver impl
#59 opened by ManiMozaffar - 0
rabbitmq saver impl
#58 opened by ManiMozaffar - 1
Required features for core are missing
#50 opened by ManiMozaffar - 0
Limit request in Aio Engine
#54 opened by ManiMozaffar - 0
CI/CD for docs on github
#31 opened by ManiMozaffar - 0
Adding docs for website's doc service
#12 opened by ManiMozaffar - 0
Implement scheduling and task managing
#14 opened by ManiMozaffar - 0
Implement base of API Integrations
#42 opened by ManiMozaffar - 0
Implement a client
#48 opened by ManiMozaffar - 0
Decrease runtime of tests in engine
#47 opened by ManiMozaffar - 0
configure setup.py
#43 opened by ManiMozaffar - 0
Implement Middleware
#18 opened by ManiMozaffar - 0
Error in tox - checks.sh file
#27 opened by aerosadegh - 0
Protect branches
#25 opened by ManiMozaffar - 0
non-blocking async core
#41 opened by ManiMozaffar - 0
Implement core
#16 opened by ManiMozaffar - 0
Improve issue/pr template
#15 opened by ManiMozaffar - 0
Redesign file names and etc
#38 opened by ManiMozaffar - 0
- 0
Add guidelines for contributing
#36 opened by ManiMozaffar - 1
Incompatible Deps
#7 opened by aerosadegh - 0
Implementing aiohttp
#10 opened by ManiMozaffar - 0
Add support for selectolax
#17 opened by ManiMozaffar - 0
Separate dependencies
#24 opened by ManiMozaffar - 0
Change regex strategy for searching in HTML
#22 opened by ManiMozaffar - 0
- 0
doc src core
#34 opened by ManiMozaffar - 1
CI Pipeline is broken
#9 opened by ManiMozaffar - 0
Non-abusive robots.txt
#8 opened by ManiMozaffar - 0
Failure Handler Schedule
#2 opened by ManiMozaffar - 0
Improving documentation on developer branch
#11 opened by ManiMozaffar - 0
CSS Selector support
#3 opened by ManiMozaffar