Issues
- 5
scrapy.pqueues.ScrapyPriorityQueue
#6266 opened by roykyle8 - 3
Investigate speeding up `MockServer()`
#6255 opened by wRAR - 8
- 0
Add brotlicffi support
#6263 opened by Gallaecio - 2
Proxy tests don't use tests/keys/mitmproxy-ca.pem
#6258 opened by wRAR - 1
Explanation of the robots.txt exclusion standard in DownloaderMiddleware.robotstxt.py
#6244 opened by mery16q - 0
Fix and re-enable `unnecessary-comprehension` and `use-dict-literal` pylint tags
#6254 opened by wRAR - 0
Use `defusedxml.xmlrpc`
#6250 opened by wRAR - 7
Twisted and asyncio
#6219 opened by abebus - 4
execution of asyncio.ensure_future(coro()) ignored on close_spider() pipelines call
#6238 opened by abebus - 0
Replace urlparse with urlparse_cached where possible
#6228 opened by Gallaecio - 9
Switch to the latest sphinx
#6177 opened by wRAR - 0
Implement get_import _path
#6225 opened by Gallaecio - 2
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. scrapy 2.11.0 requires Twisted<23.8.0,>=18.9.0, but you have twisted 23.10.0 which is incompatible.
#6211 opened by Divesh1602 - 13
- 6
- 3
Import scrapy showing error
#6217 opened by ahammed-nibras - 11
When using mongodb MotorClient with scrapy, async with await will introduce Runtime error
#6214 opened by keatonLiu - 0
Cleanup deprecated fingerprint code in scrapy.utils.request
#6212 opened by wRAR - 4
Need support for making blank requests
#6203 opened by wAnFen1017 - 11
max_active_size gives no warning when queue processing blocked (can cause deadlock when deferring items in a pipeline)
#6206 opened by djay - 1
PyPy tests fail
#6204 opened by wRAR - 3
`FEED_EXPORT_BATCH_ITEM_COUNT` not working
#6185 opened by Mhassanniazi - 6
- 1
- 1
- 1
Contradiction in Documentation about installing scrapy
#6189 opened by nabhonil - 0
install scrapy for raspberry
#6188 opened by WangXin1708 - 2
Improve how combining DEFAULT_REQUEST_HEADERS with the Referer middleware is handled
#6184 opened by Gallaecio - 1
UserAgent middleware stopped the spider
#6187 opened by jacktang - 3
- 1
There are some requests in Scrapy's downloader.active that have not been released.
#6139 opened by Yoshiya1997 - 7
- 5
Pipeline send request
#6179 opened by zuozhehao - 2
Unification of log types
#6180 opened by zuozhehao - 2
AttributeError("Response content isn't text") -- linkextractor tries to extract PDF files when PDF is in deny_extension
#6159 opened by leeprevost - 3
Best Practices for Utilizing Built-in Scrapy Store Classes in Custom Extensions
#6161 opened by atc-artur - 0
Clean up test_download_gzip_response
#6153 opened by Gallaecio - 2
CI tests broken due to `sybil==6.0.0` release
#6152 opened by BurnzZ - 3
Parse function doesn't support other functions inside it
#6146 opened by ORENYT - 3
Prioritize hcf backend links
#6138 opened by Nishant-Bansal-777 - 0
- 1
- 1
Remove deprecated scrapy.utils.response.response_httprepr
#6111 opened by wRAR - 1
Warn about mutable objects in `Request.cb_kwargs` when `JOBDIR` is set
#6120 opened by Prometheus3375 - 3
Unserializable requests slow down the engine?
#6119 opened by Prometheus3375 - 1
Infinite request: producer-consumer scrapy
#6118 opened by Yakuho - 0
Remove scrapy.pipelines.media.MediaPipeline._make_compatible
#6107 opened by wRAR - 0
Remove deprecated JSONRequest
#6110 opened by wRAR - 1
Remove deprecated scrapy.utils.misc.extract_regex()
#6108 opened by wRAR