Boris-code/feapder
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单,功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
PythonNOASSERTION
Issues
- 0
如何在 end_callback 关闭浏览器
#271 opened by pgshow - 0
请问feapder1.8.9是否支持自定义下载器
#270 opened by Sc-seven - 0
支持给Item也可以加入指定管道
#269 opened by xx299x - 0
为何我设置了永久去重以后,我连接的redis立马就崩溃
#268 opened by chujian - 11
playwright方式报错
#265 opened by wangfan002 - 0
新worker镜像打包,使用poetry 包管理失败
#267 opened by pandatools - 0
入库items 会出现重复
#266 opened by oyjcmyn - 1
指定parser_name和callback不生效
#242 opened by s2485523800 - 1
response 的判断
#258 opened by TTTSHU - 1
怎么将数据存入csv?可不可以给个demo
#209 opened by Shall-Ven - 1
网页返回编码错误
#264 opened by ruikai0103 - 5
浏览器渲染功能是否可以添加支持drissionpage库?
#252 opened by FRzhuizhu - 1
BatchSpider可以指定抓取时间吗?
#260 opened by keeleys - 0
增加Playwright 启动浏览器方式
#256 opened by apollo9527a - 0
怎么配合类似指纹浏览器那样方式工作?
#255 opened by apollo9527a - 1
如何让AirSpider在调用时每次的浏览器实例都为最新
#254 opened by javaswing - 1
mongo使用url连接副本集,不能使用yeild item来进行存储
#253 opened by dawn9551 - 3
批次爬虫获取redis中的任务时一直阻塞,任务存在就是不去执行,重新执行采集程序又正常了
#248 opened by JeffreyLiuJunJie - 2
feapder requests能支持curl_cffi类似绕过指纹吗
#247 opened by yuzhegan - 2
PLAYWRIGHT 默认开启无痕
#244 opened by jf888123 - 1
response.re_first()报错
#250 opened by ruikai0103 - 1
单机多进程模式下,MySQL 连接报错:通常每个套接字地址(协议/网络地址/端口)只允许使用一次
#227 opened by YufengSoft - 0
關於BatchSpider
#243 opened by bruce601080102 - 1
[Bug]: close_browser not working
#197 opened by BeanWei - 2
mysql 查询 有bug
#239 opened by heqiang - 3
render=True报错
#232 opened by xiaoqiangclub - 2
feapder v1.8.8 使用代理IP报错?
#236 opened by suyin-long - 3
如何在自定义下载器中启用setting中配置的代理?
#233 opened by suyin-long - 0
想要在start()启动爬虫的时候可以携带可变的初始url作为参数
#230 opened by xiaoqiangclub - 2
UpdateItem 批量更新数据问题
#221 opened by oyjcmyn - 2
- 1
解析不了web,python3.11、feapder1.8.5
#223 opened by pigeon-fancier - 5
因为代理实效导致的重试还是使用实效的那个IP
#226 opened by ubadly - 2
playwright 1.31.1的版本,开配置开启use_stealth_js=True时,会报错
#199 opened by demo1024 - 2
ERROR | logging:exception:line:1524 | global flags not at the start of the expression at position 2
#210 opened by LinMu746 - 0
- 1
selenimu 可以支持 有账号密码的代理吗
#218 opened by rottengeek - 0
浏览器渲染的一个问题?
#217 opened by lixiao888 - 4
怎么把数据保存为CSV文件?
#216 opened by liuchangfu - 0
redis keys 命令问题
#215 opened by lusi1990 - 2
Request 去重后一直重试, 并且提示加入队列成功,但是其实并没有加入队列
#207 opened by hijack911 - 2
关于yield feapder.Request中的优先级问题
#205 opened by tisoz - 0
- 0
一个spider文件的添加任务和开始爬虫的日志能否独立开
#203 opened by yyooovooo - 0
默认日志level改成warning
#201 opened by 0xxfu - 0
通过request.get_response请求网络,没法设置日志level
#200 opened by 0xxfu - 1
mysqldb close_connection问题
#195 opened by danerlt - 1
使用代理时诡异的连接失败的问题
#194 opened by pgshow - 1
Playwright 浏览器卡死的问题
#196 opened by pgshow - 1
无任务,爬虫结束
#191 opened by aneric16088