dataabc/weibo-crawler

Issues

• 下载微博视频时可以选择最高画质来下载吗？

  #455 opened 3 months ago by minecraftyusei
  2

• API 抓取失败，返回结构不符合预期（账号风控）

  #461 opened 2 months ago by FruityMaxine
  4

• 非常感谢大佬开源的代码，我二开后，现已可以实现下载所有评论，如有需要代码，我直接提个PR

  #458 opened 2 months ago by ooliveso
  4

• 加了cookie之后获取页面变得很慢

  #466 opened 2 months ago by CCMonkeyss
  2

• get_long_weibo函数重试5次仍然失败的处理

  #465 opened 2 months ago by MiSanl
  1

• 爬虫速度好慢

  #460 opened 2 months ago by xubing8
  2

• lxml的依赖应该升级了

  #463 opened 2 months ago by hjyssg
  3

• 运行显示【KeyError: 'data'】该如何解决

  #462 opened 2 months ago by tsumichan1
  1

• 我写了一个浏览本地微博的工具，如果可以，能否在README中放一个链接

  #459 opened 2 months ago by waizui
  1

• 微博爬取截止时间

  #444 opened 7 months ago by DoloresTu
  3

• Could not install packages due to an OSError: Missing dependencies for SOCKS support.

  #457 opened 2 months ago by LiuKk699
  1

• 请问为什么微博账号符合要求，却仍然cookie失效呢

  #456 opened 3 months ago by LvYingqi
  3

• 有办法突破专属会员鉴权吗

  #446 opened 6 months ago by frozenbeanxxx
  3

• Docker image文件很大

  #452 opened 3 months ago by socratesng
  3

• m.weibo.cn 无法查看全部微博

  #451 opened 4 months ago by diqiuonline
  1

• LivePhoto 没有爬取到，已经添加了cookie

  #448 opened 6 months ago by hwangzhun
  9

• 打扰了，运行完毕后csv文件始终显示文件未完全加载

  #449 opened 5 months ago by FleeNotFree
  2

• 不错。能下载全部的原创微博图片。

  #447 opened 6 months ago by zhanghengli1998
  0

• 运行之后总是显示config.json格式不正确

  #445 opened 6 months ago by Lzcns
  2

• 无法爬取地区、学校、生日相关信息

  #443 opened 7 months ago by YiCheng996
  3

• 被ban了

  #440 opened 7 months ago by hyliush
  1

• 怎么爬取用户的ip归属地呢？

  #431 opened 8 months ago by crazyegg111
  7

• COOKIES没有失效，但是Progress:  19%就结束了，可能是什么原因？

  #426 opened 9 months ago by wendywjhu
  3

• Docker 定时跑时，图片和视频是否是反复下载？

  #436 opened 8 months ago by niubird00
  0

• sqlite储存数据非常大

  #435 opened 8 months ago by hibread
  1

• csv中抓取的用户头像链接有时候会失效怎么解决？

  #434 opened 8 months ago by gjxloveu
  1

• 转发和评论好像出现了奇怪的问题

  #433 opened 8 months ago by gjxloveu
  1

• 请问下载的评论在哪

  #432 opened 8 months ago by gjxloveu
  1

• “检测cookie是否有效”的功能失效

  #429 opened 9 months ago by Pangweiyun
  2

• 爬取的图片名字里有一个奇怪的T

  #428 opened 9 months ago by Pangweiyun
  1

• 当单个微博图片超过9张时，weibo-crawler只能下载9张

  #427 opened 9 months ago by Pangweiyun
  2

• 求助-爬微博进度100%，但是数量明显跟实际数量不一致有可能是何原因？

  #424 opened 9 months ago by wendywjhu
  3

• 如何爬取微博正文时展开全文爬取到完整内容

  #425 opened 9 months ago by jingyoung115
  1

• 微博内容（Weibo.text）最大长度报错问题

  #423 opened 9 months ago by wendywjhu
  1

• 某行是一条独立换行内容的时候这个换行最终读取到MYSQL会被省略掉

  #422 opened 9 months ago by wendywjhu
  0

• 你好，我想下载所有微博正文，该怎么设置呢？

  #420 opened 9 months ago by copymonopoly
  3

• docker镜像

  #421 opened 9 months ago by JadePureOne
  1

• 为什么按照你的文档配置还是不能写入MySQL数据库，按照之前的有错误的地方，我也添加

  #419 opened 10 months ago by markhome1
  3

• 批量下载时，中间有提示错误，但是下载还是继续，其他微博的下载也正常

  #417 opened 10 months ago by wangshiyijiu
  3

• 可不可以把爬取到的评论直接以csv的格式显示，不放在sqlte数据库里面

  #416 opened a year ago by linning00
  1

• 如果是长微博出现'全文'字样爬取不全

  #413 opened a year ago by HanchuQin
  3

• max_id_type错误

  #412 opened a year ago by haohaomiao
  1

• string indices must be integers, not 'str'

  #411 opened a year ago by nanamicat
  3

• 微博用户注册信息

  #409 opened a year ago by alewina
  1

• 数据库表问题

  #408 opened a year ago by ElvisDream
  1

• 配置了数据库信息，但实际创建数据库连接报错

  #406 opened a year ago by ElvisDream
  1

• 数据库表问题

  #407 opened a year ago by ElvisDream
  0

• Aug 30 版本无法下载超过9张图的原创微博，第10张起都不下载

  #405 opened a year ago by Charrine
  1

• feature request: jsonc support

  #404 opened a year ago by lengyijun
  1

• 运行时提示main文件里需要schedule_interval参数

  #403 opened a year ago by TheYJie
  1