xuxueli/xxl-crawler

Issues

• 发送post请求时返回400

  #23 opened 5 years ago by 2637977081
  1

• 是否允许基于身份认证的爬虫

  #35 opened a year ago by xcmonline
  0

• pageVo对象注入使用get/set

  #7 opened 6 years ago by wysnxzm
  1

• 优化setPageParser避免匿名函数

  #6 opened 6 years ago by wysnxzm
  2

• 目前可使用用的选择器过少

  #5 opened 6 years ago by wysnxzm
  2

• selectType.VAL 貌似存在问题

  #8 opened 6 years ago by wysnxzm
  1

• 接入xxl-crawler的公司请留下 ”公司名称 + 公司官网地址“，谢谢。

  #1 opened 7 years ago by xuxueli
  2

• 请问该项目还维护和更新吗

  #32 opened 2 years ago by mackyuqimack
  1

• JsoupUtil工具类loadPageSource()方法里Connection没有调用requestBody

  #31 opened 3 years ago by AlexWang1988
  0

• 使用SeleniumPhantomjsPageLoader后，jsoup解析后document对象中的baseUri为空

  #27 opened 4 years ago by VincentHQL
  0

• connect timeout超时处理

  #26 opened 5 years ago by chougaigai
  0

• com.xuxueli.crawler.thread.CrawlerThread#processPage问题

  #25 opened 5 years ago by landy8530
  0

• 请问一下，有登录后再爬取内容的功能吗？

  #24 opened 5 years ago by landy8530
  0

• setWhiteUrlRegexs正则传参不起作用

  #22 opened 5 years ago by zhangnd
  0

• 【需求】VO嵌套

  #17 opened 5 years ago by yuki-xin
  1

• [issue] 多线程情况下，tryFinish()很小的概率会误判当前运行状态

  #21 opened 5 years ago by 1988tianyuan
  1

• [新需求]针对post请求，相同的url，根据参数不同返回不同结果的页面抓取实现

  #15 opened 5 years ago by zhaoxin1124
  1

• 扩散全站功能异常问题.

  #20 opened 5 years ago by lihuiby
  1

• 线程安全问题

  #19 opened 5 years ago by lihuiby
  0

• maven引入1.2.2版本，测试07报错

  #16 opened 5 years ago by 437865981
  1

• ajax请求爬取

  #14 opened 6 years ago by windhc
  0

• 建议使用jdk1.8

  #13 opened 6 years ago by windhc
  1

• CrawlerThread的process方法里判断当前链接是否是白名单链接逻辑有问题

  #12 opened 6 years ago by lomoye
  1

• 能否支持获取js执行之后的网页

  #9 opened 6 years ago by hgx
  2

• 爬取到的页面可能出现"截断"问题-----网瘾少年徐志摩

  #10 opened 6 years ago by wysnxzm
  0