dotnetcore/DotnetSpider

Issues

• DataParser或者DataFlow里面怎么获取Iconfigration，注入不进去，request的params也传不过去

  #266 opened a month ago by dflstone
  1

• 定时爬虫，同一个地址每5分钟爬取一次，实现增量爬取，怎么实现

  #265 opened a month ago by dflstone
  3

• 能不能添加一个 类似 Web那边的Ajax的轻量级请求,最好是当前的DataParser 就返回结果的那种.

  #262 opened 3 months ago by sgf
  2

• 内部报错.

  #263 opened 3 months ago by sgf
  0

• 请教下url如何自定义传参

  #258 opened 5 months ago by onestar1
  2

• 考虑对接下 Litedb。

  #261 opened 4 months ago by sgf
  0

• How to read and parse a local html file.

  #260 opened 4 months ago by scharada
  1

• Sample需要更新

  #259 opened 5 months ago by JonahPeng
  1

• 【问题】spider 中怎么使用http代理

  #257 opened 6 months ago by hurui79
  1

• bug:‘xxxEntity’ does not contain a definition for 'GetTableMetadata'

  #254 opened 6 months ago by shelley-xl
  2

• 请问如何在存储数据之前，对数据进行过滤？

  #255 opened 6 months ago by shelley-xl
  1

• Unable to launch DotnetSpider.Agent program

  #256 opened 6 months ago by jasonzhouau
  2

• English documentations

  #250 opened 7 months ago by Sojaner
  1

• XPathSelector内存消耗过大

  #235 opened 7 months ago by ethanpeng8
  3

• 重试的request请求它的Properties和headers被清理掉了，请问怎么解决

  #231 opened 7 months ago by ethanpeng8
  3

• Builder无法引用

  #230 opened 7 months ago by impPDX
  3

• 我该如何获取多个元素

  #227 opened 7 months ago by JHeLiu
  2

• 怎么使用sqlserver数据库呢

  #224 opened 7 months ago by gongzhx1998
  3

• 怎样在DotnetSpider中使用PuppeteerSharp？

  #222 opened 7 months ago by Cyberphinx
  1

• 怎么样获取js渲染后的结果

  #247 opened 7 months ago by qazuc88
  0

• 是否支持自动登录然后刷新采集数据

  #253 opened 7 months ago by fayxue
  1

• Control the speed and throttle the crawling on slow response or failure

  #249 opened 9 months ago by Sojaner
  1

• Where can I find documentations?

  #248 opened 9 months ago by Sojaner
  1

• 用Host形式启动后，执行所有任务后仍在运行， 请问完成后怎么关闭

  #246 opened a year ago by ado5
  4

• [feature] 框架是否能自动生成Host request header

  #221 opened 2 years ago by a157147899
  3

• 发现宝藏

  #223 opened 2 years ago by x2031
  0

• 爬取一个日语酒店数据都是乱码

  #228 opened 2 years ago by fayxue
  1

• 请问能用一个Spider，然后通过数据库进行配置不同抓取规则，进行多个网站抓取吗？

  #232 opened 2 years ago by kevincwj2008
  1

• 自定义储存数据库问题

  #233 opened 2 years ago by dan1212-copy
  1

• DataParser解析HTML的BUG

  #236 opened 2 years ago by Gooopw
  1

• DotnetSpider.Portal项目的lib资源目录在哪里，源码里没找到？

  #226 opened 3 years ago by qiuliliang
  2

• 请求问题原因：Could not load type 'MySql.Data.MySqlClient.MySqlDbType' from assembly 'MySqlConnector, Version=1.0.0.0, Culture=neutral, PublicKeyToken=d33d3e53aa5f8c92

  #225 opened 3 years ago by qiuliliang
  1

• Bug: Could not load type 'MySql.Data.MySqlClient.MySqlDbType

  #211 opened 3 years ago by phungxuanvuong
  2

• [问题]爬取列表页API的场景

  #219 opened 3 years ago by a157147899
  2

• 下载的html乱码

  #220 opened 3 years ago by ainuo5213
  0

• 无法下载图片

  #204 opened 3 years ago by wf1999
  1

• 有没有考虑添加puppeteer playwright

  #212 opened 3 years ago by liukaigsx
  1

• 如何往界面元素上填账号密码，单面应用如何爬？

  #214 opened 3 years ago by dfengpo
  2

• 关于启动多个爬虫时Builder中启动HostService

  #213 opened 3 years ago by guanguanchuangyu
  3

• 如何往界面元素上填账号密码，

  #215 opened 3 years ago by dfengpo
  0

• 请问中文乱码如何处理

  #210 opened 3 years ago by zaishijieshang
  0

• QQ群477731655搜不到 是解散了吗？

  #209 opened 3 years ago by jlsqr
  1

• 列表页面和详情页面分成两个DataFlow

  #206 opened 4 years ago by Chfei1
  3

• 如何实现登录？

  #200 opened 4 years ago by ysqopen
  1

• 怎样将MySQL数据库切换到SQLserver

  #201 opened 4 years ago by Deven520
  1

• 获取指定域名全站的url

  #203 opened 4 years ago by guxing2
  1

• 数据和对应的html都是后加载如何爬取

  #205 opened 4 years ago by JYY20210419
  1

• 如何发起post请求，带body内容

  #207 opened 4 years ago by songyunhmiLY
  1

• Help me to join QQ group.

  #208 opened 4 years ago by phungxuanvuong
  0

• 建议楼主拆分项目

  #202 opened 4 years ago by LostAsk
  0