fredwu/crawler

Issues

• How to deal with WX?

  #37 opened 5 months ago by yujonglee
  1

• Switch to Req

  #35 opened 9 months ago by cpursley
  0

• Request for a working example

  #33 opened a year ago by shellking4
  0

• High performance: Store gets flooded when too many pages are crawled

  #28 opened a year ago by happysalada
  6

• Filter by dynamic base URL

  #21 opened a year ago by safwank
  3

• Crawler killed from consuming all memory or processes

  #9 opened a year ago by robvolk
  17

• Retrieving all items in Crawler.Store

  #25 opened a year ago by mikhailbot
  2

• could not compile dependency :crawler

  #31 opened 5 years ago by diegosouza
  4

• When finished

  #26 opened 5 years ago by umuro
  1

• Question: What did you use for the SVG graphics

  #30 opened 5 years ago by fkumro
  1

• plug_cowboy dependency

  #22 opened 6 years ago by phereford
  4

• Cutting a new release?

  #20 opened 6 years ago by safwank
  2

• ** (ArgumentError) invalid syntax, only "retry", "after" and "else" are permitted

  #18 opened 6 years ago by simonbowen
  3

• Is there a view to determine webfonts used?

  #19 opened 6 years ago by untoldbyte
  1

• Links with space are not url encoded and return 404

  #12 opened 6 years ago by julienmarie
  3

• robots.txt

  #8 opened 7 years ago by dc0d
  1

• Is the crawler able to get async javascript render contents?

  #7 opened 7 years ago by loongmxbt
  1

• Why not use floki as a DSL for scraping page content ?

  #1 opened 7 years ago by merongivian
  3

• Example Project for basic config

  #3 opened 7 years ago by cdesch
  8

• customization strategy

  #2 opened 7 years ago by sensiblearts
  8