mazieres/crawtext_old

Issues

• Google Syntax in query

  #2 opened 12 years ago by mazieres
  0

• gestion du nb de crawl simultané

  #11 opened 12 years ago by mazieres
  0

• Gestion Threads

  #4 opened 12 years ago by mazieres
  0

• Pattern.py bug on anchor strippin'

  #10 opened 12 years ago by mazieres
  0

• remove copyright from website

  #6 opened 12 years ago by mazieres
  0

• Remember the depth where pages are discovered

  #8 opened 12 years ago by mazieres
  0

• remember occurences of relevant pages discovery

  #9 opened 12 years ago by mazieres
  0

• better outlink classification

  #7 opened 12 years ago by mazieres
  0

• keep pages sources in DB

  #5 opened 12 years ago by mazieres
  0

• Handle Timeout, 403, 404

  #3 opened 12 years ago by mazieres
  0

• Allow indexation of PDF

  #1 opened 12 years ago by mazieres
  0