tokenmill/crawling-framework

Issues

• Deleting http source should invoke dialog menu

  #27 opened a year ago by dainiusjocas
  0

• Relative date should be the date of parsing

  #19 opened a year ago by dainiusjocas
  0

• Autocomplete on source field

  #21 opened a year ago by dainiusjocas
  0

• Topology Worker Increase Not Doing Crawling.

  #45 opened 5 years ago by rishrockstar
  0

• Provide default values for ES index creation script

  #34 opened 5 years ago by dainiusjocas
  0

• Start crawler with a simple `docker-compose up`

  #36 opened 5 years ago by dainiusjocas
  0

• Setup a proper CI/CD

  #40 opened 5 years ago by dainiusjocas
  0

• Separate integration tests from unit tests

  #39 opened 5 years ago by dainiusjocas
  0

• Prepare a demo crawler with bbc configuration

  #38 opened 5 years ago by dainiusjocas
  0

• ES index config should have `fielddata` enabled for text fields

  #33 opened 6 years ago by dainiusjocas
  0

• tag cloud in kibana on text field

  #32 opened 6 years ago by dainiusjocas
  1

• Export some data by query

  #31 opened 6 years ago by dainiusjocas
  0

• Extracted document should hava name from source for filtering

  #30 opened 6 years ago by dainiusjocas
  0

• Article fingerprint for deduplication

  #26 opened 6 years ago by dainiusjocas
  1

• Use canonical url for duplicate detection

  #12 opened 6 years ago by zmedelis
  0

• Search for tests

  #24 opened 6 years ago by dainiusjocas
  0

• Inside source config indicate that the crawl is not happening

  #11 opened 7 years ago by zmedelis
  1

• Management UI should have paging for tests

  #13 opened 6 years ago by dainiusjocas
  0

• Management UI related write actions should be commited Immediately

  #18 opened 6 years ago by dainiusjocas
  0

• REST API to import/export crawler configuration

  #2 opened 7 years ago by dremeika
  0

• Evaluate http sources from CSV

  #20 opened 6 years ago by dainiusjocas
  0

• URL date should not be used as publication date hint

  #5 opened 6 years ago by dremeika
  0

• Bulk update updates docs with wrong url

  #17 opened 6 years ago by dainiusjocas
  0

• BulkProcessor and the RestHighLevelClient treats url encoded urls differently

  #16 opened 6 years ago by dainiusjocas
  0

• Management UI null pointer exception

  #15 opened 6 years ago by dainiusjocas
  0

• HttpArticle should include language attribute

  #14 opened 6 years ago by dainiusjocas
  0

• Management UI paging of HTTP sources

  #9 opened 7 years ago by dainiusjocas
  1

• Management UI search as you type

  #8 opened 7 years ago by dainiusjocas
  1

• URL status after partial data analysis should have a unique status

  #10 opened 7 years ago by dainiusjocas
  0

• Log actual LD+JSON on parsing error

  #6 opened 7 years ago by dremeika
  0

• Write installation instructions and documentation

  #4 opened 7 years ago by dremeika
  0

• Create example project which uses crawling-framework

  #3 opened 7 years ago by dremeika
  1

• Auto-create ElasticSearch indexes if they don't exist

  #1 opened 7 years ago by dremeika
  0