xirtah/gopa-spider

Issues

• Admin UI not showing redirected tasks

  #22 opened 5 years ago by LzrBear
  0

• Sites which do a redirect are all being marked a duplicates of each other

  #19 opened 5 years ago by LzrBear
  2

• Tasks marked as duplicated need to have their next check value nulled

  #20 opened 5 years ago by LzrBear
  0

• Memory leak in the parse_pdf joint

  #18 opened 5 years ago by LzrBear
  0

• Diskqueues don't allow for horizontal scalability

  #17 opened 5 years ago by LzrBear
  2

• Separate the admin ui from the spider

  #16 opened 5 years ago by LzrBear
  0

• Dates on task view screen should be shown in local time

  #15 opened 5 years ago by LzrBear
  0

• Dispatcher can not find gopa-hostconfig index in elasticsearch

  #14 opened 5 years ago by LzrBear
  0

• Add Joint to parse and index pdfs

  #9 opened 6 years ago by LzrBear
  1

• When a page has a link on it with auto-generated url params going to itself the spider gets stuck in a never ending loop

  #11 opened 6 years ago by LzrBear
  2

• Draw out pipeline end to end

  #13 opened 6 years ago by LzrBear
  0

• Adding new joints doesn't update existing parsed urls due to the snapshot not changing

  #12 opened 6 years ago by LzrBear
  0

• update to use a jenkins file for the build server

  #10 opened 6 years ago by LzrBear
  0

• split up framework, spider, and UI

  #2 opened 6 years ago by LzrBear
  1

• snapshots currently not working

  #3 opened 6 years ago by LzrBear
  2

• admin tasks filter count number on tab not working

  #4 opened 6 years ago by LzrBear
  1

• Named entity recognition joint configurable parameter URL_coreNLP not being adhered to

  #6 opened 6 years ago by LzrBear
  1

• Realtime logging on admin console page is broken.

  #8 opened 6 years ago by LzrBear
  0