alephdata/memorious

Issues

• example: version format is invalid

  #236 opened 2 months ago by mingfang
  0

• Update docs for `aleph_emit_document` operation

  #232 opened a year ago by tillprochaska
  1

• Is it possible to prerender pages before parsing?

  #218 opened a year ago by ninoppp
  0

• malformed yaml results to an error in listing crawlers

  #217 opened 2 years ago by zufanka
  0

• sqlachemy version

  #214 opened 2 years ago by rewiaca
  0

• Create an image which supports python 3.10

  #208 opened 2 years ago by Rosencrantz
  1

• Rename master branch to main

  #211 opened 2 years ago by Rosencrantz
  0

• nothing

  #210 opened 2 years ago by Rosencrantz
  0

• Filepaths that are longer than 255 characters should be shortened

  #202 opened 2 years ago by breyten
  1

• Memorious session information expiration

  #203 opened 2 years ago by monneyboi
  1

• Example won't run `no module named 'example'`

  #201 opened 2 years ago by monneyboi
  3

• Do some test stuff

  #195 opened 3 years ago by Rosencrantz
  1

• Possible improvements to how we test Memorious

  #199 opened 3 years ago by sunu
  0

• Ingesting multiple files from a single page into Aleph and creating ftm entities

  #192 opened 3 years ago by uhhhuh
  1

• `aleph_emit` fails with data validation error

  #194 opened 3 years ago by uhhhuh
  0

• Using the standard parse function for creating entities does not generate an entity_id

  #187 opened 3 years ago by Rosencrantz
  1

• Support for media monitoring

  #153 opened 3 years ago by pudo
  1

• documentcloud operation should parse `publisher` document metadata and `aleph_emit` should be able to push it to Aleph

  #182 opened 3 years ago by sunu
  0

• Prevent the docker build/push from running on forks of memorious

  #180 opened 3 years ago by Rosencrantz
  2

• Reference documents from structured data scrapes

  #65 opened 3 years ago by pudo
  1

• Different behaviour between FakeRedis and real redis

  #144 opened 3 years ago by simonwoerpel
  2

• Let other users add and run their own crawlers on our platform

  #68 opened 3 years ago by sunu
  1

• Make sure crawler status actively updates periodically instead of relying on page reload

  #75 opened 3 years ago by sunu
  1

• Cannot find crawlers in list

  #124 opened 3 years ago
  4

• Add user authentication and scraper namespacing to Memorious

  #67 opened 3 years ago by sunu
  1

• Include mapping inside memorious crawler

  #60 opened 3 years ago by uhhhuh
  1

• Ability to start or cancel multiple crawlers at a time

  #76 opened 3 years ago by sunu
  1

• Implement search/filtering for scrapers UI

  #64 opened 3 years ago by uhhhuh
  1

• Scheduled crawler don't run.

  #142 opened 3 years ago by hsnamIT
  1

• Large crawlers fill up the queue and run out of memory when running in sync mode

  #165 opened 3 years ago by sunu
  1

• Retry to establish database and redis connection a few times before raising an error

  #181 opened 3 years ago by sunu
  0

• Make memorious run a crawler based on a yaml file

  #150 opened 3 years ago by sunu
  1

• documentcloud integration may need to be reviewed

  #168 opened 3 years ago by Rosencrantz
  4

• Add file path information to dav_index

  #152 opened 3 years ago by uhhhuh
  0

• Indexing Atlassian Confluence

  #154 opened 4 years ago by pudo
  3

• Dependabot couldn't authenticate with https://pypi.python.org/simple/

  #139 opened 4 years ago by dependabot-preview
  0

• proxy handler for memorious

  #125 opened 4 years ago
  5

• fetch should ignore mailto links

  #128 opened 4 years ago by rhiaro
  3

• Normalized URLs and non-reproducibility

  #94 opened 5 years ago by moreymat
  3

• Implement Aleph bulk upload as an aggregation operation

  #61 opened 5 years ago by sunu
  7

• normalize_url: False does not disable URL normalization

  #87 opened 5 years ago by moreymat
  1

• HelpWanted

  #89 opened 5 years ago by nvelumani
  1

• Frequent database deadlock errors

  #77 opened 5 years ago by sunu
  1

• Installation instructions: /bin/bash absent from alpine

  #78 opened 5 years ago by SylvainLapoix
  2

• `memorious run` command never finishes

  #74 opened 5 years ago by alexmojaki
  3

• Running a scraper in the example fails with an error when calling context.set_tag(tag, None)

  #72 opened 5 years ago by alexmojaki
  5

• Use the OCR service thorugh the ServiceLayer

  #63 opened 5 years ago by uhhhuh
  0

• Why is `cleanup` removed?

  #70 opened 5 years ago by pohnean
  4

• Move aleph_emit operation into alephclient

  #66 opened 5 years ago by sunu
  0

• Document the `nested db` operation

  #62 opened 5 years ago by uhhhuh
  0