cern-sis/issues-inspire

backend tests fail randomly (?)

Closed this issue · 1 comments

test / test-backend (integration, 8) / test (4) fails randomly almost every time the workflow is ran. It makes it impossible to merge anything, on simple UI pr I had to run the test 4 times for it to finally work. It needs to be fixed.

UPDATE:

After monitoring for some time, this is a list of tests that failed multiple times during gh workflow runs:

  • FAILED tests/integration/records/serializers/test_cv.py::test_cv_search - ass...
  • FAILED tests/integration/records/serializers/test_cv.py::test_cv_search_with_more_complex_records
  • FAILED tests/integration/search/test_aggregations.py::test_hep_subject_aggregation_and_filter_unkown
  • FAILED tests/integration-async/records/test_tasks.py::test_recalculate_references_after_literature_record_merge
  • FAILED tests/integration-async/disambiguation/test_disambiguation_tasks.py::test_disambiguation_on_record_update_ambiguous_match

Part of the issue is that some assertions fail due to different order of elements in compared lists (i.e. here). We could approach this by sorting the lists before assertion.