cardano-foundation/cf-java-rewards-calculation

[๐Ÿ‘ท Task]: Move the test data to an S3 bucket and remove it from the actual repository

fabianbormann opened this issue ยท 0 comments

Is there an existing issue for this?

  • I have searched the existing issues

Task description ๐Ÿ”จ๐Ÿ”ง

Even if the data used by the JSON data provider is aggregated and less than the data in DB Sync, it is growing and growing over time. It makes sense to remove this test data from the repository.

  • Move the test data to an S3 bucket
  • Provide a how to fetch the data
  • Include the data folder in the .gitignore
  • Remove those folders from the git history as well to reduce the disk size of this project
  • Change the report generation and test pipeline to fetch the data on-the-fly from the bucket

Anything else?

No response