ARTIST-Association/ARTIST

Reproducibility Mode

Opened this issue · 1 comments

kalebphipps commented

Is your feature request related to a problem? Please describe.
Currently, it may be difficult to reproduce results in ARTIST.

Describe the solution you'd like
ARTIST should have a reproducibility mode, which automatically sets all seeds from Python, Numpy, and Torch to a predefined value and activates the torch.use_deterministic_algorithms() function.

kalebphipps commented

In Addition - Seed for reproducibility: ARTIST currently uses a fixed seed of 7 if no user-provided seed value is passed. However, it would be useful for a different random seed, e.g., based on the current time and not a fixed default value, to be used every time the program is run. Therefore, fixing this Issue should further involve:

  • If ARTIST is in reproducibility Mode, then a fixed seed should be considered.
  • If not, ARTIST should determine a random seed.
  • If a user seed is provided, this should dominate and be used throughout!