okbalefthanded/aawedha

[features] Add pipeline

Opened this issue · 7 comments

  • evaluation pipeline
  • Cross validation strategies available:
  • Kfold (only for SingleSubject evaluation)
  • Shufflesplit (for both types of evaluation: Single/Cross subject)

Long running evaluations may face interruptions, a checkpoint mechanism is required to resume operations from interruption point

  • Evaluation checkpoint and resume

Add Cross dataset evaluation for domain adaptation

  • CrossSet
  • Hyperparameter tuning with Keras-tuner
  • Experimental:
  • Add preprocessing layers before any model
  • Break pipeline : delete preprocessing methods and leave it to the model
  • Set image date format in the evaluation for model's training/inference consistency on GPU/TPU/CPU.
  • Add Debug mode to evaluation:
    • Keras Tensorboard callback.
    • TF Debugging V2