/data2vec

Primary LanguageJupyter Notebook

Work in progress

Implementation of Meta AI Data2Vec inspired by Pytorch Lighntning implementation of BYOL

TODOs

  • Implement data augmentation pipeline
  • Verify Implementation