TODO List
- (Done) Run some tutorial examples.
- (Done) Save PyTorch item, and print out in C++.
- (Done) Save PyTorch shard, and print out in C++.
- (Done) File size benchmark vs pickle.
- (Done) Migrate and optimize old code. Implement following functions:
- (Done) Save shard in Python.
- (Done) Load shard in C++ as dataset.
- (Done) Access sharded dataset in Python by pybind11.
- (Done) Remove the current package stuff!
- (Done) Make all the functionals class types.
- (Done) Send C++ item to PyTorch.
- (Done) Send PyTorch item to C++.
- (Done) Implement one function as a class, pass it to Python side, and pass back to C++ side to map a data sampler.
- Implement all LibriTTS dataloaders in Python.
- Build all non-sharding datasets.
- Build sharding datasets.