pip install requirements.txt
python start.py
- finetuning tasks
- text classification task
- text generation task
- token classification task
- text summarization task
- masked language modeling task
- question answering task
- adapters
- Pfeiffer Bottleneck
- Houlsby Bottleneck
- Parallel Bottleneck
- Scaled Parallel Bottleneck
- Compacter
- Compacter++
- Prefix Tuning
- Flat Prefix Tuning
- LoRA
- (IA)^3
- MAM Adapter
- UniPELT
- adapters compositions
- stack
- fuse
- split
- parallel
- methods and tools for efficient training
- gradient checkpointing
- mixed precision training
- quantization
- optimizer choice