Pinned Repositories
torchscale
Foundation Architecture for (M)LLMs
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
longvit_ckpts
torchscale
Transformers at any scale
unilm
UniLM - Unified Language Model Pre-training
vlmo_ckpts
webdataset
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
wenhui0924's Repositories
wenhui0924/webdataset
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
wenhui0924/CLIP
Contrastive Language-Image Pretraining
wenhui0924/fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
wenhui0924/torchscale
Transformers at any scale
wenhui0924/unilm
UniLM - Unified Language Model Pre-training