zhisbug

Asst. prof. at UCSD working on LLMs.

Pinned Repositories

alpa
Training and serving large-scale neural networks with auto parallelization.
Language:Python3k 45 295345
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Language:Python35.3k 346 1.7k4.3k
autodist
Simple Distributed Deep Learning on TensorFlow
Language:Python134 16 1225
bosen
Parallel ML System - Bosen project
Language:C++962 171 0290
pmls-caffe
PMLS-Caffe: Distributed Deep Learning Framework for Parallel ML System
Language:C++194 35 063
Cavs
Cavs: An Efficient Runtime System for Dynamic Neural Networks
Language:C++13 9 12
Megatron-LM
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Language:Python1 0 00
ray
An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
Language:Python3 0 01
ray-scalable-ml-design
Some microbenchmarks and design docs before commencement
Language:Python12 3 06

zhisbug/Cavs
Cavs: An Efficient Runtime System for Dynamic Neural Networks
Language:C++13 9 12
zhisbug/ray-scalable-ml-design
Some microbenchmarks and design docs before commencement
Language:Python12 3 06
zhisbug/ray
An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
Language:Python3 0 01
zhisbug/Megatron-LM
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Language:Python1 0 00
zhisbug/AutoLossRelease
1 0
zhisbug/caffe
Caffe: a fast open framework for deep learning.
Language:C++2 0
zhisbug/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Language:Python0 0
zhisbug/lm
Language:Python1 0
zhisbug/ludwig
Ludwig is a toolbox that allows to train and evaluate deep learning models without the need to write code.
Language:Python0 0
zhisbug/metaseq
Repo for external large-scale work
Language:Python0 0
zhisbug/models
Models and examples built with TensorFlow
Language:Python0 0
zhisbug/RC
My dev configurations
Language:Shell1 0
zhisbug/RFC
Community Documents
0 0
zhisbug/tensorflow
Computation using data flow graphs for scalable machine learning
Language:C++1 0
zhisbug/test-alpa-ci
Language:Shell1 0
zhisbug/test-alpa-ci-runner
1 0