xgreat8
Head of Compute, ByteDance Infra US Lab. Working on Next Gen AI Infra, General Purpose Serverless, Graph ML, Graph Computing, Ray etc.
ByteDanceMountain View, CA
Pinned Repositories
autoprompt
AutoPrompt: Automatic Prompt Construction for Masked Language Models.
Awesome-CS-Books
:books: Awesome CS Books/Series(.pdf by git lfs) Warehouse for Geeks, ProgrammingLanguage, SoftwareEngineering, Web, AI, ServerSideApplication, Infrastructure, FE etc. :dizzy: 优秀计算机科学与技术领域相关的书籍归档
ColossalAI
Colossal-AI: A Unified Deep Learning System for Big Model Era
ColossalAI-Examples
Examples of training models with hybrid parallelism using ColossalAI
EnergonAI
Large-scale model inference.
fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
FastFold
Optimizing Protein Structure Prediction Model Training and Inference on GPU Clusters
InstructionWild
Llama-X
Open Academic Research on Improving LLaMA to SOTA LLM
LSH
Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
xgreat8's Repositories
xgreat8/autoprompt
AutoPrompt: Automatic Prompt Construction for Masked Language Models.
xgreat8/Awesome-CS-Books
:books: Awesome CS Books/Series(.pdf by git lfs) Warehouse for Geeks, ProgrammingLanguage, SoftwareEngineering, Web, AI, ServerSideApplication, Infrastructure, FE etc. :dizzy: 优秀计算机科学与技术领域相关的书籍归档
xgreat8/ColossalAI
Colossal-AI: A Unified Deep Learning System for Big Model Era
xgreat8/ColossalAI-Examples
Examples of training models with hybrid parallelism using ColossalAI
xgreat8/EnergonAI
Large-scale model inference.
xgreat8/fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
xgreat8/FastFold
Optimizing Protein Structure Prediction Model Training and Inference on GPU Clusters
xgreat8/InstructionWild
xgreat8/Llama-X
Open Academic Research on Improving LLaMA to SOTA LLM
xgreat8/LSH
Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
xgreat8/OFA
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
xgreat8/Oh-My-Dockerfile
A collection of dockerfiles for various tasks
xgreat8/OpenDelta
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
xgreat8/OpenPrompt
An Open-Source Framework for Prompt-Learning.
xgreat8/PatrickStar
PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
xgreat8/quokka
Fast data lake analytics/ETL/ML pipeline tool
xgreat8/self-instruct
Aligning pretrained language models with instruction data generated by themselves.
xgreat8/TensorNVMe
A Python library transfers PyTorch tensors between CPU and NVMe
xgreat8/torchrec
Pytorch domain library for recommendation systems
xgreat8/Uniserve
A runtime implementation of data-parallel actors.
xgreat8/vega
A new arguably faster implementation of Apache Spark from scratch in Rust
xgreat8/WAIT
xgreat8/wasm32-wasi-benchmark
xgreat8/x-deeplearning
An industrial deep learning framework for high-dimension sparse data