ys-eric-choi

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

bertsearch

Elasticsearch with BERT for advanced document search.

FasterTransformer

Transformer related optimization, including BERT, GPT

fastertransformer_backend

KLUE

Korean NLU Benchmark

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

ys-eric-choi/accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

ys-eric-choi/bertsearch

Elasticsearch with BERT for advanced document search.

ys-eric-choi/FasterTransformer

Transformer related optimization, including BERT, GPT

ys-eric-choi/fastertransformer_backend

ys-eric-choi/KLUE

Korean NLU Benchmark

ys-eric-choi/server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

ys-eric-choi/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

ys-eric-choi/tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

ys-eric-choi/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs