sywangyi

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

haystack

:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex decision making, question answering, semantic search, text generation applications, and more.

hf-diffusers-sd-finetuning

intel-extension-for-transformers

Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

sywangyi/evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

sywangyi/transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

sywangyi/accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

sywangyi/AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

sywangyi/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

sywangyi/diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

sywangyi/haystack

:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex decision making, question answering, semantic search, text generation applications, and more.

sywangyi/hf-diffusers-sd-finetuning

sywangyi/intel-extension-for-transformers

Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.

sywangyi/lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

sywangyi/neural-compressor

Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.

sywangyi/optimum-habana

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

sywangyi/optimum-intel

Accelerate inference of 🤗 Transformers with Intel optimization tools

sywangyi/peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

sywangyi/pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

sywangyi/testcase

HF testcase

sywangyi/text-generation-inference

Large Language Model Text Generation Inference

sywangyi/transformers-bloom-inference

Fast Inference Solutions for BLOOM

sywangyi/trl

Train transformer language models with reinforcement learning.

sywangyi/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs