Pinned Repositories
accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
evaluate
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
haystack
:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex decision making, question answering, semantic search, text generation applications, and more.
hf-diffusers-sd-finetuning
intel-extension-for-transformers
Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.
lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
sywangyi's Repositories
sywangyi/evaluate
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
sywangyi/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
sywangyi/accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
sywangyi/AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
sywangyi/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
sywangyi/diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
sywangyi/haystack
:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex decision making, question answering, semantic search, text generation applications, and more.
sywangyi/hf-diffusers-sd-finetuning
sywangyi/intel-extension-for-transformers
Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.
sywangyi/lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
sywangyi/neural-compressor
Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.
sywangyi/optimum-habana
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
sywangyi/optimum-intel
Accelerate inference of 🤗 Transformers with Intel optimization tools
sywangyi/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
sywangyi/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
sywangyi/testcase
HF testcase
sywangyi/text-generation-inference
Large Language Model Text Generation Inference
sywangyi/transformers-bloom-inference
Fast Inference Solutions for BLOOM
sywangyi/trl
Train transformer language models with reinforcement learning.
sywangyi/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs