Alwahsh's Stars
AlibabaResearch/flash-llm
Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
janhq/jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
dendibakh/perf-ninja
This is an online course where you can learn and master the skill of low-level performance analysis and tuning.
sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
punica-ai/punica
Serving multiple LoRA finetuned LLM as one
Xilinx/mlir-aie
An MLIR-based toolchain for AMD AI Engine-enabled devices.
abdelfattah-lab/PQA
All-Hands-AI/OpenHands
🙌 OpenHands: Code Less, Make More
facebookresearch/faiss
A library for efficient similarity search and clustering of dense vectors.
MartaAndronic/PolyLUT
PolyLUT is the first quantized neural network training methodology that maps a neuron to a LUT while using multivariate polynomial function learning to exploit the flexibility of the FPGA soft logic.
microsoft/unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
IST-DASLab/gptq
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
google-research/long-range-arena
Long Range Arena for Benchmarking Efficient Transformers
DachengLi1/LongChat
Official repository for LongChat and LongEval
tatsu-lab/alpaca_eval
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
apoorvumang/prompt-lookup-decoding
inferflow/inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
facebookresearch/dietgpu
GPU implementation of a fast generalized ANS (asymmetric numeral system) entropy encoder and decoder, with extensions for lossless compression of numerical and other data types in HPC/ML applications.
ggerganov/llama.cpp
LLM inference in C/C++
pbelcak/UltraFastBERT
The repository for the code of the UltraFastBERT paper
meta-llama/codellama
Inference code for CodeLlama models
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
alibaba/clusterdata
cluster data collected from production clusters in Alibaba for cluster management research
LAION-AI/Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
Lightning-AI/pytorch-lightning
Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
ELS-RD/kernl
Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
allegroai/clearml-serving
ClearML - Model-Serving Orchestration and Repository Solution
ParametricPress/01-unraveling-the-jpeg
Source code for Unraveling the JPEG
facebookincubator/AITemplate
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.