Alwahsh

Alwahsh's Stars

• AlibabaResearch/flash-llm

  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity

  Language:Cuda16413

• janhq/jan

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

  Language:TypeScript21.9k1.3k

• dendibakh/perf-ninja

  This is an online course where you can learn and master the skill of low-level performance analysis and tuning.

  Language:C++2.4k206

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python5k343

• punica-ai/punica

  Serving multiple LoRA finetuned LLM as one

  Language:Python94042

• Xilinx/mlir-aie

  An MLIR-based toolchain for AMD AI Engine-enabled devices.

  Language:MLIR28079

• abdelfattah-lab/PQA

  Language:Python3

• All-Hands-AI/OpenHands

  🙌 OpenHands: Code Less, Make More

  Language:Python31.1k3.6k

• facebookresearch/faiss

  A library for efficient similarity search and clustering of dense vectors.

  Language:C++30.4k3.5k

• MartaAndronic/PolyLUT

  PolyLUT is the first quantized neural network training methodology that maps a neuron to a LUT while using multivariate polynomial function learning to exploit the flexibility of the FPGA soft logic.

  Language:Python364

• microsoft/unilm

  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

  Language:Python19.5k2.5k

• IST-DASLab/gptq

  Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

  Language:Python1.9k150

• google-research/long-range-arena

  Long Range Arena for Benchmarking Efficient Transformers

  Language:Python71077

• DachengLi1/LongChat

  Official repository for LongChat and LongEval

  Language:Python50429

• tatsu-lab/alpaca_eval

  An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

  Language:Jupyter Notebook1.4k221

• EleutherAI/lm-evaluation-harness

  A framework for few-shot evaluation of language models.

  Language:Python6.3k1.7k

• apoorvumang/prompt-lookup-decoding

  Language:Jupyter Notebook43622

• inferflow/inferflow

  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

  Language:C++23224

• facebookresearch/dietgpu

  GPU implementation of a fast generalized ANS (asymmetric numeral system) entropy encoder and decoder, with extensions for lossless compression of numerical and other data types in HPC/ML applications.

  Language:Cuda30527

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++64.6k9.3k

• pbelcak/UltraFastBERT

  The repository for the code of the UltraFastBERT paper

  Language:Python50833

• meta-llama/codellama

  Inference code for CodeLlama models

  Language:Python15.8k1.8k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python26.1k3.8k

• alibaba/clusterdata

  cluster data collected from production clusters in Alibaba for cluster management research

  Language:Jupyter Notebook1.6k403

• LAION-AI/Open-Assistant

  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  Language:Python36.9k3.2k

• Lightning-AI/pytorch-lightning

  Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

  Language:Python27.9k3.3k

• ELS-RD/kernl

  Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

  Language:Jupyter Notebook1.5k93

• allegroai/clearml-serving

  ClearML - Model-Serving Orchestration and Repository Solution

  Language:Python13640

• ParametricPress/01-unraveling-the-jpeg

  Source code for Unraveling the JPEG

  Language:JavaScript24421

• facebookincubator/AITemplate

  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

  Language:Python4.5k362