ItsAbdula

ItsAbdula's Stars

• SafeAILab/EAGLE

  Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)

  Language:Python81280

• UChi-JCL/CacheGen

  Language:Python618

• PSAL-POSTECH/ONNXim

  ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference

  Language:C++6211

• mit-han-lab/lmquant

  Language:Python11510

• rapidsai/cuvs

  cuVS - a library for vector search and clustering on the GPU

  Language:Cuda20667

• microsoft/Samba

  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"

  Language:Python80148

• friendliai/LLMServingPerfEvaluator

  Language:Python40

• mistralai/mistral-inference

  Official inference library for Mistral models

  Language:Jupyter Notebook9.7k860

• openvinotoolkit/openvino

  OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

  Language:C++7.2k2.3k

• RussWong/CUDATutorial

  A CUDA tutorial to make people learn CUDA program from 0

  Language:Cuda19450

• haotian-liu/LLaVA

  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

  Language:Python20k2.2k

• OpenNMT/CTranslate2

  Fast inference engine for Transformer models

  Language:C++3.4k299

• lapp0/lm-inference-engines

  Comparison of Language Model Inference Engines

  1896

• stanfordnlp/dspy

  DSPy: The framework for programming—not prompting—foundation models

  Language:Python18.4k1.4k

• horseee/Awesome-Efficient-LLM

  A curated list for Efficient Large Language Models

  Language:Python1.2k93

• ItzCrazyKns/Perplexica

  Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI

  Language:TypeScript14.4k1.4k

• PyTorchKorea/tutorials-kr

  🇰🇷파이토치에서 제공하는 튜토리얼의 한국어 번역을 위한 저장소입니다. (Translate PyTorch tutorials in Korean🇰🇷)

  Language:Jupyter Notebook350257

• hao-ai-lab/MuxServe

  Language:Jupyter Notebook413

• hemingkx/Spec-Bench

  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)

  Language:Python17616

• hemingkx/SpeculativeDecodingPapers

  📰 Must-read papers and blogs on Speculative Decoding ⚡️

  43119

• mit-han-lab/qserve

  QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

  Language:Python42723

• MrYxJ/calculate-flops.pytorch

  The calflops is designed to calculate FLOPs、MACs and Parameters in all various neural networks, such as Linear、 CNN、 RNN、 GCN、Transformer(Bert、LlaMA etc Large Language Model)

  Language:Python53820

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

  2.8k187

• intel/intel-extension-for-pytorch

  A Python package for extending the official PyTorch that can easily obtain performance on Intel platform

  Language:Python1.6k246

• Doubiiu/ToonCrafter

  [SIGGRAPH Asia 2024, Journal Track] ToonCrafter: Generative Cartoon Interpolation

  Language:Python5.3k440

• NVlabs/DoRA

  [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

  Language:Python61040

• NVIDIA/gdrcopy

  A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology

  Language:C++879144

• 2noise/ChatTTS

  A generative speech model for daily dialogue.

  Language:Python32k3.5k

• tabtoyou/KoLLaVA

  KoLLaVA: Korean Large Language-and-Vision Assistant (feat.LLaVA)

  Language:Jupyter Notebook26929

• salesforce/LAVIS

  LAVIS - A One-stop Library for Language-Vision Intelligence

  Language:Jupyter Notebook9.9k967