cmcmaster1

cmcmaster1's Stars

• MDK8888/GPTFast

  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.

  Language:Python68765

• leptonai/leptonai

  A Pythonic framework to simplify AI service building

  Language:Python2.7k172

• excalidraw/excalidraw

  Virtual whiteboard for sketching hand-drawn like diagrams

  Language:TypeScript86.5k8.2k

• crewAIInc/crewAI

  Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

  Language:Python21.7k3k

• m-bain/whisperX

  WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

  Language:Python12.6k1.3k

• taylorai/mlx_embedding_models

  run embeddings in MLX

  Language:Python736

• argmaxinc/WhisperKit

  On-device Speech Recognition for Apple Silicon

  Language:Swift4k335

• eth-sri/lmql

  A language for constraint-guided and efficient LLM programming.

  Language:Python3.7k202

• lucidrains/self-rewarding-lm-pytorch

  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

  Language:Python1.3k73

• hiyouga/LLaMA-Factory

  Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

  Language:Python35k4.3k

• dwzhu-pku/PoSE

  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)

  Language:Python19919

• da-z/mlx-ui

  A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.

  Language:Python22731

• Codium-ai/AlphaCodium

  Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""

  Language:Python3.7k273

• microsoft/LLMLingua

  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

  Language:Python4.7k262

• TheMind-AI/fluid-db

  Fluid Database

  Language:Python1148

• datamllab/LongLM

  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning

  Language:Python61562

• theroyallab/tabbyAPI

  An OAI compatible exllamav2 API that's both lightweight and fast

  Language:Python62476

• catid/oaillama3

  Simple setup to self-host LLaMA3-70B model with an OpenAI API

  191

• databricks/lilac

  Curate better data for LLMs

  Language:Python97491

• ModelTC/lightllm

  LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

  Language:Python2.6k208

• huggingface/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python136k27.1k

• arcee-ai/mergekit

  Tools for merging pretrained large language models.

  Language:Python4.9k445

• ContextualAI/HALOs

  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

  Language:Python74845

• predibase/lorax

  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

  Language:Python2.2k145

• allenai/papermage

  library supporting NLP and CV research on scientific papers

  Language:Python70756

• databricks/megablocks

  Language:Python1.2k175

• huggingface/transformers.js

  State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

  Language:JavaScript12.2k775

• yuchenlin/LLM-Blender

  [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut the weaknesses through ranking and integrate the strengths through fusing generation to enhance the capability of LLMs.

  Language:Python88979

• epfLLM/Megatron-LLM

  distributed trainer for LLMs

  Language:Python54377

• VikParuchuri/marker

  Convert PDF to markdown quickly with high accuracy

  Language:Python18k1k