philipchung's Stars
tiangolo/fastapi
FastAPI framework, high performance, easy to learn, fast to code, ready for production
run-llama/llama_index
LlamaIndex is a data framework for your LLM applications
astral-sh/ruff
An extremely fast Python linter and code formatter, written in Rust.
astral-sh/uv
An extremely fast Python package and project manager, written in Rust.
unslothai/unsloth
Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
Avaiga/taipy
Turns Data and AI algorithms into production-ready web applications in no time.
apple/pkl
A configuration as code language with rich validation and tooling.
OpenAccess-AI-Collective/axolotl
Go ahead and axolotl questions
google/gemma.cpp
lightweight, standalone C++ inference engine for Google's Gemma models.
langfuse/langfuse
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
google/gemma_pytorch
The official PyTorch implementation of Google's Gemma models
google/highway
Performance-portable, length-agnostic SIMD with runtime dispatch
Giskard-AI/giskard
🐢 Open-Source Evaluation & Testing for LLMs and ML models
turboderp/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
Arize-ai/phoenix
AI Observability & Evaluation
OpenNMT/CTranslate2
Fast inference engine for Transformer models
huggingface/text-embeddings-inference
A blazing fast inference solution for text embeddings models
uptrain-ai/uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
Eventual-Inc/Daft
Distributed DataFrame for Python designed for the cloud, powered by Rust
NVIDIA/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
astral-sh/ruff-vscode
A Visual Studio Code extension with support for the Ruff linter.
datadreamer-dev/DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
MDK8888/GPTFast
Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
dgarnitz/vectorflow
VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
sunnweiwei/RankGPT
Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]
chujiezheng/chat_templates
Chat Templates for 🤗 HuggingFace Large Language Models
RAIVNLab/MRL
Code repository for the paper - "Matryoshka Representation Learning"
helixml/helix
Multi-node production AI stack. Run the best of open source AI easily on your own servers. Create your own AI by fine-tuning open source models. Integrate LLMs with APIs. Run gptscript securely on the server
machaao/mistral-7b-chatbot
A Mistral-7B-Instruct + LangChain powered sample AI persona chatbot (via HuggingFace)
hurshd0/vllm-docker-traefik
vLLM with Traefik for reverse proxy and load balancing