huyouare's Stars
scorecard-ai/scorecard-python
Python SDK for the Scorecard API
fpgmaas/deptry
Find unused, missing and transitive dependencies in a Python project.
Hypercontext/linkifyjs
JavaScript plugin for finding links in plain-text and converting them to HTML <a> tags.
microsoft/promptbase
All things prompt engineering
ContextualAI/HALOs
A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
eric-mitchell/direct-preference-optimization
Reference implementation for DPO (Direct Preference Optimization)
reworkd/bananalyzer
Open source AI Agent evaluation framework for web tasks 🐒🍌
prometheus-eval/prometheus
[ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on a customized score rubric, Prometheus is a good alternative for human evaluation and GPT-4 evaluation.
google-deepmind/funsearch
abetlen/llama-cpp-python
Python bindings for llama.cpp
open-compass/opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
databricks/megablocks
mistralai/megablocks-public
reworkd/tarsier
Vision utilities for web interaction agents 👀
promptfile/promptfile
A Markdown-like syntax for writing prompts. Includes an in-editor playground.
lancedb/lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
lancedb/lancedb
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
waydabber/BetterDisplay
Unlock your displays on your Mac! Flexible HiDPI scaling, XDR/HDR extra brightness, virtual screens, DDC control, extra dimming, PIP/streaming, EDID override and lots more!
datastax/ai-chatbot-starter
A starter app to build AI powered chat bots with Astra DB and LlamaIndex
eugeneyan/visualizing-finetunes
ray-project/llm-numbers
Numbers every LLM developer should know
fixie-ai/ai-benchmarks
Benchmarking suite for popular AI APIs
unkeyed/unkey
Open source API management platform
BerriAI/litellm
Python SDK, Proxy Server to call 100+ LLM APIs using the OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
JaleelB/emblor
A fully-featured tag input component built with shadcn/ui
huyouare/humaneval-unpacked
OpenPipe/OpenPipe
Turn expensive prompts into cheap fine-tuned models
yoheinakajima/who_let_the_logs_out
Automatic logging of every API & function calls
AgentOps-AI/agentops
Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen
archinetai/audio-diffusion-pytorch
Audio generation using diffusion models, in PyTorch.