danitico

danitico's Stars

• run-llama/llama_index

  LlamaIndex is a data framework for your LLM applications

  Language:Python36.9k2435.5k5.3k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python30.5k2485.3k4.6k

• Mozilla-Ocho/llamafile

  Distribute and run LLMs with a single file.

  Language:C++20.5k1774271k

• dolthub/dolt

  Dolt – Git for Data

  Language:Go18k1162.4k514

• ml-explore/mlx

  MLX: An array framework for Apple silicon

  Language:C++17.3k1485621k

• valkey-io/valkey

  A flexible distributed key-value datastore that is optimized for caching and other realtime workloads.

  Language:C17.3k104366653

• huggingface/candle

  Minimalist ML framework for Rust

  Language:Rust15.9k154716960

• BerriAI/litellm

  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

  Language:Python14k763.6k1.7k

• FlagOpen/FlagEmbedding

  Retrieval and Retrieval-augmented LLMs

  Language:Python7.6k461.1k554

• microsoft/promptbase

  All things prompt engineering

  Language:Python5.4k5915302

• nmslib/hnswlib

  Header-only C++/python library for fast approximate nearest neighbors

  Language:C++4.4k65373650

• pytorch/serve

  Serve, optimize and scale PyTorch models in production

  Language:Java4.2k571.6k863

• huggingface/optimum

  🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

  Language:Python2.6k58755470

• bclavie/RAGatouille

  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

  Language:Python2.6k24162183

• pytest-dev/pytest-xdist

  pytest plugin for distributed testing and loop-on-failures testing modes.

  Language:Python1.5k54638232

• Lightning-AI/lightning-thunder

  Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

  Language:Python1.2k3555980

• aws/deep-learning-containers

  AWS Deep Learning Containers are pre-built Docker images that make it easier to run popular deep learning frameworks and tools on AWS.

  Language:Python1k58244464

• pyspark-ai/pyspark-ai

  English SDK for Apache Spark

  Language:Python8392051128

• BerriAI/reliableGPT

  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors

  Language:Python63262338

• youtype/mypy_boto3_builder

  Type annotations builder for boto3 compatible with VSCode, PyCharm, Emacs, Sublime Text, pyright and mypy.

  Language:Python556521638

• oughtinc/ice

  Interactive Composition Explorer: a debugger for compositional language model programs

  Language:Python535103266

• run-llama/finetune-embedding

  Fine-Tuning Embedding for RAG with Synthetic Data

  Language:Jupyter Notebook4694568

• Cranial-XIX/llm-pddl

  Language:SAS373151133

• castorini/docTTTTTquery

  docTTTTTquery document expansion model

  Language:Python356153335

• RUC-GSAI/YuLan-Rec

  Language:Python28231919

• cansik/onnxruntime-silicon

  ONNX Runtime prebuilt wheels for Apple Silicon (M1 / M2 / M3 / ARM64)

  Language:Shell19751718

• brendenlake/MLC

  Meta-Learning for Compositionality (MLC) for modeling human behavior

  Language:Python1385120

• newrelic/nr-openai-observability

  Easy to install OpenAI GPT monitoring tool.

  Language:Python34111015

• vispana/vispana

  Web client for Vespa.ai

  Language:JavaScript343228

• pehrs/vscode-vespa

  Vespa AI Extension for Visual Studio Code

  Language:TypeScript5201