mixtral

There are 79 repositories under mixtral topic.

  • h2oai/h2ogpt

    Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

    Language:Python11.9k1561.2k1.3k

  • bigscience-workshop/petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    Language:Python9.8k99208572

  • yangjianxin1/Firefly

    Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

    Language:Python6.5k59286586

  • InternLM/xtuner

    A Next-Generation Training Engine Built for Ultra-Large MoE Models

    Language:Python4.8k38577364

  • aandrew-me/tgpt

    AI Chatbots in terminal without needing API keys

    Language:Go2.8k41308293
  • elia

    darrenburns/elia

    A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

    Language:Python2.3k1349143
  • Ollamac

    kevinhermawan/Ollamac

    Mac app for Ollama

    Language:Swift1.9k1785102

  • tenstorrent/tt-metal

    :metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

    Language:C++806279.3k143

  • jianzhnie/LLamaTuner

    Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

    Language:Python61394363

  • ymcui/Chinese-Mixtral

    中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

    Language:Python608151144

  • helixml/helix

    ♾️ Helix is a private GenAI stack for building AI agents with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

    Language:Go517622248

  • ModelTC/llmc

    [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

    Language:Python450107451
  • aikit

    sozercan/aikit

    🏗️ Fine-tune, build, and deploy open-source LLMs easily!

    Language:Go44084438

  • moritztng/fltr

    Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

    Language:Rust385628

  • unifyai/unify

    Notion for AI Observability 📊

    Language:Python28621430

  • expectedparrot/edsl

    Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.

    Language:Python274778124

  • Picovoice/picollm

    On-device LLM Inference Powered by X-Bit Quantization

    Language:Python26881214

  • WangRongsheng/Aurora

    The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"

    Language:Python26661721

  • inferflow/inferflow

    Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

    Language:C++24881725
  • ollama-ai

    gbaptista/ollama-ai

    A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.

    Language:Ruby2436411
  • empower-functions

    empower-ai/empower-functions

    GPT-4 level function calling models for real-world tool using use cases

    Language:Python2312819
  • machinascript-for-robots

    babycommando/machinascript-for-robots

    Build LLM-powered robots in your garage with MachinaScript For Robots!

    Language:Python18910210

  • vemonet/libre-chat

    🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup.

    Language:Python1625922

  • noco-ai/spellbook-docker

    AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models

    Language:Shell1544311

  • marklysze/LlamaIndex-RAG-WSL-CUDA

    Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B

    Language:Jupyter Notebook1302214

  • trinib/ZORG-Jailbreak-Prompt-Text

    Bypass restricted and censored content on AI chat prompts 😈

    1166119

  • Mobile-Artificial-Intelligence/llama_sdk

    lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

    Language:C++10272824

  • fly-apps/ollama-open-webui

    Self-host a ChatGPT-style web interface for Ollama 🦙

    Language:Shell908127

  • Dublit-Development/ollama-api

    Deploy a RESTful API Server to interact with Ollama and Stable Diffusion

    Language:Python60014
  • herc.ai

    Bes-js/herc.ai

    A powerful library for interacting with the Herc.ai API.

    Language:TypeScript581823

  • mzarnecki/php-rag

    This application uses LLMs like DeepSeek, GPT-4o, Claude, Gemini2 or Llama, Mixtral (locally) in order to generate text based on the user input. The user input is used to retrieve relevant information from the database and then the retrieved information is used to generate the text. This approach combines power of LLMs and access to source documen

    Language:PHP57203
  • llm.js

    themaximalist/llm.js

    Simple LLM library for JavaScript

    Language:JavaScript54259

  • ventz/easy-llms

    Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama

    Language:Python53318

  • tghamm/Mistral.SDK

    An unofficial C#/.NET SDK for accessing the Mistral AI API

    Language:C#45257

  • marklysze/LangChain-RAG-Linux

    Examples of RAG using LangChain with local LLMs - Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B

    Language:Jupyter Notebook40202

  • hkproj/mistral-src-commented

    Reference implementation of Mistral AI 7B v0.1 model.

    Language:Python28105