falcon
There are 348 repositories under falcon topic.
bentoml/OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
huggingface/text-generation-inference
Large Language Model Text Generation Inference
SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
open-falcon/falcon-plus
An open-source and enterprise-level monitoring system.
hugapi/hug
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
plotly/falcon
Free, open-source SQL client for Windows and Mac 🦅
kennethreitz/responder
A familiar HTTP Service Framework for Python.
yuanzhoulvpi2017/zero_nlp
中文nlp解决方案(大模型、数据、模型、训练、推理)
socketry/falcon
A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.
ashishpatel26/LLM-Finetuning
LLM Finetuning with peft
marshmallow-code/webargs
A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.
hiyouga/FastEdit
🩹Editing large language models within 10 seconds⚡
explosion/spacy-llm
🦙 Integrating LLMs into structured NLP pipelines
explosion/curated-transformers
🤖 A PyTorch library of curated Transformer models and their composable components
basetenlabs/truss
The simplest way to serve AI/ML models in production
georgian-io/LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
cak/secure
Secure 🔒 headers for Python web frameworks
guokr/swagger-py-codegen
a Python web framework generator supports Flask, Tornado, Falcon, Sanic
mallorbc/Finetune_LLMs
Repo for fine-tuning Casual LLMs
jraska/Falcon
Take Android screenshots with Falcons bright eye!
yangjianxin1/Firefly-LLaMA2-Chinese
Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
open-falcon/dashboard
falcon-plus frontend
CrowdStrike/psfalcon
PowerShell for CrowdStrike's OAuth2 APIs
CrowdStrike/falconpy
The CrowdStrike Falcon SDK for Python
0b01001001/spectree
API spec validator and OpenAPI document generator for Python web frameworks.
tenstorrent/tt-metal
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
Oksydan/falcon
Prestashop starter theme that provides great development experience.
explosion/spacy-services
💫 REST microservices for various spaCy-related tasks
inferflow/inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
iamarunbrahma/finetuned-qlora-falcon7b-medical
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
wimpysworld/umpc-ubuntu
Scripts for UMPCs such as GPD Pocket, Pocket 2, MicroPC & TopJoy Falcon
stanleylsx/llms_tool
一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。
guinmoon/llmfarm_core.swift
Swift library to work with llama and other large language models.
ModelTC/llmc
This is the official PyTorch implementation of "LLM-QBench: A Benchmark Towards the Best Practice for Post-training Quantization of Large Language Models", and also an efficient LLM compression tool with various advanced compression methods, supporting multiple inference backends.
strongbugman/apiman
Api document support for any python web framework