BodhiHu

Blogs

dapr

Dapr is a portable, event-driven, runtime for building distributed applications across cloud and edge.

gemma-function-call-finetune

🌟 Fine-tuning of the gemma-2b-it model with peft and function-call-sharegpt dataset.

kubeflow-lab

Kubeflow lab for running cloudy AI ops /w ease.

langchain

🦜🔗 Build context-aware reasoning applications

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

reactive.fiori

Teris-Game-for-Android

A Tetris Game for Android

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

BodhiHu/ai-search-memfree

MemFree - Hybrid AI Search Engine

BodhiHu/chathub

All-in-one chatbot client

BodhiHu/DocsGPT

GPT-powered chat for documentation, chat with your documents

BodhiHu/electron-minidump

Symbolicate Electron minidumps

BodhiHu/fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

BodhiHu/gpt_academic_paper

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

BodhiHu/graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

BodhiHu/huggingface-text-generation-inference

Large Language Model Text Generation Inference

BodhiHu/hyper-terminal

A terminal built on web technologies

BodhiHu/jan-ai

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

BodhiHu/jan.ai-cortex

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan

BodhiHu/llama.cpp

LLM inference in C/C++

BodhiHu/llamafile

Distribute and run LLMs with a single file.

BodhiHu/llm.c

LLM training in simple, raw C/CUDA

BodhiHu/lobe-cli-toolbox

BodhiHu/mlc-llm

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

BodhiHu/node-screenshots

Zero-dependent. A native nodejs screenshots library for Mac、Windows、Linux.

BodhiHu/ollama

Get up and running with Llama 2, Mistral, and other large language models locally.

BodhiHu/openai-translator-chrome-extension

基于 ChatGPT API 的划词翻译浏览器插件和跨平台桌面端应用 - Browser extension and cross-platform desktop application for translation based on ChatGPT API.

BodhiHu/Phi-3CookBook

This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.

BodhiHu/PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

BodhiHu/PowerInfer-clone

BodhiHu/powerinfer-sparse-predictor

BodhiHu/private-gpt

Interact with your documents using the power of GPT, 100% privately, no data leaks

BodhiHu/promptfoo-llm-eval-pipelines

Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.

BodhiHu/quivr-chat-knowledge

Your GenAI Second Brain 🧠 A personal productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Local & Private alternative to OpenAI GPTs & ChatGPT powered by retrieval-augmented generation.

BodhiHu/searxng

SearXNG is a free internet metasearch engine which aggregates results from various search services and databases. Users are neither tracked nor profiled.

BodhiHu/torch_musa

torch_musa is an open source repository based on PyTorch, which can make full use of the super computing power of MooreThreads graphics cards.

BodhiHu/TTime-AI-mouse-marking

🚀 Screenshots, word marking, OCR, AI, translation software || 截图、划词、文字识别、AI、翻译软件

BodhiHu/uiohook-napi