Jan

An open source alternative to OpenAI that runs on your own computer or server

Pinned Repositories

awesome-local-ai
An awesome repository of local AI tools
990 23 681
cortex
Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan
Language:C++1.7k 14 29789
cortex.llamacpp
Language:C++32
cortex.python
C++ code that run Python embedding
Language:C++3 2 20
cortex.tensorrt-llm
Nitro is an C++ inference server on top of TensorRT-LLM. OpenAI-compatible API. Run blazing fast inference on Nvidia GPUs. Used in Jan
Language:C++29 1 151
docs
Jan.ai Website & Documentation
Language:MDX16 6 806
extension-template
Language:TypeScript7 3 22
jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
Language:TypeScript20k 121 1.5k1.2k
model-converter
Language:Python18 2 35
models
Language:JavaScript4 2 22

Jan's Repositories

janhq/jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
Language:TypeScript20k 121 1.5k1.2k
janhq/cortex
Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan
Language:C++1.7k 14 29789
janhq/awesome-local-ai
An awesome repository of local AI tools
990 23 681
janhq/cortex.tensorrt-llm
Nitro is an C++ inference server on top of TensorRT-LLM. OpenAI-compatible API. Run blazing fast inference on Nvidia GPUs. Used in Jan
Language:C++29 1 151
janhq/model-converter
Language:Python18 2 35
janhq/docs
Jan.ai Website & Documentation
Language:MDX16 6 806
janhq/extension-template
Language:TypeScript7 3 22
janhq/models
Language:JavaScript4 2 22
janhq/cortex.llamacpp
Language:C++32
janhq/cortex.python
C++ code that run Python embedding
Language:C++3 2 20
janhq/thinking-machines
Thinking Machines
2 1 00
janhq/architecture
1 1 01
janhq/cortex-node
The official Node.js / Typescript library for the OpenAI API
Language:TypeScript1 0 00
janhq/cortex-python
The official Python library for the OpenAI API
Language:Python1 0 00
janhq/node-nitro
Language:JavaScript1 5 00
janhq/open-foundry
R&D experiments
Language:Jupyter Notebook1 1 01
janhq/triton_tensorrt_llm
Language:Shell1 1 0
janhq/charts
This repository contains helm chart for our team
Language:Smarty0 4 00
janhq/plugin-catalog
Language:JavaScript0 5 01
janhq/py-nitro
0 2 00
janhq/cortex-web
Language:TypeScript
janhq/cortex.hub
Language:Python
janhq/cortex.onnx
Language:C++3 0
janhq/infinity
The AI-native database built for LLM applications, providing incredibly fast vector and full-text search
Language:C++
janhq/langchainjs
Language:TypeScript1 01
janhq/llama.cpp-avx-vnni
Port of Facebook's LLaMA model in C/C++
Language:C++1 01
janhq/openai_trtllm
OpenAI compatible API for TensorRT LLM triton backend
Language:Rust1 0
janhq/pymaker
Make the py
janhq/tensorrtllm_backend
The Triton TensorRT-LLM Backend
Language:Python1 0
janhq/trt-llm-as-openai-windows
This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
Language:Python