/llmonitor

Open-source monitoring & analytics for AI apps and agent

Primary LanguageTypeScriptApache License 2.0Apache-2.0

📈 llmonitor

Open-source monitoring & observability for AI apps and agents

website - docs - pricing - self host

npm version Discord GitHub last commit (by committer) GitHub commit activity (branch)

Features

LLMonitor helps AI devs monitor their apps in production, with features such as:

  • 💵 Cost, token & latency analytics
  • 👪 Track users
  • 🐛 Traces to debug easily
  • 🔍 Inspect full requests
  • 🖲️ Collect feedback from users (soon)
  • 🧪 Unit tests for your agents (soon)
  • 🏷️ Label and create fine-tuning datasets (soon)

It also designed to be:

  • 🤖 Usable with any model, not just OpenAI
  • 📦 Easy to integrate (2 minutes)
  • 🧑‍💻 Simple to self-host (deploy to Vercel & Supabase)

Demo

demo720.mp4

⚙️ Integration

Modules available for:

LLMonitor natively supports:

Additionally you can use it with any framework by wrapping the relevant methods.

📚 Documentation

Full documentation is available on the website.

☁️ Hosted version

We offer a hosted version with a free plan of up to 1k requests / days.

With the hosted version:

  • 👷 don't worry about devops or managing updates
  • 🙋 get priority 1:1 support with our team
  • 🇪🇺 your data is stored safely in Europe

🙋 Support

Chat with us on Discord or email one of the founders: vince [at] llmonitor.com.

👨‍👩‍👧 Team

Made by @vincelwt and Hugh.

License

This project is licensed under the Apache 2.0 License.