whylabs/langkit
🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
Jupyter NotebookApache-2.0
Issues
- 1
- 1
tests for injections module
#40 opened by FelipeAdachi - 8
Add support for AzureOpenAI
#197 opened by rajib76 - 0
Response Hallucination: decouple LLMs for sample generation and consistency checking
#205 opened by FelipeAdachi - 0
- 0
Add support for python 3.12
#195 opened by jamie256 - 0
Add support for armv6l, armv7l chipset architecture
#196 opened by jamie256 - 2
- 0
- 0
Consider asserting input types
#184 opened by jamie256 - 1
need a way to override metric names in LangKitConfig
#174 opened by jamie256 - 0
- 0
example notebooks use older style why.init
#159 opened by jamie256 - 0
xformers causes crash on mac with injections
#161 opened by jamie256 - 0
Don't create an iterable
#155 opened by andyndang - 0
langkit's pypi page does not show a homepage link
#150 opened by jamie256 - 0
Documentation Upgrades
#143 opened by FelipeAdachi - 0
- 0
make has_patterns directly callable for strings
#125 opened by FelipeAdachi - 3
Any plan to support multilingual?
#74 opened by jack1981 - 6
load tests interfere with eachother
#109 opened by jamie256 - 0
aggregage_reading_level should output a float
#131 opened by jamie256 - 1
Support multiple embedding models
#120 opened by zmacks - 0
Themes module don't allow custom groups
#119 opened by FelipeAdachi - 0
regexes expansion
#112 opened by FelipeAdachi - 2
Release workflow is hitting a permission error
#102 opened by jamie256 - 0
- 0
- 0
- 1
Support prometheus metrics
#73 opened by andyndang - 0
- 2
Deploying in heroku - python flask server
#48 opened by sarulnat - 0
add docs & tests for openai wrapper
#52 opened by AndreTessell - 1
udf_schema should not track frequent items
#90 opened by jamie256 - 3
- 0