truera/trulens

Issues

• The system is happy about the model saying it doesn't know something even though it has been stated in the prompt

  #1183 opened 4 months ago
  3

• Langchain Quickstart notebook does not work

  #1179 opened 4 months ago
  3

• context_selection doesn't work correctly when chat_mode = "context"

  #1175 opened 3 months ago
  11

• [Recursion Error] Calling TruLlama()

  #1174 opened 4 months ago
  8

• [BUG] Selector __record__.app.retrieve.args.query does not exist in source data.

  #1172 opened 4 months ago
  10

• from trulens_eval.feedback import Groundedness Not working

  #1170 opened 4 months ago
  2

• Deploy Trulens with FastAPI

  #1164 opened 4 months ago
  5

• [BUG] v0.20.3 of trulens-eval AzureOpenAI object has no attribute 'generate_score'

  #1163 opened 4 months ago
  2

• [BUG] Inconsistent results between records variable values and dashboard/leaderboard values

  #1162 opened 3 months ago
  7

• [FEAT] ARES integration possible?

  #1153 opened 4 months ago
  4

• [BUG] Using AzureOpenAI provider does not show token usage/price

  #1152 opened 17 days ago
  3

• [BUG] Problem with custom retriever. It's triggering "Found more than one `BaseRetriever` in app".

  #1151 opened 4 months ago
  5

• [BUG] Bedrock provider always gives: "Groundedness per statement in source: 0%"

  #1150 opened a month ago
  5

• Outdated documentation for Groundedness

  #1149 opened 4 months ago
  3

• [BUG] Azure openai shows 404 error

  #1148 opened 4 months ago
  1

• getting error that openai is not installed.

  #1145 opened 4 months ago
  15

• Getting issues in using Trulens with Langchain Agents like ReAct/Structured Chat

  #1133 opened a month ago
  6

• [BUG] Could not locate app.retriever.get_relevant_documents.rets[:].page_content.collect() in app/record.

  #1132 opened 21 days ago
  5

• [FEAT] Can I use a full local LLM instead of openai?

  #1126 opened 5 months ago
  1

• Feedback functions returning FAILED

  #1125 opened 4 months ago
  9

• Error: ValueError: Some selectors do not exist in the app or record.

  #1106 opened 3 months ago
  11

• [BUG] TruChain - no values returned for Groundedness feedback function for Bedrock

  #1101 opened 5 months ago
  8

• Getting RecursionError: maximum recursion depth exceeded while calling a Python object while creating tru_recorder.

  #1100 opened 21 days ago
  17

• [FEAT] Feasibility to extend the record schema to accommodate custom fields

  #1098 opened 2 months ago
  0

• [BUG] TruLens Quickstart - OperationalError: (sqlite3.OperationalError) no such table: trulens_apps

  #1089 opened 5 months ago
  6

• [BUG] Tru() function fails either due to missing alembic.ini file or KeyError: 'formatters'

  #1087 opened 5 months ago
  6

• [BUG] Trulens does not evaluate the cost per inference in the case of Bedrock.

  #1073 opened 2 months ago
  3

• [BUG] Azure OpenAI error with evaluation using TruLlama/Llamaindex

  #1071 opened 4 months ago
  14

• [BUG] TruLlama quickstart example fails with Pydantic validation error for queue.Queue object.

  #1069 opened 5 months ago
  3

• [BUG] No return of feedback when using LiteLLM with Mistral

  #1068 opened 5 months ago
  10

• [BUG] import error after clean install

  #1060 opened 5 months ago
  5

• Groundedness evaluating sentences that don't exist in the LLM response

  #1059 opened 4 months ago
  5

• [BUG] Groundedness and Context Relevance Error due to Debug Timeout

  #1057 opened 5 months ago
  4

• Error Executing llama_index_quickstart.ipynb

  #1048 opened 6 months ago
  4

• [BUG] Trulens is working properly with the Query Engine but not with the Chat Engine.

  #1044 opened 6 months ago
  6

• Run 'tru.run_dashboard(port=8502)' Leaderboard shows error.

  #1040 opened 4 months ago
  10

• Error when using Streaming mode in trulens for openai chat completion.

  #1039 opened 5 months ago
  4

• [BUG] TruLens throws ValidationError: Input should be an instance of llama_index.core.base_query_engine.BaseQueryEngine

  #1028 opened 5 months ago
  5

• [BUG] Dashboard ignores `database_url` when opening Apps or Evaluations pages without opening Leaderboards first

  #1017 opened 5 months ago
  4

• [BUG] A non-annotated attribute was detected: `TABLE_META = 'meta'`

  #1016 opened 6 months ago
  6

• [BUG] Tru was already initialized. Cannot change database_url

  #1011 opened 6 months ago
  3

• [BUG] UnicodeDecodeError: 'gbk' codec can't decode

  #1010 opened 6 months ago
  3

• [BUG]get concurrent.futures._base.TimeoutError

  #1009 opened 5 months ago
  5

• [FEAT] Support for Python 3.12

  #1007 opened 6 months ago
  4

• Add Gemini Support in the provider list

  #1006 opened 6 months ago
  2

• TruLens with Outside Logs example not working

  #1005 opened 5 months ago
  9

• [BUG] pydantic_core._pydantic_core.ValidationError: 1 validation error for TruCustomApp

  #998 opened 7 months ago
  2

• [BUG] Use Anthropic Claude 3 Opus as Feedback Provider

  #992 opened 6 months ago
  14

• [BUG] Some docs broken / 404?

  #986 opened 7 months ago
  3

• When Custom retriever and query engine with llamaindex,get ERROR

  #979 opened 7 months ago
  2