Giskard-AI/giskard

Issues

• Replacing OpenAI GPT-4 with Ollama as LLM-as-a-Judge and API Calls with Local LLMs in Giskard (RAGET Toolkit) AND Replacing API Calls with Local LLMs in Giskard Using Ollama

  #2096 opened a month ago by pds13193
  7

• 'charmap' codec can't encode character '\U0001f512' in position 1020: character maps to <undefined>

  #2095 opened 4 days ago by SalAlba
  2

• Bug when calculating correctness_by_metadata mean

  #2089 opened 4 days ago by lailanelkoussy
  1

• how to fully change the LLM model and embedding model from default openAI to AzureAI?

  #2105 opened 6 days ago by jerry0688
  1

• giskard.rag.report.save fails if evaluate doesn't include KnowlegeBase

  #2097 opened 13 days ago by gotsysdba
  2

• Is it possible to return the full result of giskard.scan() including both passed and not passed results?

  #1996 opened 6 months ago by Wongkitlong314
  2

• infinite build times on hf private spaces using docker image

  #2078 opened 3 months ago by Josephrp
  2

• num_samples and num_requirements don't work in all detectors

  #2086 opened 2 months ago by AmineDjeghri
  1

• Scan Report: All Open statements are lacking specification of argument encoding="utf-8" - which can cause the output methods to crash with UnicodeEncodeError for users running Windows OS

  #2083 opened 2 months ago by CAW-nz
  3

• AttributeError: module 'giskard.llm' has no attribute 'embeddings'

  #2076 opened 3 months ago by AmineDjeghri
  6

• Custom embedding model is not being used by KnowledgeBase

  #2054 opened 3 months ago by walaa-akram
  2

• Giskard Scan crush when tested for a large number of features

  #1974 opened 3 months ago by dzaridis
  2

• Giskard artifacts Pypi issue - local data injection files are not present.

  #2008 opened 3 months ago by sturiot
  1

• Large knowledge base leads to context length exceeded error

  #2050 opened 3 months ago by Tobi696
  6

• KeyError: 'user_input' when calculating RAGAS metric

  #2056 opened 3 months ago by PierreMesure
  7

• Outdated error message

  #2055 opened 3 months ago by PierreMesure
  2

• Test output in range - indexing error while using slicing function for classification problem

  #2061 opened 3 months ago by AndreaBosi96
  3

• RAG Metrics parse_json_output Key Error

  #2030 opened 4 months ago by AidanNell
  1

• Testset saved as ".json", not ".jsonl" when saving report

  #2057 opened 4 months ago by PierreMesure
  0

• Import error with RAGAS v0.2.2

  #2051 opened 4 months ago by PierreMesure
  1

• Non-ASCII characters in testsets and report JSON files

  #2046 opened 4 months ago by PierreMesure
  7

• AttributeError: module 'giskard.llm' has no attribute 'embeddings'

  #2047 opened 4 months ago by MachoPanko
  1

• Configuring Knowledgebase class to use Gemini as LLM client but it still uses Open AI

  #2045 opened 4 months ago by walaa-akram
  2

• Allow user to specify N retries

  #2043 opened 4 months ago by ClarkKentIsSuperman
  0

• When will the API documentation for the RAG Evaluation Toolkit be completed?

  #2032 opened 4 months ago by LordSyd
  3

• Generate synthetic questions with listing choices

  #1956 opened 8 months ago by terry07
  0

• Contributing to examples/tutorials

  #1951 opened 4 months ago by cyberholics
  2

• giskard.scan() defaults back to OpenAI, when I have been using LM Studio (Solution suggested)

  #1962 opened 4 months ago by osok
  6

• Testset generation lost when a single generation fail

  #2022 opened 5 months ago by kevinmessiaen
  2

• Set any groq model as default LLMClient for giskard

  #1977 opened 7 months ago by Vikas9758
  1

• Ollama Embeddings

  #2035 opened 4 months ago by nobad4rt
  1

• Documentation: Add the list of tags available for the `only` param of the `scan` method

  #1984 opened 5 months ago by kevinmessiaen
  6

• Discrimination Detector Not Found

  #2028 opened 4 months ago by ClarkKentIsSuperman
  1

• JSON Processing Error running LLM Scan

  #2009 opened 5 months ago by ClarkKentIsSuperman
  2

• LLMHarmfulContentDetector Failure/Crash

  #2027 opened 5 months ago by ClarkKentIsSuperman
  1

• Support python 3.12

  #1976 opened 5 months ago by baswenneker
  3

• Add support for python 3.12

  #2006 opened 5 months ago by tituslhy
  1

• Incorrect Usage of Temperature Parameter in _llm_complete Method

  #1998 opened 5 months ago by craston
  0

• BUG: Griffe package breaks Giskard

  #2000 opened 6 months ago by ecocarlisle
  1

• Implement a Gemini `LLMClient`

  #1901 opened 7 months ago by kevinmessiaen
  6

• dataset has a column ```question``` but Dataset constructor is throwing an Error that it doesn't

  #1961 opened 8 months ago by osok
  1

• Unresolved Version Conflict for Langchain-community

  #1957 opened 8 months ago by jeffersonqiu
  1

• Raget: Possible miscalculation of all Ragas metrics, in particular Precision and Recall

  #1924 opened 8 months ago by Chabert-Liddell
  2

• "generate_test" function with Bedrock client (for Claud03)

  #1933 opened 9 months ago by MelissaMokhtari
  1

• huggingface models as client?

  #1931 opened 9 months ago by kbmlcoding
  1

• giskard.scan is failing for azure openai & langchain

  #1894 opened 9 months ago by AshishGoelTR
  2

• Wrapping custom application endpoint not working

  #1914 opened 9 months ago by AshishGoelTR
  2

• Scan is not working with OpenAI when running quickstart_llm.ipynb. AttributeError: module 'openai' has no attribute 'Client'

  #1918 opened 10 months ago by HuaizhengZhang
  6

• Is there a way to test the LLM-based models for stereotypes and discrimination using a saved dataset

  #1893 opened 10 months ago by rudziankou
  3

• generate_test does not work with Azure Open AI key

  #1872 opened 10 months ago by terry07
  2