IINemo/lm-polygraph

Issues

• Get the uncertainty scores without rerun the models (for NumSets, Deg, Ecc)

  #155 opened 9 months ago by caiqizh
  3

• Example for normalizaiton

  #226 opened 3 months ago by YiJohnny
  1

• Semantic entropy is using probabilites greater than 1

  #223 opened 3 months ago by gyampols
  2

• generate_texts on wbmodel ignores generation parameters and stopping critera.

  #224 opened 3 months ago by rvashurin
  0

• About the generation metric for questions with multiple correct answers

  #207 opened 3 months ago by caiqizh
  2

• Load custom estimators and stat_calculators in the evaluation script

  #219 opened 3 months ago by IINemo
  0

• Dockerfile adjustments

  #206 opened 5 months ago by SuperCoolCucumber
  3

• using the openai API for a BlackBox model for non OPENAI hosted platforms

  #166 opened 9 months ago by psteinb
  4

• Error loading larger models - You shouldn't move a model when it is dispatched on multiple devices

  #147 opened 4 months ago by avi-jain
  5

• Not 100% sure if sampling parameters is correct

  #119 opened 4 months ago by kirill-fedyanin
  3

• Possible mismatching max_length and max_new_tokens in example eval script

  #118 opened a year ago by kirill-fedyanin
  4

• Entropy calculation maybe wrong?

  #195 opened 7 months ago by athrvkk
  6

• May I know how to run an ensemble-based uncertainty estimation method?

  #170 opened 8 months ago by he159ok
  2

• [Question] Pipeline integration (Langchain)

  #165 opened 9 months ago by Rebell-Leader
  1

• What is the different between pe_uncertainties and ep_uncertainties?

  #164 opened 9 months ago by HuihuiChyan
  2

• AutoModelForCausalLM max_length

  #163 opened 9 months ago by amayuelas
  1

• Get the uncertainty scores without rerun the models

  #144 opened a year ago by caiqizh
  4

• Demo doesn't work.

  #142 opened a year ago by caiqizh
  4