EleutherAI/delphi

[Experiments] - Explore recall difficulty

SrGonao opened this issue · 0 comments

  • Compute recall for explanations using only top (100) activating examples (50), for 100 features.
  • Compute recall for explanations using top (100) activating examples (35) and non activating examples (15), for 100 features.
  • Compute recall for explanations sampled randomly from activating examples (50).