/candle-sampling

Sampling techniques for Candle.

Primary LanguageRustMIT LicenseMIT

candle-sampling

Continuous integration Documentation

Sampling techniques for Candle.

Currently implemented methods are:

  • multinomial (ancestral)
  • top-k
  • top-p (nucleus)
  • top-n logprobs
  • repeat penalty (frequency penalty)
  • presence penalty
  • logit bias