simonw/ttok

Issues

• Does `ttok` need an internet connection?

  #11 opened a year ago by NightMachinery
  3

• Ability to count tokens for models other than OpenAI

  #8 opened a year ago by simonw
  3

• Options for special token handling

  #13 opened 8 months ago by grantjenks
  3

• ttok adds a 20 second delay when using llm-gpt4all when offline

  #10 opened a year ago by learning4life
  1

• Mechanism for splitting rather than truncating

  #3 opened 2 years ago by simonw
  21

• An additional option to view the actual tokenized text

  #4 opened a year ago by oostopitre
  11

• Option to turn token integers back into text

  #7 opened a year ago by simonw
  6

• Truncate => trim tokens

  #6 opened 2 years ago by jefftriplett
  0

• Verbose option

  #5 opened 2 years ago by faroukfaiz10
  0

• Initial design

  #1 opened 2 years ago by simonw
  3