IAPark/tiktoken_ruby

Issues

• Support for new "gpt-4o" tiktoken tokenizer

  #36 opened 25 days ago by gtoubassi
  2

• Request for Maintainers

  #26 opened 4 months ago by bmulholland
  2

• Error installing gem in MacOS M1

  #34 opened 2 months ago by AlessandroTolomio
  0

• Error installing gem on Linux Xenial Ruby 3.0/1 AMD64

  #32 opened 2 months ago by MarioRuiz
  5

• Thread safe?

  #8 opened 2 months ago by mkdynamic
  7

• Tiktoken.encoding_for_model has bad return value on unrecognized model name

  #28 opened 2 months ago by rob-mindtrip
  4

• [Proposal] Add model token limits to tiktoken_ruby

  #6 opened 3 months ago by mattlindsey
  1

• Install failing on Ruby 3.3.0 and Heroku

  #20 opened 4 months ago by kapso
  14

• Getting "LoadError" when trying to use the gem as dependency

  #10 opened a year ago by rolo9128
  1

• [Proposal] Claude Tokenizer

  #15 opened 9 months ago by BarberAlec
  1

• LoadError: /lib/x86_64-linux-gnu/libc.so: invalid ELF header

  #12 opened 10 months ago by stephenarifin-payscore
  0

• Unable to build on OpenBSD

  #11 opened 10 months ago by basicfeatures
  3

• Failed to build on Ventura 13.4.1 M1 and Ruby 2.7.6

  #9 opened 10 months ago by teejteej
  1

• "Failed to build gem native extension" on Linux (Ubuntu)

  #7 opened a year ago by bdegomme
  0

• Can't compile on Ruby 3.0: No builder for extension 'ext/tiktoken_ruby/Cargo.toml'

  #1 opened a year ago by taf2
  9