georg-jung/FastBertTokenizer

Issues

• Return the "string" representation of tokens or their text offsets

  #38 opened 4 months ago by Egyptmaster
  5

• Request for .NET Framework 4.8 Support

  #23 opened 8 months ago by wning13
  2

• Add Decode support for input_id sequences that don't start at a word prefix

  #39 opened a year ago by georg-jung
  0

• can load config from directory?

  #34 opened a year ago by sangeren
  2

• Consider Implementing PreTokenizer as ref struct Enumerator

  #6 opened a year ago by georg-jung
  1