Dan-wanna-M/kbnf

Issues

• [Bug?] Incompatible with Hugging Face `Tokenizers`

  #18 opened 4 months ago by EricLBuehler
  4

• Support full json validation

  #15 opened 5 months ago by Dan-wanna-M
  0

• Structured AST nodes as inputs

  #17 opened 4 months ago by Dan-wanna-M
  0

• Provide an efficient logits mask index

  #16 opened 4 months ago by Dan-wanna-M
  1

• Support suffix automata

  #13 opened 4 months ago by Dan-wanna-M
  2

• Mitigate improper tokenization sequence

  #14 opened 5 months ago by Dan-wanna-M
  0

• Integrate with third party libraries

  #12 opened 5 months ago by Dan-wanna-M
  0

• More comprehensive benchmark

  #4 opened 7 months ago by Dan-wanna-M
  1

• Extend Earley recognizer to a parser

  #10 opened 7 months ago by Dan-wanna-M
  1

• Replace `except!` by #e"<regex>"

  #8 opened 5 months ago by Dan-wanna-M
  1

• Add lexer

  #11 opened 5 months ago by Dan-wanna-M
  1

• Eager token id cache for regular expressions

  #1 opened 5 months ago by Dan-wanna-M
  2

• Add `mask_token_ids` and `update_token_ids` API

  #7 opened 7 months ago by Dan-wanna-M
  1

• Minimal Continuous Integration

  #5 opened 7 months ago by Dan-wanna-M
  1

• Escape characters support

  #9 opened 6 months ago by Dan-wanna-M
  3

• Use mimalloc for python wheels

  #6 opened 7 months ago by Dan-wanna-M
  1

• FFI bindings

  #2 opened 7 months ago by Dan-wanna-M
  0

• Expose `Grammar` from `EngineLike`

  #3 opened 7 months ago by Dan-wanna-M
  0