bzick/tokenizer

Issues

• panic when stream with more than one token ends with any white space

  #26 opened a month ago by n-peugnet
  1

• Can it parse "any programming language"?

  #23 opened 3 months ago by Zireael07
  1

• Crash

  #24 opened 2 months ago by joy4eg
  1

• Parsing comments

  #21 opened 4 months ago by ddorstijn
  3

• Parsing an empty string causes odd behavior

  #7 opened 9 months ago by dpedu
  2

• Parsing closing parenthesis/brackets/curly without a token for them causes panic after parsing TokenString

  #9 opened 9 months ago by DSVDiniz
  1

• Handle some special characters as a part of TokenKeyword

  #6 opened 9 months ago by ryszard-swierczynski
  4

• parser incorrectly report float token for multiple "."

  #11 opened 9 months ago by vk-coder
  1

• Specify case insensitive matching of token upon definition

  #12 opened 10 months ago by ktsivkov
  1

• stream.IsNextSequence is infinitely running, if `keys` is longer, than the stream sequence itself

  #13 opened 9 months ago by DanikNik
  2

• How to ignore _ in string?

  #3 opened 2 years ago by dviljoen
  1