cedricrupb/code_tokenize

Issues

• Unexpectedly recent/incompatible version of tree-sitter

  #6 opened 2 months ago
  2

• Unexpected token with no matched text at the end of tokenstream

  #5 opened 2 years ago
  4

• string literals lost during tokenization for C/C++ code.

  #4 opened 2 years ago
  2

• The tree-sitter-go can not parse the type of string.

  #2 opened 3 years ago
  2

• Could this tool parse a part of C code?

  #1 opened 3 years ago
  2