Lexer matches unicode, but doesn't catch it.

[Exunys]

Title says it all, I am using src/lexer/init.lua. Here's a quick example:

⭮⽥⻶ⓞ⠏Ⱈ⵼⇠⺀❜⍨ↇ⡧⚏ⷔ⸂␳⋡⒀⻒⪻ⅆ⿜⌰⤟ⵣ⏗⸂⚿▚⪪⿐⽻⥝⁹⚎Ⓥ◥◶℀₏Ⅻ will get matched, but not catched properly.

print("⭮⽥⻶ⓞ⠏Ⱈ⵼⇠⺀❜⍨ↇ⡧⚏ⷔ⸂␳⋡⒀⻒⪻ⅆ⿜⌰⤟ⵣ⏗⸂⚿▚⪪⿐⽻⥝⁹⚎Ⓥ◥◶℀₏Ⅻ")

Will catch: "⭮⽥⻶ⓞ⠏Ⱈ⵼⇠⺀❜⍨ↇ⡧⚏ⷔ⸂␳⋡⒀⻒⪻ⅆ⿜⌰⤟ⵣ⏗⸂⚿▚⪪⿐⽻⥝⁹⚎Ⓥ◥◶℀₏Ⅻ")

It returns the unicode with the suffix and ) but it's not suppose to.

Here's how it looks like:

Here is how it should look like:

[boatbomber]

Thanks for bringing this up. In fact, it was not an issue with the Unicode matcher but actually with the string matcher. A fix will be pushed shortly.

[boatbomber]

Fixed, thank you!