hawkw/seax

Implement Scheme lexer

Closed this issue · 10 comments

Implement Scheme lexer

Blocked on #22

Since Scheme is such a simple language, I can probably implement the lexer and parser in one component using parsing expression grammar. It's not like there's a lot of complex tokenizing that will require a separate lexer and parser component a la flex/yacc.

Started: 147afbd

Tokenizes names correctly in c6ae364

Made the name lexer fully R6RS-compliant in d7215d3

Lexer for hex numbers added in f41d449

Lexer for unsigned ints added in 030ce0c

Lexer for float constants added in 0553d35

3356cdd and ace267d implement lexing for character literals and R6RS-style named character literals.

f86e56f adds support for character literals as hex scalar values. This finishes character constant lexing.