Implement Scheme lexer

Question

Implement Scheme lexer

hawkw opened this issue 10 years ago · 10 comments

Answer 1 · 2015-03-16T16:24:14.000Z

Blocked on #22

Answer 2 · 2015-03-18T17:41:38.000Z

Since Scheme is such a simple language, I can probably implement the lexer and parser in one component using parsing expression grammar. It's not like there's a lot of complex tokenizing that will require a separate lexer and parser component a la flex/yacc.

Answer 3 · 2015-03-18T17:42:22.000Z

Started: 147afbd

Answer 4 · 2015-03-20T00:33:45.000Z

Tokenizes names correctly in c6ae364

Answer 5 · 2015-03-20T16:58:40.000Z

Made the name lexer fully R6RS-compliant in d7215d3

Answer 6 · 2015-03-20T22:04:26.000Z

Lexer for hex numbers added in f41d449

Answer 7 · 2015-03-20T22:04:39.000Z

Lexer for unsigned ints added in 030ce0c

Answer 8 · 2015-03-20T22:55:25.000Z

Lexer for float constants added in 0553d35

Answer 9 · 2015-03-22T16:56:32.000Z

3356cdd and ace267d implement lexing for character literals and R6RS-style named character literals.

Answer 10 · 2015-03-22T17:08:22.000Z

f86e56f adds support for character literals as hex scalar values. This finishes character constant lexing.