Lexical analysis (scanner)
Closed this issue · 2 comments
metthal commented
Based on finite state machine, scanner needs to be implemented.
Scanner has to contain:
- Structure respresenting token with all needed attributes about the token
- Finite state machine
- Interface to provide token for parser
BetaRavener commented
Scanner should parse whole file and return Vector of Tokens to parser.