/Scanner-Compiler-Design

The Scanner/Lexer of a Compiler Made with Python for Python

Primary LanguagePython

Scanner-Compiler-Design

  • The Scanner/Lexer of a Compiler Made with Python for Python

  • Includes 2 Versions with the re and NLTK library separately

  • Built with Python 3.10

Scanner Usage Instructions:

  1. Run either "scanner1.py" (re) or "scanner2.py" (NLTK)
  2. Input the name of a test file you'd like to scan such as "prog1.py"
  3. Programme will display a sequence of tokens and their corresponding categories