Tokenizer

This is a tokenizer implemented in C for Systems Programmming Course at Rutgers University.

You can refer to readme.pdf for the full documentation!