A tokenizer written in (SWI-)Prolog. It has some useful features and some flexibility and it might improve.
Primary LanguagePrologThe UnlicenseUnlicense