php-tokenizer

There are 3 repositories under php-tokenizer topic.

  • lionsoul2014/friso

    High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.

    Language:C494332092

  • baygin/php-simple-lexer

    The Lexer layer of Compiler/Interpreter

    Language:PHP0100

  • soiqualang/php_token

    php_token

    Language:PHP20