tokenizer-parser
There are 38 repositories under tokenizer-parser topic.
ikskuh/parser-toolkit
A toolkit that makes it easier to write recursive-descent parsers in Zig.
ehwan/C-language-Parser-In-Rust
C language lexer & parser & virtual interpreter from scratch in Rust
recp/xml
🔋 In-place lightweight XML parser
Zackattak01/HumanTimeParser
Simple to use parser capable of parsing a usable time object from human input
aboss123/Ice-Programming-Language-Submission
This is a short and modern JIT compiler that transform source text, into LLVM IR bytecode that executes machine code at runtime. This project was developed at the hths.hacks() hackathon against more 250+ participants internationally and was placed as a winner. Among the winners, my project was the only one developed solo.
melchisedech333/antlr4-experiments
:wrench: My studies on context-free grammar, using ANTLR4 (C++) to generate the parser files. Some basics are developed, such as token processing, recursion, variable definition, array processing, Abstract Syntax Tree (AST) manipulation, UNICODE support, and error handling.
melchisedech333/lex-yacc-experiments
:wrench: My studies involving context-free grammar analysis. The analyzers were built using familiar tools such as YACC, Lex and Bison. Topics covered include token filtering, simple variable manipulation, and arrays.
HamedFathi/ParserToolkit
A toolkit that helps you to write your own parser.
Rajspeaks/Machine-Learning-approach-to-Bengali-Corpus-Tokenization-Stemming-POS-Tagging-using-BNLTK
Machine Learning approach to Bengali Corpus POS Tagging using BNLTK. This is an experimenting project under the mentorship of Prof. Sandipan Ganguly, HIT-K.
spydaz/AI_ZX81
A Basic Experiment in Parser and Compilers and Stack VM . A basic stack based CPU with Assembly language and basic commands. A basic programming Languge Parsed to Tokens to e parsed to expressions to be compiled to assembly code to be executed on the virtual CPU... Also to be used to Parse English grammar to make abstract syntax trees.
stcjs/flkit
A JS/HTML/CSS Toolkit(Tokenizer、Parser) Support Template Syntax
DuffsDevice/tiny-parser
Write use-case specific parsers within minutes!
MitchellGray100/Critter-World-README
A README for my private CS 2112 Critter World Project
vxern/text_expressions
A tiny and complete tool to supercharge static JSON strings with dynamic, user-defined expressions.
2439905184/bkscr-parser
bkengine脚本的解析器（开源实现）基于python3.8.4
ander-db/Tokenizer
A very fast and low memory usage C++ automaton tokenizer that breaks an input string into a list of tokens looking at tabs, spaces, new lines, and detects special tokens like numbers, prces, personal noms, emails, lexemes, etc. It allows to specify delimeters and detect special cases.
atmay/Tokenization
tokeniser for math in c#
ByteXenon/LuaXen
Lua Compiler, (De)Obfuscator, Minifier, Beautifier, And more
HamedStack/HamedStack.SyntaxMania
Empowering you to create your own parser.
idris-aitmoulay/minimal-parser
this repository contient a minimal parser
jasont14/tokenizer
Python Token Tokenizer for SQL using Postgresql Keywords
ldaniels528/oxide
Oxide is a hybrid database and streaming messaging system (think Kafka + MySQL); supporting data access via REST and SQL.
melchisedech333/antlr4-demonstration-project
:wrench: Demonstration of using ANTLR4 (with runtime for C++) in projects for context-free grammar processing. The ANTLR4 (Java) package is included, and the project is configured to compile on Linux.
paulo-granthon/uml-gen-tw
An automatic UML generator for Java that *actually works*
annapoorna-a-k/SYNTAX-ANALYZER-using-Java
This is a Syntax Analyzer which can parse Jack programmes in accordance with the Jack language and generate an XML file .
Degef/Minishell
A bash like shell or command interpreter written in C.
itfray/PyLexPyParse
Python library for creating lexical analyzers and parsers
jackr276/Simple-Pascal-Like-Language-Interpreter
An interpreter for a custom-made, Pascal-Like Programming Language
MoRanYue/ApiMarkupLanguage
API Markup Language Parser, implemented using TypeScript and JavaScript.
muhiris/CompilerConstruction
All CC-Labs of Sir Nadeem.
ardac67/lisp_lisp
some works on lisp
benjamin-trainor/json-parser
Recreating JSON.parse
gabsfredes/LISPtoPOSFIX
Software produzido na disciplina de Linguagens Formais que deverá receber como entrada uma expressão em LISP e retornar a expressão posfixa equivalente.
jcdobrin/micro_c_parser
Programming Language Concepts Final Project - Micro C language Lexical Scanner and Parser - Spring 2008
ldaniels528/tinyDB.go
An experimental database implementation written in pure Go.
xxEBxx/Math_eval
Command-line application designed to parse and evaluate mathematical expressions