lexical-analysis
There are 608 repositories under lexical-analysis topic.
DoctorWkt/acwj
A Compiler Writing Journey
baidu/lac
百度NLP：分词，词性标注，命名实体识别，词重要性
SeanLee97/xmnlp
xmnlp：提供中文分词, 词性标注, 命名体识别，情感分析，文本纠错，文本转拼音，文本摘要，偏旁部首，句子表征及文本相似度计算等功能
katef/libfsm
DFA regular expression library & friends
DmitryRyumin/INTERSPEECH-2023-Papers
INTERSPEECH 2023 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023 conference. Explore the latest advances in speech and language processing. Code included. Star the repository to support the advancement of speech technology!
qinwf/jiebaR
Chinese text segmentation with R. R语言中文分词 （文档已更新 🎉 ：https://qinwenfeng.com/jiebaR/ )
WGrape/lexer
A lexical analyzer based on DFA that is built using JS and supports multi-language extensions / 一个基于DFA的支持多语言扩展的JS版开源词法分析器
ghaiklor/llvm-kaleidoscope
LLVM Tutorial: Kaleidoscope (Implementing a Language with LLVM)
gecko0307/dlib
Allocators, I/O streams, math, geometry, image and audio processing for D
SwiftStudies/OysterKit
OysterKit is a framework that provides a native Swift scanning, lexical analysis, and parsing capabilities. In addition it provides a language that can be used to rapidly define the rules used by OysterKit called STLR
drifter1/compiler
Implementing a complete Compiler for a simple C-like language using the C-tools Flex and Bison
brucewlee/lingfeat
[EMNLP 2021] LingFeat - A Comprehensive Linguistic Features Extraction ToolKit for Readability Assessment
AnjaneyaTripathi/c-compiler
A compiler that accepts any valid program written in C. It is made using Lex and Yacc. Returns a symbol table, parse tree, annotated syntax tree and intermediate code.
jafarlihi/clex
clex is a simple lexer generator
kamadorueda/santiago
Santiago is a lexing and parsing toolkit for Rust
LSYS/LexicalRichness
:smile_cat: :speech_balloon: A module to compute textual lexical richness (aka lexical diversity).
techcentaur/PyLex
Perform lexical analysis on words, one word at a time.
quil-lang/alexa
A Lexical Analyzer Generator
PratikSavla/compiler-design-lab
These are my programs for compiler design lab work in my sixth semester
Aurore54F/JStap
Modular static malicious JavaScript detection system
YaccConstructor/YaccConstructor
Platform for parser generators and other grammarware research and development. GLL, RNGLR, graph parsing algorithms, and many others are included.
truongpt/meo
subset c compiler
soul-soft/SqlBatis
A high performance Micro-ORM supporting SQL Server, MySQL, Sqlite etc..
ghaiklor/pascal-interpreter
A simple interpreter for a large subset of Pascal language written for educational purposes
alirezakay/RegexToDFA
converting regex (regular expression) to DFA directly by creating syntax tree in java
gbroques/compiler
A simple compiler written from scratch in C++ for an undergraduate course in program translation.
yassram/SwiLex
A universal lexer library in Swift.
devangi2000/Compiler-Design
A repository containing all experiments for the course Compiler Design.
ftchirou/blink-lexer
Starting code of the first challenge in the Let's Build a Programming Language series.
jnyfah/CuriousX
A simple miniature Compiler
FelipeTomazEC/Lexical-Analyzer
A basic Lexical-Analyzer written in Java.
phorward/libphorward
C/C++ library for dynamic data structures, regular expressions, lexical analysis & more...
amirbawab/EasyCC-CPP
Easy Compiler Compiler written in C++
Rabrg/jlex
A lexical analyzer for Java source code written in Python
ELI-Data-Mining-Group/PELIC-dataset
The University of Pittsburgh English Language Institute Corpus (PELIC) dataset