The SamoraLang Rust Lexical Analyzer is a lexer implemented in Rust for the SamoraLang programming language. This lexer is designed to tokenize SamoraLang source code, providing a foundation for further stages in the language processing pipeline.
- Tokenizes SamoraLang source code into a stream of tokens.
- Supports a variety of token types, including identifiers, keywords, operators, and literals.
- Handles whitespace and comments gracefully.
- Written in Rust for efficiency and reliability.
To use the SamoraLang Rust Lexical Analyzer, you need to have Rust and Cargo installed on your system. If you haven't installed Rust, you can do so by following the instructions on the official Rust website.
Clone the repository to your local machine:
git clone https://github.com/GraHms/SLang-Rust-Lexical-Analyzer.git
cd SLang-Rust-Lexical-Analyzer.
Build the project using Cargo:
cargo build --release
Once the project is built, you can use the lexer in your Rust projects. Import the lexer module and create an instance of the Lexer
struct:
use samoralang_lexer_rust::lexer::Lexer;
fn main() {
let input = "let x = 5;";
let mut lexer = Lexer::new(input.to_string());
loop {
let token = lexer.next_token();
// Process or display the token as needed
println!("{:?}", token);
if token.r#type == TokenType::EOF {
break;
}
}
}
If you find issues or want to contribute to the development of the SamoraLang Rust Lexical Analyzer, please open an issue or submit a pull request on the GitHub repository.
This project is licensed under the MIT License - see the LICENSE file for details.
Feel free to customize this template based on your specific project details. Include any additional sections that might be relevant for your users, such as a roadmap, known issues, or examples of SamoraLang code.