jooris/bucky
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: Add token definitions and lexer logic.

Browse Source 
This commit adds the `Token` and `TokenKind` definitions in `src/token.rs`,
in `src/lexer.rs` I've added the `Lexer` logic.

squash
This commit is contained in:
Jooris Hadeler
2026-03-11 23:18:05 +01:00
parent 9e4d4085ba
commit 8dc2f15e26
8 changed files with 424 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
Cargo.toml
View File

@@ -4,4 +4,5 @@ version = "0.1.0"
edition = "2024"
[dependencies]
unicode-xid = "0.2.6"
yansi = "1.0.1"