feat: add lexer implementation

This commit is contained in:
2026-04-20 19:51:57 +02:00
parent 51a4000f1f
commit 1006301255
3 changed files with 291 additions and 4 deletions
+4 -4
View File
@@ -8,10 +8,10 @@ A Rust-flavored, C-targeting language - built pipeline-first.
## Phase 1 - Lexer
- [x] Define token enum (int literal, bool literal, ident, keywords, operators, punctuation)
- [ ] Implement character-by-character scanner loop
- [ ] Handle whitespace & single-line comments (`//`)
- [ ] Produce source spans (file, line, col) on every token
- [ ] Unit-test: known inputs → expected token streams
- [x] Implement character-by-character scanner loop
- [x] Handle whitespace & single-line comments (`//`)
- [x] Produce source spans (file, line, col) on every token
- [x] Unit-test: known inputs → expected token streams
## Phase 2 - Parser