feat: add token and span definitions

2026-04-20 19:00:36 +02:00
parent 46028f9072
commit 51a4000f1f
4 changed files with 127 additions and 1 deletions
@@ -7,7 +7,7 @@ A Rust-flavored, C-targeting language - built pipeline-first.

 ## Phase 1 - Lexer

- [ ] Define token enum (int literal, bool literal, ident, keywords, operators, punctuation)
+- [x] Define token enum (int literal, bool literal, ident, keywords, operators, punctuation)
 - [ ] Implement character-by-character scanner loop
 - [ ] Handle whitespace & single-line comments (`//`)
 - [ ] Produce source spans (file, line, col) on every token