jooris/bucky
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

init: Add Token definition and Tokenizer logic.

Browse Source
This commit is contained in:
Jooris Hadeler
2026-01-12 16:06:55 +01:00
commit 0599a5fb98
6 changed files with 378 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
Cargo.toml Normal file
View File

@@ -0,0 +1,8 @@
[package]
name = "bucky"
version = "0.1.0"
edition = "2024"
[dependencies]
multipeek = "0.1.2"
unicode-xid = "0.2.6"