tokenizer

2026-04-03 10:29:38 +08:00
parent de99cb2806
commit c1a895258f
70 changed files with 22320 additions and 239 deletions
--- a/README.md
+++ b/README.md
@@ -17,4 +17,7 @@ HUSKY=0 pnpm bootstrap
 pnpm dev


+# tokenizer
+docker build -t tokenizer:1.0.0 .
+
 ```