Test: Append tokens to tokenizer.ggml.tokens
Browse filesTesting appending ['hoh','haha'] to tokenizer.ggml.tokens via direct commit edit
tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90096745e3e1a17a9ee4718803ff44289aa9d51d4188fded7cf81b8c06996df7
|
| 3 |
+
size 667814912
|