AdoCleanCode commited on
Commit
1b200e7
·
verified ·
1 Parent(s): 4d6c5e7

Upload tokenizer

Browse files
Files changed (2) hide show
  1. tokenizer.json +1 -1
  2. tokenizer_config.json +1 -1
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:de5b56054fb87b4170c39fac0220642388a202620eedd1b3b634bb46050cab5b
3
  size 29650325
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17f69f8ad5fe55e0bf77f3f1707a3a8543fc0a361c2eecb29f95883a45000e30
3
  size 29650325
tokenizer_config.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:059be8b6771ae4634600de03eb1914919cd6b2161959eb9b265fb436fd677e4d
3
  size 11833261
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd4a8c732e4c3eba05496fac7b1edcd7254e4124f886799837d6e38bf1557843
3
  size 11833261