AdoCleanCode commited on
Commit
6d9c8cd
·
verified ·
1 Parent(s): 4fc505d

Upload tokenizer

Browse files
Files changed (2) hide show
  1. tokenizer.json +1 -1
  2. tokenizer_config.json +1 -1
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c64ccebae49a8a8f5a4e2681ed2e3e59fa7cf77fcb367e5aff95bdb466f14a86
3
  size 29649909
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4865d2efef007fa6f0eded9666e5bc7e0563b635e434f24b9c21f726bde62cce
3
  size 29649909
tokenizer_config.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2f52bd10decd17c29f45589c6df092cb89c46ed381848f647bec7b240e812323
3
  size 11832787
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15d50aa3754ea43f39250d63fddd0fe1362d132f21edba800f1f9283d850c5c6
3
  size 11832787