Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
LiquidAI
/
LFM2-Tokenizer
like
5
Follow
Liquid AI
1.39k
Model card
Files
Files and versions
xet
Community
main
LFM2-Tokenizer
2.99 MB
2 contributors
History:
3 commits
mlabonne
Create LICENSE
16904be
verified
5 months ago
.gitattributes
Safe
1.52 kB
initial commit
5 months ago
LICENSE
Safe
10.6 kB
Create LICENSE
5 months ago
README.md
Safe
975 Bytes
Add Liquid LFM2 tokenizer
5 months ago
special_tokens_map.json
Safe
434 Bytes
Add Liquid LFM2 tokenizer
5 months ago
tokenizer.json
Safe
2.89 MB
Add Liquid LFM2 tokenizer
5 months ago
tokenizer_config.json
Safe
91.7 kB
Add Liquid LFM2 tokenizer
5 months ago