Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
damfle
/
multistral-tokenizer
like
0
Token Classification
HuggingFaceFW/fineweb
HuggingFaceFW/fineweb-2
nick007x/github-code-2025
French
English
Chinese
code
License:
isc
Model card
Files
Files and versions
xet
Community
main
multistral-tokenizer
9.29 MB
2 contributors
History:
6 commits
damfle
mod: add chat_template.jinja
ca00efb
unverified
7 days ago
.gitattributes
1.52 kB
initial commit
7 days ago
README.md
1.1 kB
doc(readme): add missing dataset
7 days ago
chat_template.jinja
6.3 kB
mod: add chat_template.jinja
7 days ago
special_tokens_map.json
571 Bytes
init: initial commit
7 days ago
tokenizer.json
9.28 MB
init: initial commit
7 days ago
tokenizer_config.json
627 Bytes
init: initial commit
7 days ago
