InterwebAlchemy
/

kn1ght

Text Generation

text-generation-inference

Model card Files Files and versions

kn1ght / tokenizer.json

Commit History

Revert to NFD normalization

9babf3e
verified

InterwebAlchemy commited on Feb 11, 2025

Remove normalizer

68ba4ef
verified

InterwebAlchemy commited on Feb 11, 2025

Update tokenizer

f1f85c8
verified

InterwebAlchemy commited on Feb 11, 2025

Rename tokenizer_config.json to tokenizer.json

11d7238
verified

InterwebAlchemy commited on Jan 28, 2025

Rename tokenizer.json to tokenizer_config.json

7e5462a
verified

InterwebAlchemy commited on Jan 28, 2025

Add tokenizer config

e0099a2
verified

InterwebAlchemy commited on Jan 28, 2025