Spaces:

Duplicated from ggunio/intelligent-tokenizer-v6-demo

ggunio
/

B2NL-v6.1.2-intelligent-tokenizer-v6-demo

Sleeping

App Files Files Community

B2NL-v6.1.2-intelligent-tokenizer-v6-demo

371 kB

2 contributors

History: 53 commits

ggunio's picture

Update app.py

42e1b93 verified about 2 months ago

core
Update core/unified_model.py about 2 months ago
src
Upload src/core/byte_tokenizer_v6.py with huggingface_hub 3 months ago
.gitattributes
1.52 kB

initial commit 3 months ago
README.md
8.1 kB

Update README.md about 2 months ago
VERSION_COMPARISON.md
8.54 kB

Update to B2NL v6.1.2 POC - 18.6:1 compression with 6 languages (Korean, English, Chinese, Japanese, Spanish, Arabic) 3 months ago
app.py
32.1 kB

Update app.py about 2 months ago
config.json
394 Bytes

Upload config.json with huggingface_hub 3 months ago
demo_poc.py
9.88 kB

Upload demo_poc.py with huggingface_hub 3 months ago
inference.py
6.29 kB

Upload inference.py with huggingface_hub 3 months ago
requirements.txt
103 Bytes

Upload requirements.txt with huggingface_hub 3 months ago
test_app.py
6.05 kB

Update to B2NL v6.1.2 POC - 18.6:1 compression with 6 languages (Korean, English, Chinese, Japanese, Spanish, Arabic) 3 months ago