Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

fxmarty
/
tiny-llama-fast-tokenizer

Text Generation
Transformers
PyTorch
ONNX
llama
text-generation-inference
Model card Files Files and versions
xet
Community
11
tiny-llama-fast-tokenizer
19.7 MB
  • 2 contributors
History: 5 commits
fxmarty's picture
fxmarty
Adding ONNX file of this model
6b2147f verified almost 2 years ago
  • onnx
    Adding ONNX file of this model almost 2 years ago
  • .gitattributes
    1.48 kB
    initial commit over 2 years ago
  • README.md
    76 Bytes
    Create README.md about 2 years ago
  • config.json
    466 Bytes
    add model over 2 years ago
  • generation_config.json
    138 Bytes
    add model over 2 years ago
  • pytorch_model.bin

    Detected Pickle imports (3)

    • "torch._utils._rebuild_tensor_v2",
    • "collections.OrderedDict",
    • "torch.HalfStorage"

    What is a pickle import?

    2.07 MB
    xet
    add model over 2 years ago
  • special_tokens_map.json
    411 Bytes
    fix tokenizer? over 2 years ago
  • tokenizer.json
    1.84 MB
    fix tokenizer? over 2 years ago
  • tokenizer.model
    500 kB
    xet
    add model over 2 years ago
  • tokenizer_config.json
    649 Bytes
    fix tokenizer? over 2 years ago