jojo1899
/

Llama-2-13b-chat-hf-ov-int4

Text Generation

Model card Files Files and versions

Llama-2-13b-chat-hf-ov-int4

6.72 GB

1 contributor

History: 7 commits

jojo1899's picture

Improved quantization using Openvino 2024.5.0rc1

0869f09 about 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

977 Bytes

Improved quantization using Openvino 2024.5.0rc1 about 1 year ago
config.json

801 Bytes

Improved quantization using Openvino 2024.5.0rc1 about 1 year ago
generation_config.json

193 Bytes

Improved quantization using Openvino 2024.5.0rc1 about 1 year ago
openvino_model.bin

6.71 GB
xet

Improved quantization using Openvino 2024.5.0rc1 about 1 year ago
openvino_model.xml

3.16 MB

Improved quantization using Openvino 2024.5.0rc1 about 1 year ago
special_tokens_map.json

414 Bytes

Improved quantization using Openvino 2024.5.0rc1 about 1 year ago
tokenizer.json

3.62 MB

Quantized using nncf 2.13.0 about 1 year ago
tokenizer.model

500 kB
xet

Improved quantization using Openvino 2024.5.0rc1 about 1 year ago
tokenizer_config.json

1.83 kB

Quantized using nncf 2.13.0 about 1 year ago