Mungert
/

granite-3.3-8b-instruct-GGUF

Text Generation

Model card Files Files and versions

granite-3.3-8b-instruct-GGUF

134 GB

1 contributor

History: 1 commit

Mungert's picture

Super-squash history to reclaim storage

01d10de verified 2 months ago

.gitattributes

4.39 kB

Super-squash history to reclaim storage 2 months ago
README.md

39.6 kB

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-bf16.gguf

16.3 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-bf16_q8_0.gguf

8.87 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-f16_q8_0.gguf

8.87 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-iq2_m.gguf

2.84 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-iq2_xxs.gguf

2.27 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-iq3_m.gguf

3.71 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-iq3_s.gguf

3.59 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-iq3_xs.gguf

3.4 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-iq3_xxs.gguf

3.2 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-iq4_nl.gguf

4.67 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-iq4_xs.gguf

4.43 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q2_k_m.gguf

3.1 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q2_k_s.gguf

2.86 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q3_k_m.gguf

4 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q3_k_s.gguf

3.57 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q4_0.gguf

4.6 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q4_1.gguf

5.11 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q4_k_m.gguf

4.94 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q4_k_s.gguf

4.69 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q5_0.gguf

5.62 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q5_1.gguf

6.13 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q5_k_m.gguf

5.8 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q5_k_s.gguf

5.65 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q6_k_m.gguf

6.71 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct-q8_0.gguf

8.68 GB
xet

Super-squash history to reclaim storage 2 months ago
granite-3.3-8b-instruct.imatrix

5.99 MB
xet

Super-squash history to reclaim storage 2 months ago