DevQuasar
/

PowerInfer.SparseQwen2-7B-GGUF

Text Generation

Model card Files Files and versions

'Make knowledge free for everyone'

Quantized version of: PowerInfer/SparseQwen2-7B

Downloads last month: 1

GGUF

Model size

8B params

Architecture

qwen2

Hardware compatibility

Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Model tree for DevQuasar/PowerInfer.SparseQwen2-7B-GGUF

Base model

Tiiny/SparseQwen2-7B

Quantized

(3)

this model