DarkSapling-7B-v2.0-MNN / llm_config.json
WhoIsShe's picture
Add MNN 4-bit quantized model with Model Card
31357f5 verified
{
"model_type": "mistral",
"hidden_size": 4096,
"attention_mask": "float",
"attention_type": "full"
}