Quantized Nanbeige4.1-3B
Collection
Verified models. Compatible with vLLM v0.15.1.
•
5 items
•
Updated
This is Nanbeige/Nanbeige4.1-3B quantized with llm-compressor to W4A16 AWQ . The model is compatible with vLLM (tested: v0.15.1). Tested with an L4 (Google Colab).
- Developed by: The Kaitchup
- Downloads last month
- 49
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support