File size: 3,263 Bytes
25ba856 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 |
---
pipeline_tag: text-generation
license: other
license_name: modified-mit
license_link: https://github.com/MiniMax-AI/MiniMax-M2.5/blob/main/LICENSE
library_name: transformers
base_model: MiniMaxAI/MiniMax-M2.5
tags:
- uncensored
- abliterated
- fp8
- minimax
- moe
---
# MiniMax-M2.5-catid
**Uncensored FP8 version of [MiniMaxAI/MiniMax-M2.5](https://huggingface.co/MiniMaxAI/MiniMax-M2.5)** with safety refusal behavior removed via surgical weight replacement.
## Refusal Removal Results
Evaluated on a 10,000-prompt refusal benchmark (8,000 train + 2,000 validation) using an LLM judge (GPT-5-nano) for 4-way classification (complied / refused / hedged / deflected):
| Split | Total Prompts | Complied | Refused | Hedged | Deflected | Refusal Rate |
|-------|--------------|----------|---------|--------|-----------|-------------|
| Train | 8,000 | 7,506 | 262 | 228 | 4 | 6.2% |
| Validation | 2,000 | 1,885 | 55 | 59 | 1 | 5.8% |
**Coherence: 100%** (50/50 capability test prompts answered correctly)
The ~6% residual "refusal rate" consists primarily of false positives from the LLM judge on benign prompts (opinion questions, casual banter, medical/privacy disclaimers) rather than actual safety refusals of harmful content.
### Method
The `o_proj` (attention output projection) weights across all 62 transformer layers were replaced with weights from [PRISM-PRO](https://huggingface.co/PrunaAI/MiniMax-M2.5-PRISM-PRO-Q8_0_v2-GGUF) (an abliterated variant), dequantized from Q8_0 GGUF format and re-quantized to FP8 E4M3FN with block-wise scaling to match the original model's quantization scheme. All other weights (q_proj, k_proj, v_proj, MLP experts, embeddings, norms, etc.) are identical to the official FP8 base model.
- **Reconstruction error**: 0.5% relative error per layer (cosine similarity ~1.0)
- **Modified weights**: 62 o_proj tensors (3072 x 6144 each) + their scale_inv tensors
- **Unmodified weights**: Everything else (~229B parameter MoE architecture preserved exactly)
## Usage
This model is a drop-in replacement for `MiniMaxAI/MiniMax-M2.5`. Serve it with vLLM, SGLang, or any framework that supports the original model:
### vLLM
```bash
vllm serve catid/MiniMax-M2.5-catid \
--tensor-parallel-size 4 \
--trust-remote-code \
--max-model-len 2048
```
### SGLang
```bash
python -m sglang.launch_server \
--model catid/MiniMax-M2.5-catid \
--tp 4 \
--trust-remote-code
```
### Recommended Parameters
`temperature=1.0`, `top_p=0.95`, `top_k=40`
## Model Details
- **Architecture**: MiniMax-M2.5 (229B MoE, 62 layers, 256 experts/layer, hidden_dim=3072)
- **Precision**: FP8 E4M3FN with block-wise scaling (128x128 blocks)
- **Base model**: [MiniMaxAI/MiniMax-M2.5](https://huggingface.co/MiniMaxAI/MiniMax-M2.5)
- **Abliteration source**: [PrunaAI/MiniMax-M2.5-PRISM-PRO-Q8_0_v2-GGUF](https://huggingface.co/PrunaAI/MiniMax-M2.5-PRISM-PRO-Q8_0_v2-GGUF)
- **License**: [Modified MIT](https://github.com/MiniMax-AI/MiniMax-M2.5/blob/main/LICENSE) (same as base model)
## Disclaimer
This model is provided for research purposes. The removal of safety guardrails means it may generate content that the original model would refuse. Users are responsible for ensuring appropriate use.
|