HERETICODER-2.5-7B-IT

Model Description

This is an abliterated decensored version of Qwen2.5-Coder-7B-Instruct using Heretic!

  • License: apache-2.0
  • Abliterated by : Cannae-AI
  • Base model : Qwen/Qwen2.5-Coder-7B-Instruct
Model Refusals KL divergence
HERETICODER-2.5-7B-IT 1/100 0.00
  • Parameters:
    • direction_index = per layer
    • attn.o_proj.max_weight = 1.30
    • attn.o_proj.max_weight_position = 16.27
    • attn.o_proj.min_weight = 0.74
    • attn.o_proj.min_weight_distance = 4.19
    • mlp.down_proj.max_weight = 0.98
    • mlp.down_proj.max_weight_position = 21.61
    • mlp.down_proj.min_weight = 0.54
    • mlp.down_proj.min_weight_distance = 2.64
Downloads last month
11
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Cannae-AI/HERETICODER-2.5-7B-IT

Base model

Qwen/Qwen2.5-7B
Finetuned
(253)
this model
Quantizations
2 models

Collection including Cannae-AI/HERETICODER-2.5-7B-IT