please make 3 bit & 4 bit dwq quant of cerebras/MiniMax-M2.5-REAP-172B-A10B

#5
by Narutoouz - opened
  • cerebras/MiniMax-M2.5-REAP-172B-A10B is pruned version that is 25% lighter
  • but still retain same accuracy in all becnhmarks including coding
  • Please make 3 bit and 4 bit dwq quant of this model

Thankyou

Sign up or log in to comment