Kimi-K2.5-PRISM-REAP-530B-A32B-i1-GGUF ?

#1882
by Rebis - opened

Hi,
Could you make a version i1-GGUF of Kimi-K2.5-PRISM-REAP-530B-A32B (https://huggingface.co/Ex0bit/Kimi-K2.5-PRISM-REAP-530B-A32B) ?
This is the first Kimi-K2.5 REAP at 50% with SOTA PRISM on Hugging Face.
Thank you in advance.

Well, it's gated so I have to wait to get the access. Im not sure if it will quant because expert pruners usually modify model architecture and llama cpp doesnt like it

Sign up or log in to comment