GGUF conversion failure

#2
by pa0los - opened

Hello.

I'm not sure if this is an issue with my environment or the model.
After using convert_hf_to_gguf.py the model fails to load:

llama_model_load: error loading model: check_tensor_dims: tensor 'blk.0.exp_probs_b.bias' has wrong shape; expected   205, got   256,

Anyone else has the same issue?

This comment has been hidden (marked as Off-Topic)

Sign up or log in to comment