ArtusDev

/

requests-exl

like 4

Thanks! Got queued but unfortunately aya support is not in exl3 😢
I'll leave the request open in case support will be added in the future

Hi, thanks allot
Are you sure it's not supported ?
aya architecture is CohereForCausalLM (same as Command-R familly also by cohere labs ) which is listed in exl3 supported architectures

This is most likely a regression with aya quirks not being accounted for as the model is very old as the original arch support was done with command r in mind iirc