Thanks!
#1
by
TheDrummer
- opened
Works
Nice, glad it works - let me know what you build with it :)
its broken. just tested it
its broken. just tested it
Your fine-tune? Or this converted model?
Finetune. I might have fumbled somewhere since I disabled mistral_common, enabled Liger, FlashAttention w/o knowing if the new arch supports it.
Yeah, I had some issue when I tried converting w/o mistral-common at first