view post Post 5514 You can now run Qwen3.5 locally! ๐Qwen3.5-397B-A17B is an open MoE vision reasoning LLM for agentic coding & chat. It performs on par with Gemini 3 Pro, Claude Opus 4.5 & GPT-5.2.GGUF: unsloth/Qwen3.5-397B-A17B-GGUFRun Dynamic 3-bit on a 192GB Mac for 20 tokens/s.Guide: https://unsloth.ai/docs/models/qwen3.5 See translation 9 replies ยท ๐ฅ 19 19 โค๏ธ 6 6 ๐ 2 2 + Reply
Qwen3.5 Collection Qwen3.5 is Qwen's new model family including Qwen3.5-397B-A17B. โข 2 items โข Updated 6 days ago โข 8
view post Post 2980 GLM 5 is insane, it ranks #4 Globally! See translation 4 replies ยท ๐ฅ 10 10 ๐คฏ 2 2 + Reply
view post Post 3421 You can now run Kimi K2.5 locally! ๐ฅWe shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.GGUF: unsloth/Kimi-K2.5-GGUFGuide: https://unsloth.ai/docs/models/kimi-k2.5 See translation 7 replies ยท ๐ 16 16 ๐ 3 3 ๐ฅ 2 2 ๐ 1 1 + Reply