TheCornCollector@piefed.zip to LocalLLaMA@sh.itjust.worksEnglish · edit-27 hours agoQwen3.6-35B-A3B releasedhuggingface.coexternal-linkmessage-square14fedilinkarrow-up126arrow-down12file-text
arrow-up124arrow-down1external-linkQwen3.6-35B-A3B releasedhuggingface.coTheCornCollector@piefed.zip to LocalLLaMA@sh.itjust.worksEnglish · edit-27 hours agomessage-square14fedilinkfile-text
The Qwen3.5 models are still the best local models I’ve used, so I’m excited to see how this updated version performs.
minus-squareInfinite@lemmy.ziplinkfedilinkEnglisharrow-up5·5 hours agoProbably 24 GB VRAM and 32-64 GB RAM for minimum specs with 4-bit quantization. This is a beefy boi.
minus-squarevenusaur@lemmy.worldlinkfedilinkEnglisharrow-up1·4 hours agoThanks! Not for me yet. Hope to save up enough to get 24GB VRAM in near future.
Probably 24 GB VRAM and 32-64 GB RAM for minimum specs with 4-bit quantization. This is a beefy boi.
Thanks! Not for me yet. Hope to save up enough to get 24GB VRAM in near future.