robber@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 8 days agoQwen3-Coder-Nexthuggingface.coexternal-linkmessage-square8fedilinkarrow-up123arrow-down10file-text
arrow-up123arrow-down1external-linkQwen3-Coder-Nexthuggingface.corobber@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 8 days agomessage-square8fedilinkfile-text
minus-squareXylight@lemdro.idlinkfedilinkEnglisharrow-up1·2 days agothanks to the beauty of mixture-of-experte models i can shove a q2 quant of this into my 8gb vram
thanks to the beauty of mixture-of-experte models i can shove a q2 quant of this into my 8gb vram