robber@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 1 month agoQwen3-Coder-Nexthuggingface.coexternal-linkmessage-square10fedilinkarrow-up125arrow-down10file-text
arrow-up125arrow-down1external-linkQwen3-Coder-Nexthuggingface.corobber@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 1 month agomessage-square10fedilinkfile-text
minus-squareAvid Amoeba@lemmy.calinkfedilinkEnglisharrow-up1·edit-218 days agoInteresting. 3B models run decently fast on my CPU and I have a lot of system RAM. 🤔 E: Just tried it on 100% CPU on AMD 7700 with DDR5 3600 and it does 6.5t/s. Not bad.
Interesting. 3B models run decently fast on my CPU and I have a lot of system RAM. 🤔
E: Just tried it on 100% CPU on AMD 7700 with DDR5 3600 and it does 6.5t/s. Not bad.