minus-squaresapetoku@sh.itjust.workstoLocalLLaMA@sh.itjust.works•A question about running LLMs with an AMD cardlinkfedilinkEnglisharrow-up2·1 year agoAll the ones I’ve used so far are able to use the GPU but it has to be enabled in the app settings. I mostly use LM Studio and it flies on my nvidia 3060. Doesn’t seem to have options for AMD GPUs though, unless I’m mistaken. linkfedilink
minus-squaresapetoku@sh.itjust.workstoMildly Infuriating@lemmy.world•Another example of shrink flation... oh, my beer...linkfedilinkEnglisharrow-up17arrow-down1·2 years agoMill St brewery was bought by Molson (or other industrial piss maker) a few years back. Total boycott on my part. linkfedilink
All the ones I’ve used so far are able to use the GPU but it has to be enabled in the app settings. I mostly use LM Studio and it flies on my nvidia 3060. Doesn’t seem to have options for AMD GPUs though, unless I’m mistaken.