minus-squaresapetoku@sh.itjust.workstoLocalLLaMA@sh.itjust.works•A question about running LLMs with an AMD cardlinkfedilinkEnglisharrow-up2·11 months agoAll the ones I’ve used so far are able to use the GPU but it has to be enabled in the app settings. I mostly use LM Studio and it flies on my nvidia 3060. Doesn’t seem to have options for AMD GPUs though, unless I’m mistaken. linkfedilink
minus-squaresapetoku@sh.itjust.workstoMemes@lemmy.ml•A secret best left unknownlinkfedilinkarrow-up1·1 year agoScaramanga, is that you? linkfedilink
All the ones I’ve used so far are able to use the GPU but it has to be enabled in the app settings. I mostly use LM Studio and it flies on my nvidia 3060. Doesn’t seem to have options for AMD GPUs though, unless I’m mistaken.