turkishdelight@lemmy.ml to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

Ollama now supports AMD graphics cards

4

77

Ollama now supports AMD graphics cards

turkishdelight@lemmy.ml to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

4

Ollama now supports AMD graphics cards · Ollama Blog

Ollama now supports AMD graphics cards in preview on Windows and Linux. All the features of Ollama can now be accelerated by AMD graphics cards on Ollama for Linux and Windows.

But in all fairness, it’s really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

Chat

Alex@lemmy.ml
link
fedilink
English
arrow-up
1·
1 year ago
I was sadly stymied by the fact the rocm driver install is very much x86 only.
- turkishdelight@lemmy.mlOP
  link
  fedilink
  English
  arrow-up
  2·
  1 year ago
  It’s improving very fast. Give it a little time.

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

31 users / day
58 users / week
249 users / month
592 users / 6 months
1 local subscriber
2.69K subscribers
193 Posts
754 Comments
Modlog