What gpu are you running models on?
d0nkey
- 0 Posts
- 3 Comments
Joined 8 months ago
Cake day: August 16th, 2025
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
d0nkey@lemmy.zipto
LocalLLaMA@sh.itjust.works•Am I the only one who is really impressed by Granite4 from IBM?English
2·5 months agoI have used the micro variant primarily with perplexica and I must say it is really good for summation and for answering further questions, especially when it comes to these tasks in my testing it has outclassed instruct models that are 2-3 times its size.
But still no one is willing to move to another platform. I have talked to many of my friends about moving to a more secure platform for messaging or social media, but nobody is willing to move because everyone they know is on a platform developed by meta. And I think they are right, it is impossible to make everyone individually switch, we need new rules and regulations being put in place in order to at least protect some parts of the lives of us and everyone around us.