• 8 Posts
  • 42 Comments
Joined 1 year ago
cake
Cake day: August 9th, 2023

help-circle



  • 24GB VRAM will easily let you run medium-sized models with good context length, and if you’re a gamer the XTX is a beast for raster performance and has good price/performance.

    If you want to get serious about LLMs also keep in mind that most models and tools scale well across multiple GPUs, so you might buy one today (even a lesser one with “only” 16 or 12GB) and add another later. Just make sure your motherboard can fit 2, and you have a CPU, RAM and power supply that can handle it.

    Here’s a good example from a guy who glued two much more modest cards together with decent results: https://adamniederer.com/blog/rocm-cross-arch.html














  • I spent my childhood in Brooklyn (just a bridge away from Manhattan) just before the internet was a thing, and it seems pretty normal relative to what friends from other places describe. In fact, better in some ways. It was always easy to get a group of kids together to do whatever. We had pickup baseball (usually stickball), basketball, hide-and-seek and other games. There were 2 nice parks and several pocket parks in easy walking distance. Most of us had and rode bikes everywhere. A lot of my friends went to different schools (because of the density you might walk 3 blocks to the elementary school north of you, or 4 to the one south), so there were always new pools of people to interact with.

    Though I moved away my sister still lives there and has kids of her own, and it seems pretty much the same now as it was then. Since the density of the place hasn’t changed too much it actually seems more the same than where I live now, which has significantly changed in terms of population and traffic (and is heavily car-dependent) in just the last 15 years.





  • This is a good, short read. For those who are unfamiliar with the AGPL license that the author proposes we all start using, the main difference (and I am not a lawyer) is that under the AGPL, the source code including any modifications must also be made available to all users interacting with the software over a network. This prevents companies from making proprietary versions of AGPL software that are only accessible as a web service, which is one of the big ways that corporations are able to profit from GPL source code contributions these days.