• 0 Posts
  • 9 Comments
Joined 2 years ago
cake
Cake day: June 26th, 2023

help-circle
  • And then you have a trained model that requires vast amounts of energy per request, right? It doesn’t stop at training.

    You need obscene amounts GPU power to run the ‘better’ models within reasonable response times.

    In comparison, I could game on my modest rig just fine, but I can’t run a 22B model locally in any useful capacity while programming.

    Sure, you could argue gaming is a waste of energy, but that doesn’t mean we can’t argue that it shouldn’t have to cost boiling a shitload of eggs to ask AI how long a single one should. Or each time I start typing a line of code for that matter.









  • I love building my own uBlue image. Tinkering is done in toolbox containers, definite changes are baked into the image. Completely custom (to me) and when you get it right it will just work anywhere. If I would brick my PC/storage I can just boot up another and restore my (back-upped) home dir with very little effort.