News for hackers. Stuff that matters.
Re:Does current AI represent a dead end? by clayhacks on Friday December 27, 2024 @01:12PM (#42524503)
Deepseek just released their frontier model that they trained on 2k GPUs for <$6M. Way cheaper than a lot of the big labs. If the big labs can replicate some of their optimisations we might see some big gains. And I would hope more small labs could then even further shrink the footprint and costs
Re:Does current AI represent a dead end? by cruffle_duffle on Friday December 27, 2024 @01:37PM (#42524715)
I don’t think this stuff will be truly revolutionary until I can train it at home or perhaps as a group (SETI at home anybody?)

Six million is a start but this tech won’t truly be democratized until it costs $1000.

Obviously I’m being a little cheeky but my real point is… the idea that this technology is in the control of massive technology companies is dystopian as fuck. Where is the RMS of the LLM space? Who is shouting from every rooftop how dangerous it is to grant so much power and control over information to a handful of massive tech companies, all whom have long histories of caving into various government demands. It’s scary as fuck.

Re:Does current AI represent a dead end? by lodovic on Friday December 27, 2024 @03:53PM (#42525935)
This is just a tech race. we'll get affordable 64 gb gpus in a few years, businesses want to run their own models.