News for hackers. Stuff that matters.
Re:GPT-5 is behind schedule by dns_snek on Monday December 23, 2024 @09:42AM (#42494698)
> Yes, the big companies are making the models, but enough of them are open weights that they can be fine tuned and run however you like.

And how long is that going to last? This is a well known playbook at this point, we'd be better off if we didn't fall for it yet again - it's comical at this point. Sooner or later they'll lock the ecosystem down, take all the free stuff away and demand to extract the market value out of the work they used to "graciously" provide for free to build an audience and market share.

Re:GPT-5 is behind schedule by SamPatt on Monday December 23, 2024 @01:39PM (#42496603)
How will they do this?

You can't take the free stuff away. It's on my hard drive.

They can stop releasing them, but local models aren't going anywhere.

Re:GPT-5 is behind schedule by johnisgood on Monday December 23, 2024 @10:12PM (#42499444)
What are the hardware and software requirements for a self-hosted LLM that is akin to Claude?
Re:GPT-5 is behind schedule by skirmish on Thursday December 26, 2024 @12:44AM (#42513374)
Llama v3.3 70B after quantization runs reasonably well on a 24GB GPU (7900XTX or 4090) and 64GB of regular RAM. Software: https://github.com/ggerganov/llama.cpp .
Re:GPT-5 is behind schedule by dns_snek on Tuesday December 24, 2024 @04:37AM (#42500775)
They can't take the current open models away, but those will eventually (and I imagine, rather quickly) become obsolete for many areas of knowledge work that require relatively up to date information.