News for hackers. Stuff that matters.
Re:Apple No Longer in Talks to Invest in ChatGPT Maker OpenAI by tough on Monday September 30, 2024 @03:56PM (#41701380)
the only AI hardware that matters are the GPU´s

if altman gets his billions he can buy or build some maybe

Re:Apple No Longer in Talks to Invest in ChatGPT Maker OpenAI by rhdunn on Monday September 30, 2024 @04:13PM (#41701572)
There are several ways that AI hardware could compete with GPUs:

1. more VRAM -- better capacity for running large models and training new models/LoRAs/etc.;

2. more matrix and tensor accelerators/cores -- be able to run the neural networks faster;

3. dedicated silicon for ReLU and other common neural net building blocks to better accelerate workflows;

4. efficient use of the above to ideally run a model at the same speed but lower power;

5. affordability at the higher end so you are not spending £30,000+ on an AI workstation/server just to get 80GB VRAM.

Re:Apple No Longer in Talks to Invest in ChatGPT Maker OpenAI by tough on Tuesday October 01, 2024 @10:58AM (#41709277)
yeah sorry i was only thinking about all the dumb ai gadgets that the grifters are raising millions to shovel us and are gameboys + llm or mics on your neck