Re:Apple No Longer in Talks to Invest in ChatGPT Maker OpenAI
by tough on Tuesday October 01, 2024 @10:58AM
(#41709277)
yeah sorry i was only thinking about all the dumb ai gadgets that the grifters are raising millions to shovel us and are gameboys + llm or mics on your neck
1. more VRAM -- better capacity for running large models and training new models/LoRAs/etc.;
2. more matrix and tensor accelerators/cores -- be able to run the neural networks faster;
3. dedicated silicon for ReLU and other common neural net building blocks to better accelerate workflows;
4. efficient use of the above to ideally run a model at the same speed but lower power;
5. affordability at the higher end so you are not spending £30,000+ on an AI workstation/server just to get 80GB VRAM.