locknessness
Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
on Friday October 20, 2023 @10:38PM (#37963599)
AMD messes up software... Again.
Re:Elasticsearch Relevance Engine brings new vectors to generative AI
on Thursday May 25, 2023 @04:18PM (#36075623)
Enterprise enters the space currently occupied by Pinecone, Chroma, Weaviate, etc.
Re:Hugging Face and AWS partner to make AI more accessible
on Tuesday February 21, 2023 @05:09PM (#34888301)
Disclaimer: I used to work for AWS ML
Buried in the press release is the announcement that there will be a push to bring up models on the AWS Trainium accelerator.
In the name of "ML democratization" this agreement could help shift tides away from the Nvidia HW + SW monopoly. Amazon (trn1) and Google (TPU) are little guys compared to Nvidia.
The book may already be written. Pytorch is heavily biased towards libraries that are customized for cuda/Nvidia (see FSDP). This leaves the other HW folks playing SW catch-up, with everyone rallying behind the open source XLA compiler.
It's too bad the press release didn't touch on these points and used cliche rhetoric instead.