News for hackers. Stuff that matters.
Re:Intel Gaudi 3 AI Accelerator by latchkey on Tuesday April 09, 2024 @03:10PM (#39983044)
You are right, AMD should do more with consumer cards, but I understand why they aren't today. It is a big ship, they've really only started changing course as of last Oct/Nov, before the release of MI300x in Dec. If you have limited resources and a whole culture to change, you have to give them time to fix that.

That said, if you're on the inside, like I am, and you talk to people at AMD (just got off two separate back to back calls with them), rest assured, they are dedicated to making this stuff work.

Part of that is to build a developer flywheel by making their top end hardware available to end users. That's where my company Hot Aisle comes into play. Something that wasn't available before outside of the HPC markets, is now going to be made available.

Re:Intel Gaudi 3 AI Accelerator by tucnak on Tuesday April 09, 2024 @03:17PM (#39983113)
> developer flywheel

This is peak comedy

Re:Intel Gaudi 3 AI Accelerator by latchkey on Tuesday April 09, 2024 @03:25PM (#39983185)
https://news.ycombinator.com/newsguidelines.html

Comments should get more thoughtful and substantive, not less, as a topic gets more divisive.

Re:Intel Gaudi 3 AI Accelerator by jmward01 on Tuesday April 09, 2024 @05:53PM (#39984705)
I look forward to seeing it. NVIDIA needs real competition for their own benefit if not the market as a whole. I want a richer ecosystem where Intel, AMD, NVIDIA and other players all join in with the winner being the consumer. From a selfish point of view I also want to do more home experimentation. LLMs are so new that you can make breakthroughs without a huge team but it really helps to have hardware to make it easier to play with ideas. Consumer card memory limitations are hurting that right now.
Re:Intel Gaudi 3 AI Accelerator by latchkey on Tuesday April 09, 2024 @05:56PM (#39984730)
> I want a richer ecosystem where Intel, AMD, NVIDIA and other players all join in with the winner being the consumer.

This is exactly the void I'm trying to fill.

Re:Intel Gaudi 3 AI Accelerator by Hugsun on Sunday April 14, 2024 @08:33AM (#40030673)
I can't find your company, what are you trying to do to solve this?
Re:Intel Gaudi 3 AI Accelerator by latchkey on Sunday April 14, 2024 @11:11AM (#40031667)
Thanks for asking, it is right there in my profile... click on my username.