News for hackers. Stuff that matters.
Re:Powering cost-efficient AI inference at scale with Cloud ... by jauntywundrkind on Tuesday November 28, 2023 @09:27PM (#38454693)
My vague read from before was that TPU4 has been out for a long long time & was basically near impossible to get time in unless you could bid super high.

Not my field & this could be super wrong. But my skepticism that a TPU5e launch was going to help anyone but some niche well connected other big players has been very high. I'm interested from an academic sense, and I love work like the Keras 3.0 release that makes me much more universal/portable, such that hardware like this or others can burn f-ing metal. But I don't have much trust this will actually be available at a reasonable price/with any kind of availability. https://news.ycombinator.com/item?id=38446353 https://keras.io/keras_3/

I'd love to be wrong & have this be actually available at a good price to change what is possible for people, & still interesting. Your call out is right. There's no lightning rod here, nothing to be hyoer-critical of, and few step outside the comfort zone of CUDA have anywhere near enough idea how to assess. This is an unknown on the radar for most.

There are no comments on this comment yet.