News for hackers. Stuff that matters.

A comment on Who uses Google TPUs for inference in production?. Parent comment

Re:Who uses Google TPUs for inference in production? by htrp on Monday March 11, 2024 @04:24PM (#39672845)
100% agree, if I have access to the TPU team internally, it'll be very easy to use in production.

If you aren't internal, the documentation, support, and even just general bug fixing is impossible to get.

[ Parent | on HN ]
Re:Who uses Google TPUs for inference in production? by ethbr1 on Monday March 11, 2024 @06:22PM (#39673902)
(Has an expert team dedicated solely to optimizing for exotic hardware) = an option

(Doesn't have a team like that) = stick to mass-use, commodity hardware

That's generally been the trade-off since ~1970. And usually, the performance isn't worth the people-salaries.

How many examples of successful hardware that isn't well-documented and doesn't have drop-in 1:1 SDK coverage vs (more popular solution) are there?

It seems like a heavy-lift to even get something that does have parity in those ways adopted, given you're fighting market inertia.

[ Parent | on HN ]