ThunderKittens: Simple, Fast, and Adorable AI Kernels

Re:ThunderKittens: Simple, Fast, and Adorable AI Kernels by Archit3ch on Wednesday October 30, 2024 @06:41PM (#42001304)

I hate to be that guy, but Metal support?

[ Parent | on HN ]

Re:ThunderKittens: Simple, Fast, and Adorable AI Kernels by simarora777 on Wednesday October 30, 2024 @07:51PM (#42001912)

coming!

[ Parent | on HN ]

Re:ThunderKittens: Simple, Fast, and Adorable AI Kernels by 6gvONxR4sf7o on Friday November 01, 2024 @12:32PM (#42018679)

I'm late to the party, but also wondering about Metal, and I have a question for you all. Do you happen to know how energy use relates to utilization? If I run a super duper duper fast thunder kitten kernel on an iphone (pending Metal, blah blah), would I expect it to also cost less battery? My naive guess is yes, but without logic to back it up.

It would be wild if some of these time-efficiency boosts you're getting with TK turned out to be energy-efficiency boosts too!

[ Parent | on HN ]