News for hackers. Stuff that matters.
Re:AI PCs Aren't Good at AI: The CPU Beats the NPU by refulgentis on Wednesday October 16, 2024 @05:01PM (#41863821)
You're absolutely right IMO, given what I heard when launching on-device speech recognition on Pixel, and after leaving Google, what I see from ex. Apple Neural Engine vs. CPU when running ONNX stuff.

I'm a bit suspicious of the article's specific conclusion, because it is Qualcomm's ONNX, and it be out of date. Also, Android loved talking shit about Qualcomm software engineering.

That being said, its directionally correct, insomuch as consumer hardware AI acceleration claims are near-universally BS unless you're A) writing 1P software B) someone in the 1P really wants you to take advantage.

Re:AI PCs Aren't Good at AI: The CPU Beats the NPU by kristianp on Wednesday October 16, 2024 @06:37PM (#41864564)
1P?
Re:AI PCs Aren't Good at AI: The CPU Beats the NPU by refulgentis on Wednesday October 16, 2024 @06:38PM (#41864574)
First party, i.e. Google/Apple/Microsoft