News for hackers. Stuff that matters.

A comment on Challenging projects every programmer should try. Parent comment

Re:Challenging projects every programmer should try by ericjmorey on Tuesday December 26, 2023 @12:01AM (#38769051)
"The vast majority of ML/AI software that is published (which often implements revolutionary techniques!) is of incredibly poor quality from a software engineering standpoint. As a result, practical AI applications are orders of magnitude slower than they could be."

That's quite the claim. Why should anyone take your word for it?

[ Parent | on HN ]
Re:Challenging projects every programmer should try by p-e-w on Tuesday December 26, 2023 @12:09AM (#38769084)
There are literally performance breakthroughs being made every few weeks (most recently, PowerInfer, which can speed up LLM inference by 10x or more) where the main improvement amounts to the application of caching/preloading techniques.

If the "engineering" part of ML had kept up with the "science" part, I have no doubt that performance for typical use cases would be 100x-1000x higher than we are seeing today.

[ Parent | on HN ]
Re:Challenging projects every programmer should try by wiseowise on Tuesday December 26, 2023 @05:46AM (#38770601)
> If the "engineering" part of ML had kept up with the "science" part, I have no doubt that performance for typical use cases would be 100x-1000x higher than we are seeing today.

Even more of a claim than previous one.

[ Parent | on HN ]