News for hackers. Stuff that matters.
Re:Paradigms of A.I. Programming: Case Studies in Common Lis... by kqr on Friday May 05, 2023 @03:53AM (#35826465)
The company I work for makes a killing on applying a 1980s-era ML technique to a really tough modern business problem -- the resulting product is probably the best in the world at what it's doing.

Old techniques have several things going for them, with one of the more important ones for us being explainability. A random person off the street could hypothetically, with an hour or two of training, diagnose problems just by looking at the structure of the model. That's very helpful for adapting to market needs.

Generality is another big plus. Since the model encodes intuitive ideas there's a lot of room for using it in innovative ways.

Older techniques also tend to produce better results with less data, because big data wasn't as much of a thing back then.

Unless you have a crazy amount of resources, I think it's far better to be bleeding edge in as few things as possible. Solving a new business problem? Perhaps don't spend too much time on also solving all the childhood diseases of a new technology.

Re:Paradigms of A.I. Programming: Case Studies in Common Lis... by npsomaratna on Friday May 05, 2023 @04:53AM (#35826832)
Cost is also important. LLMs are expensive to run.

I think that going forward, we'll see a mix of "normal" programming, LLMs, and simpler machine learning techniques all combined together, because of economic reasons.

Re:Paradigms of A.I. Programming: Case Studies in Common Lis... by kqr on Friday May 05, 2023 @05:03AM (#35826878)
Hm. I'm not sure about cost. I haven't done any sort of analysis but I would guess with 75 % certainty that the techniques we use need more watts per byte of data than modern techniques. Modern techniques are very efficient in terms of their operation -- it's just that they achieve performance by needing to do so much operation!
Re:Paradigms of A.I. Programming: Case Studies in Common Lis... by bmitc on Friday May 05, 2023 @07:06AM (#35827685)
I was assuming they were referring to the data collection, storage, and processing and model training.
Re:Paradigms of A.I. Programming: Case Studies in Common Lis... by i_don_t_know on Friday May 05, 2023 @09:14AM (#35828808)
What 1980s-era ML technique are you using and why is it better suited for your application than something modern? Is it „just“ the ability to explain solutions, or is there something else like guarantees for XYZ?
Re:Paradigms of A.I. Programming: Case Studies in Common Lis... by kqr on Friday May 05, 2023 @10:33AM (#35829748)
The core part of it is doing dimensionality reduction with shallow neural networks, but essentially all user-facing functionality we get by controlling the training methods and hooking into the neural network and querying it all sorts of ways.

We switched from more modern techniques primarily because they needed too much data to work well, but the other things I mentioned are the benefits we noted along the way. I don't know if that answers your question.