ninahaberl

You are basically saying that some models (your local one, which is it?) in some setups (the API you mentioned) can fail to use fresh information if that conflicts with strong training priors. I agree:)

BUT

That's a bad model. My opinion is that for exactly this case we need to use RAGs/ APIs/ some retrieval mechanisms.

It's silly to train them on stuff that changes every week/month

I don't learn APIs by heart, I look them up. It's to expensive (my time) for me and (the compute) for the models

Models don't need to keep retraining just to stay current. Harnesses give them access to the internet, internal systems use RAGs, and so on.

I think lower-cost models will get the largest piece of the pie, as with almost everything that has ever been sold.

Just look at cars: US consumers buy the F-150, EU consumers buy the freaking Dacia Sandero the most :)))

Ferrari/Lambo numbers are microscopic

I’d expect these shenanigans to get much worse over time for the average Joe.

Imagine a world where any random person can run a super-capable model on their own hardware with no limitations and no one to pull the plug.

Information has always been power and those who already have power won't just allow everyone else having the same tools as them