When the internet was just getting started, I imagine it would have sounded ludicrous to suggest that soon, practically every single software application would have some networking component.

Similarly, I think it's a good bet that in the relatively near future, pretty much all consumer software, down to piddling little phone games, will be built with the presumption of some LLM/inference layer.

One very simple reason for this is that AI could dramatically change people's expectations for UI/UX across the board. I can see a future where the expectation is to have some natural language interface at minimum, or have UI driven a great deal by inference under the hood.

In which case, applications without these features become about as appealing as command line tools to the general public.