I don't see any future where programs follow the static nature of old paradigm programming. A nice intuitive UI? What about just telling the app what I need when I need it? The gold standard of consumer UI is...another person.
If I have a team of god tier SWE's at my disposal, why the fuck am I fumbling around in an actions panel? The program can just be dynamically modified in real time to be whatever I need it to be in that moment.
If you extrapolate LLMs out to their extreme, you get a shape-shifting liquid array of bits in memory that manifest anything at the behest of a completely natural language interface.
Absolutely not. Constraining the set of possible actions instead of having you verbalise what you want every time is often a feature, not just a technical limitation. A camera with a shutter button is better design than having to tell the camera “please take a photo”.
At the supermarket, I personally also prefer the self-checkout machines over going to a human cashier.
The UI is totally fluid at all times, because an "intelligence" is actively manifesting it at all times. Nothing needs to be hard coded.
Hell the computer might even see your face, see your age and style, and be like "Yup, this guy definitely wants to checkout with a dumb, midi keytone 8-bit styled program"
But already AI design is everywhere and regular people don't even notice. It's only going to get better as people can interact with the design the same as the interact with another person.
The only reason it works out in my favor is that I enjoyed doing it. Normal people don't want to fuck around with that kind of shit.
You're also assuming that there are no negatives to saying what you want compared to just acting on things, but since the beginning of computing many people have proven this wrong time and again. I suggest you read about HCI as a research field and its history, it doesn't take much to realise how limited the average HNer's understanding of UI/UX design is, and how far current LLMs are from the skills required to be able to carefully design an app for productive human use.
Good design rarely calls for a “you can do everything” approach. Good design is often context specific and subtly guides users to better outcomes.
Doctor appointments would absolutely suck if I had to navigate decision trees and click buttons to communicate my symptoms. Car blinkers would absolutely suck if I had to type “blink left” into a chat window before every turn.
Maybe it’s just the ‘tism, but I hard disagree that I would ever say another person is a superior interface into… anything? It’s slow, they may misinterpret you, they have their own ideas and motivations, they’re (mostly) expensive because the only reason I need them is because there’s information / skill asymmetry. I don’t know that many or even most of those problems are resolved with ai, in some ways the problems are amplified.
I like to customize my Neovim setup or terminal and a bunch of scripts that I keep making them nice and maybe my blog and so on.
I don't want to become the PM of every app I need. But I do agree changes will happen to the current apps and how we buy and use them. Not sure exactly where it will settle. But still unknown unknowns and domain knowledge and vocabulary is not yet allowing anyone to build their own apps unless for simple cases.
Or maybe it is just me: I want someone else to think about my accounting app. I dont want to spend time to learn and understand and keep myself up to date or setup a series of LLM sessions that navigate and watch laws and propose changes.
Why do you need an accounting app when you have an accountant?
Programs of the future will in no way resemble what they are today. I don't even want to call it a "program" because in my head it's more like an intelligent digital liquid that can rapidly flow into any state. This flash-in-the-pan 50 year archaic era of software will look like what the oil lamp looks like today. A crude intermediate tech during a time of much larger transition.
it's nice to see my financial situation at a glance, without asking my accountant.
speech/text is one modality. we humans are also visual and tactile. and we need consistency and recurring patterns of interaction to function well.
Same thing for your accountant.
Imagine that both of them, while being good at their respective jobs, are also software engineers that can mint a custom throwaway app for you at a moment's notice.
I'm sure your secretary will make a note of your preference.
Sounds cumbersome, slow to use, and prone to failure.
However, you could expect LLMs to train on existing successful apps and hardened design patterns that compose well into good UIs. In that case, you might expect the last mile polish to be the differentiating factor. However, the more marginal this last mile becomes, the more other social, political, business, etc. forces will determine which app rises and which falls. But this has always been the case, certainly in software.
If you meant training on UI and features of established apps then it gets even more complex, as success of B2C apps is obscured by their pricing strategies and marketing, and business models for successful B2B apps like Jira/Confluence/Office often revolve around sales, partnerships and other non-product things like that.
Any business is a set of design decision someone made, with their app just being a small subset of these.
I dont think llms are going to replace banking apps anytime soon. But I no longer look for an app to pull data from my Peloton app into another exercise app. LLMs can build an app or a script that will do that and I wont have to pay some annual or monthly fee. It feels like these types of apps are going to die off.
I think it's better when you are at the origin, and the software branches off of your taste. For so long, we had to adapt and accept the ways of established software because it would take so long to make something of your own. Now it's both cheap and fast to iterate.
I recently used a coding agent to build a TV-like YouTube player for my mother, who is quite elderly. It's inspired by channelsurfer.tv, but runs on the Google TV Streamer in my living room. Unlike any set top box I've seen, it has on-screen diagrams that tell her which button to press on the remote to change the "channel." It doesn't have ads. The UI will never change unless I ask the AI to change it.
You can't say that about most apps in an app store. They will do a UI redesign and you're out of luck if you preferred the old version.
Do you really think Google or Apple or anyone else will build this app? Maybe some self-hosted media box out there would be similar, but I can't be bothered to search for one and I'm doubtful that any of them were designed for an elderly parent who isn't good with technology. It's still work in progress, but at least she can use a single remote to turn the TV on and watch TV without being bombarded with things she doesn't understand and doesn't care about.
There are downsides that make this app less compelling for other people, but I didn't build the app for them.
There's a recent benchmark indicating Hermes Agent and, I think, Qwen's harness are far and away the most effective.
Pi isn't bad but it doesn't seem as talented as Hermes. Nor does it currently array of self-learning/adaptive plugins seem as capable. That said, it's difficult to keep track of the SotA with pi; it grows like the node ecosystem in its first year.
But we are not there yet.
Whatever "good design" is (and it varies by user), it's very easy to copy. Commodity apps complete on marketing. Companies who charge $10/month for an app, are probably spending $8/month in marketing/advertising.
At the end of the day, it seems we'll be left with a decision of using something made by a person with real opinions or using something generated by AI with opinions that are a distillation of past documentation fed into it.
We're in this weird spot now where we are transitioning toward all ui feeling the same, and only the people really tuned in even notice this. Once the general public starts noticing, I believe there's going to be a search for fresh, organic, opinionated software. Not that the software won't be AI-generated, but it will have a human truly sculpting it, like art.
So the question becomes, if people still appreciate human-made art in a world where a better image can be generated in a small fraction of time via a prompt, will they feel the same way about the software they use?
Commodities like todo apps and calculators rarely compete on features, they compete on product design. This includes look and feel, relation between elements, design choices on what exact common features are available.
All products are, at their essence, just a set of design decisions stitched and shipped together.
Now, making these design decisions is hard. It requires knowledge, consistency, and insights into how real people operate real products. Even as a sole user of the app you build you rarely know what you actually need.
LLMs are 'design-less' in their essence. Building your own todo app takes literal seconds and it all looks simple because LLMs will default most of these design decisions for you - until you try to use your new app daily and notice it somehow sucks. Building a good todo app or good calculator requires tweaking, publishing, polishing, and solving bugs, testing, rinse and repeat.
Another tricky side of this is that you might know logically what features you want, but you are not selecting one product over another logically. You need to try and see if that works for you, all the vibes and good parts and bad parts and design choices and colors, till you find something that "clicks" for you. Using pure Claude as a todo app only works as long as you want to have more Claude in your daily life.
In the meantime app store provides dozens of well-reviewed alternative solutions which look good and require zero maintenance.
And that's just a calculator or todo app. Non-commodity apps are even harder than that.