Now try to mute a video on youtube and understand what's being said from the automatic subtitles.
If you do it in english, be aware that it's the best performing language and all others are even worse.
1. It's overwhelmingly more useful than the [no text] it was replacing, particularly for the deaf or if you want to search for keywords in a video.
2. When it fails, it tends to do so in ways that trigger human suspicion and oversight.
Those aren't necessarily true of some of the things people are shoehorning LLMs into these days, which is why I'm a lost more pessimistic about that technology.
https://news.ycombinator.com/item?id=41199567#41201773
I expect that YouTube will up their transcription game soon, too.
Basically it's kinda useful to put time tags, but I need to manually fix each and every sentence. Sometimes I need to fix the time tags as well.
I just spoke about youtube because it's more popular and easy to test.
I've come to notice a correlation between contemporary AI optimism and having effectively made the jump to coding with AI assistants.
I think this depend heavily on what type of coding your doing. The more your job could be replaced by copy/pasting from Stack Overflow, the more useful you find coding assistants.
For that past few years most of the code I've written has been solving fairly niche quantitative problems with novel approaches and I've found AI coding assistants to range from useless to harmful.
But on a recent webdev project, they were much more useful. The vast majority of problems in webdev are fundamentally not unique so a searchable pattern library (which is what an LLM coding assistant basically is) should be pretty effective.
For other areas of software, they're not nearly as useful.
I think this is true and also why you see some "older devs just don't like AI" type comments. AI assistants seem to be great at simple webdev tasks, which also happens to be the type of work that more junior developers do day to day.
I have also found them useful with that and I keep one active for those types of projects because of the speed up, although I still have to keep a close eye on what it wants to inject. They also seem to excel at generating tests if you have already developed the functions.
Then there are more difficult (usually not webdev) projects. In those cases, it really only shines if I need to ask it a question that I would previously have searched on SO or some obscure board for an answer. And even then, it really has to be scrutinized, because if it was simple, I wouldn't be asking the question.
There is def. something there for specific types of development, but it has not "changed my life" or anything like that. It might have if I was just starting out or if I only did webdev type projects.
If this thing also conferred an actual productivity advantage that would be one thing, and it might motivate me to get past the horrible UX, but I haven't seen any evidence yet.
But after that we ran into a kind of loop, where you put my feelings into much better words than I could. If I had stopped after iteration 3, I probably would have finished what I wanted to do in half a day
Anyway, considering all these things can be done on device, where is the long term business prospect of which you speak?