In my experience it’s literally the only model which can actually code beyond auto-complete. Not perfect but a completely different tier above the rest.
The progress made since the start has been wild, and if it keeps increasing, even at a much slower pace, it's gonna be even better.
That's like people looking at N64 games saying "wow, these new 3D graphics sure look like ass, they'll never catch on and replace 2D games". Or like people looking at the output of early C compilers going "wow, this is so unoptimized, I'll stick to coding in assembly for my career since nobody will ever use compilers for serious work".
It boggles my mind how ignorant people can be about progress and disruption based on how past history played out. Oh well, at least more power to those who embrace the new tech early on.
I’m sure somebody said that, but I don’t think it was a common sentiment.
Rather, people said that there were still some cases that required some assembly programming. And it is true. It’s just a niche. One they gets smaller over time. If you are a generalist it makes sense to retrain. If you are a specialist, there’s some level of socialization where you can get away with continuing to program assembly.
Back with N64 or C compilers, we didn't talk about energy requirements on the level of small countries and billions of dollars to even compete with the status quo. You're like one of those guys in the fifties, thinking it'll only be a few more years until we're all commuting in flying cars powered by nuclear reactors.
Why would embracing it early before it is useful give you more power?
Like, how is some hesitance towards the possibilities of this specific implementation of AI "ignorant of the progress and disruption of history". A casual glance at the headlines around blockchain ~ 6 years ago should invite some skepticism.
I think in some ways this is like looking at the difference between Camera only self-driving vs all the tools. I think it's quite possible LLM's look more like camera-only self-driving which will continue to get marginally better but may never solve the problem, and we're still waiting on the insight/architecture that will bring us full AGI.
I'll be back in line for the iPhone 3G, thank you.
I would guess that's one of those "pick any two" things, given how many construction projects, repair, "life happens" stuff goes on in a modern city
That said, unless I'm totally missing something they have a self-solving problem with that since the Waymo's all carry around cameras, lidar, and presumably radar so I would expect that they update the maps as they go. Come to think of it, that's very likely why I originally saw them roaming around the city with drivers in them: testing the pathfinding and mapping at the same time
I would believe at some point this is possible though, since at least if they send the data home about things that "don't match" with their precise maps, they can easily use as much compute as they want on the servers to get the maps updated.
The job has changed before, it will change again. It may get easier to enter the industry, but the industry will still exist and will still need subject matter experts a decade from now.
I also don’t like English as a language to express requirements, it’s not strict enough and depends too much on an implicit context. Whatever high-level abstraction we end up with it cannot be something that results in the wrong implementation because the agent incorrectly read the tone of the exchange.
There are people on hacker news daily arguing this
That can easily be said of most Product Manager > SWE relationships too though
In otherwords, they are cheaper mid to entry level employees which don’t get sick or have emotions. I think most people would agree with this.
One of the reasons well informed curious people tend to underestimate the value of LLMs despite their flaws is they underestimate the amount of routine work that could be automated but is still done imperfectly by humans. LLMs lower the barrier to entry to halfway decent automation and eliminating those jobs.
Where I’m not sold yet is on the whole idea of bots that go off and do their own thing totally unsupervised (but increasingly, you are having models supervise one another).
Which means we're doing it backwards.
AI writes code as well as a committee of StackOverflow users but reads it without breaking a sweat. Use AI to do the harder part.
he's the creator of django and has been writing about coding with LLMs since the beginning. he was one of the first people to report about prompt injection and hallucinations. you will learn about the strengths and weaknesses of coding with LLMs if you approach his blog with an open mind.
Probably quantum computing. That seems to be the next hyped up product.
It turns out that to be a good 3D printer, you need to be really good at CAD, and measuring stuff with Vernier calipers. That’s like prompt engineering.
Then there was the nozzle temperature, print errors, and other strange results — call those hallucinations.
Once I had designed something that I needed many instances of, it was great. But for one-offs, it was a lot of work. So it goes with AI.
I kind of wonder if there's a way to make ai-accessible software.
For example, lets say someone wrote some really descriptive tutorial on blender, not only simple features, but advanced ones. added some college texts on adjacent problems to help prevent "falling flat" at more difficult tasks.
could something like that work? I figure LLMs are now just reading simple tutorials now, what about feeding them advanced stuff?
> It doesn't surprise me though, most of the people working on this are the same that had been promising self-driving cars.
Where did you pick that up? That's just pure hallucination (ironically). Also what are you implying, that Tesla made LLM now? If I have to guess their amount of contribution to LLM it'd be way closer to 0 than 'most'.
It's one of those things that is so easy to say but has no actual truth.
It doesn't surprise me though, most of the people working on this are the same that had been promising self-driving cars. But that proved to be quite hard, and most of them moved on to the next thing which is this. So maybe a decade from now we'll be directing AIs instead of writing code. Or maybe that will also be difficult, and people will have moved on to the next thing they will fail to replace with AI.