Personally I feel most of the improvement in the last year comes from tooling/integration (MCPs, realtime documentation access, treesitter support, orchestration) than from the models themselves, in the last year. And still frontier models would routinely come up with bs until you tell them to actually use those tools.
Two years ago, I couldn't trust an LLM to do anything that wasn't straight forward boiler plate.
One year ago, I was pretty solid at writing algorithms that were combinations of existing ideas.
Now, Fable is outputting stuff that I would genuinely consider to be creative and original if a colleague had presented it to me.
Yes, maybe the code style still isn't great, but given the pattern of the last few years, it feels correct (a priori) to assume that this gap isn't going to keep closing.
In the 60 years since, we've barely been able to adapt the 737 to fly longer routes.
I am going to say it. The CEO of a pre-IPO company has extreme incentive to bolster the tech he is selling, to the point where his every action should be viewed as only in service to that goal. Every word he says should be viewed critically through that lense. He is not making this post out of the goodness of his heart, he is doing it in service to the IPO. If it happens to align with your views that's great, but it's still just a marketing stunt to get people with your views to buy in. Don't be fooled. Buy in if you feel it's a good deal, not because of the CEO's marketing.
The fact that he doesn't support more restrictive approaches that don't align with his incentives doesn't invalidate the points he is making.
"Everyone else is doing it" but even worse as nobody else is actually even doing it and you just made up that part.
Just commenting on this horrible justification trick in general.
Also, on an unrelated note, why would you have an account for 5 years and only now post your second comment? AI has been an existential threat for years, why only now?
This is a pattern I am seeing all over the place on HN in the last year in AI threads, and I have to admit that I am starting to become paranoid and my feels need some assuaging.
However, my point isn't that I think Dario is our saviour who we should follow the every word of. As with everyone, his opinions should be filtered through the lens of his incentives. That said, I don't understand the knee-jerk reaction by many commenters to completely disregard the many important points he's making.
As for the lack of my account use, I can't comment for others, but I'm just quite shy. I've opened up the comment box many times to write a reply but rarely commit to actually posting it, especially because I feel like I'm not on the side of the general HN consensus.
The quality of discussion and prose on HN is just generally so high that it can feel quite a bit intimidating to jump in (in contrast to Reddit where I have no worries about commenting haha).
citation needed
There is nothing indicating these models are clearly intelligent. Language fluency is not cognitive intelligence, and to think otherwise is falling into the trap of anthropomorphizing the LLMs.
They are still probabilistic engines, there is no causal reasoning still, they only emulate logic, and as far as we know, there is no agency, just the illusion of agency.
The danger here is not existential as you say. We aren't on the cusp of some machine uprising by super intelligence. The threats are algorithmic bias, misinformation at scale, and displacement of human labor.
I would argue the best way to safeguard against long-term threats is to start by focusing on the issues that already exist. If you can offset the health risks of local datacenters or issues of unequal distribution of wealth by creating a more equal society right now then you’re already on the path to handling these long term issues. To me, this distant focus only distracts from the already present issues and conceals effective policy in this moment. We do need to safeguard against AI risk and it’s already here. Don’t even get me started on the havoc which recommendation systems have caused in society in the last 15 years which we still don’t call AI because it doesn’t speak.
Tl;Dr: These essays can feel disingenuous because:
1) AI risk is already present without exponential growth. The exponential growth argument often feels like a distraction from the fixes we could put in to fix the current issues that are already here.
2) The people stating this argument often have billions of dollars to gain if it comes true. While they may be altruistic, I also don’t see them doing all that much to fix the issues that people are already claiming exist and instead continue onwards on their path by justifying that they are the only ones responsible enough to handle it if the super intelligence does arrive. By continuing down that path, if that day ever does arrive they’ll have ensured the existence of a system which is unable to handle it.
https://theonion.com/this-war-will-destabilize-the-entire-mi...
There are people who simultaneously are scared about AI but refuse to believe that AI is the * real deal * and can do everything Dario thinks it can. These are the same people who think its all marketing hype and Dario is "hyping up" before IPO or some lame conspiracy theory.
It is high time people start accepting the real world performance of LLMs and brace themselves instead of hiding behind two contradictory views
1. AI is hype
2. AI is scary
Notice how in any of these proposed regulations, Dario is talking about future advances. Notice how these suggestions are never implied to apply retroactively to existing models. If AI was SO dangerous, then any future regulations should obviously be retroactive and we should seriously consider restricting access now to the models that already exist.
Hard not to see that as nothing more than a play at regulatory capture and pulling the ladder up behind them.
I'm not going to claim that the CEO of pre-IPO company has no incentive to bolster the claims of his tech, but to completely disregard everything he is saying based on that seems awfully binary.
I don't know whether people are just high on copium, spouting "it's just fancy autocomplete" or "only humans can really be creative" on every LLM-related thread, but it is impossible to deny that in a span of a few years we've gone from models that could barely put together a sentence, to something maybe not equivalent to a junior developer, but at least resembling it.
And sure, you can point out every flaw that current day LLMs have, just how everyone pointed out that Stable Diffusion couldn't generate accurate hands (until it could 6 months later!). But the gradient is pretty clear and I am yet to see a well-argued narrative from anyone why scaling laws should fail in the next year or two (by which point it feels like we're going to have a real problem, extrapolating the current trajectory).
I'm very glad this discussion is at least being had, and I wish everyone would get off their high-horse and take things a bit more seriously.