ErrantX
The latest frontier models are producing significantly higher quality output. And the usual reason to introduce tech debt (deadlines) is less relevant.
Indeed, I know multiple companies fixing decades of bugs and security issues in just the last few months.
Prior to this, building the software was, generally, one of the main constraints. If the business wants to do X, then it takes 3 months to build.
That means the business ideation and governance cycle (what do we want to do, are there customers, what do we charge) can take 3 months.
If you 10x thay development process then you also have to do the same with the business processes.
Once engineering teams have cleared the backlog, then burned through the decades of tech debt the constraints will switch. And how businesses react to that will be interesting.
And even in 2024 the themes are similar, generally more complex or specific about the coding/turing/action test.
But in 2026 a huge shift, we have things like; can open a physical door, emulates human pettiness convincingly, makes novel scientific breakthroughs.
That alone tells you a lot IMO
Google never really has to outpace the competitors (other than to have some relevance) but they have a very large group of business customers using them for business process work in Gmail, Docs, etc.
Clearly they will win when the models are close enough to frontier to be good enough, but are long-term cheap for buy. I.e. they will aim to make it a commodity.
In theory MS has the same opportunity (plus they have GitHub so, you know, dev eco system too) but seem be blowing the strategy.
Anthropic and OpenAI are having to race to the top on ability entirely to keep their name in the media and in front of us all (which costs: hence more recently trying to pivot away from model releases and more into controversy/danger). The main cost is in training and so this strategy is much much more expensive and this will play out either as a huge cost hike or a forced slow down in pace.
I believe essentially Google is betting on that & I think it's probably the right strategy.
It was prescient (especially given he'd have written it through 2024) in its depiction of the ability of an AGI to break its boundaries.
Ultimately the risk of AI breakout(s) come down to the weakest human link.
Tech just happens and is useful, it's not necessarily attractive as a thing to investigate in detail.
And as to your last point; well that demonstrates your in the subset of people interested in this stuff. There are a hell of a lot of people very interested in trains too.
Big-co CEOs are naturally expected to share their bets - and they aren't going to couch it with a "oh well no one could know for sure but..", that would totally undermine their existence!
On top of that; sometimes just saying a thing can make it happen. So it's never not worth that shot...
This has always been true.
Your selecting a group of people (CEOs and VCs) who have always made and lost money on confidently predicting the future. See also wall street bankers and politicians.
There are winners and losers in any boom - this happened in Cloud, DotCom, computing and hell probably tractors, industrial revolution, etc
Fusillades specifically was unfamiliar but I inferred if from context and knowing fusilier.
I read a study a while ago (sorry Google didn't find it again) that said a lot of exceptionally gifted people just don't apply to elite universities. Instead, the main characteristic of applicants tends to be that they are extremely driven.
Drive tends to not correlate well to long term success without talent as a companion. Therefore a lot of people at Cambridge (which I think was the example) tend to do no better than the average in later life (notably wasn't true for PPE grads obviously)
Either due to corruption or, even more likely, institutional biases.
Malcolm Gladwell has a few episodes of revisionist history that looks at some US universities who fall into this trap.
Even with all that said; the chances of a selection process for 17/18 year olds being able to correctly select the best future adults in their field is very low.
Another good example; the number of young geniuses or prodigies (whether maths, chess, acting etc.) who don't make anything of themselves.
She remains my (close) second favourite[1], with a choose your own adventure talk about algorithms. It was genuinely great, and warm, and thoughtful (a lot of it was about the risks of algorithms, which is very relevant for us).
This was... 2021 so mid COVID (yep it was remote) and so just before she became really big. We've worked with a lot of external speakers since, many of them very good or very slick, but she was the only one that was clearly both brilliant at her topic(s) and also an exceptional communicator.
[1] For the record my favourite is Clifford Agius who is some guy I saw at a local conference who in his spare time from being a commercial pilot builds fully robotic arms for kids - he even lets them give the finger. Great guy and refused to charge us more than a few hundred quid.
What sufficiently hard, but useful, problem would you ask the model for?
The problem isn't the test, its that is a public test.
Simon has previously said he has a list of secret prompts (at least one of which he "burned" as a demonstration a while ago). That's what makes it a good test - his commentary on the public test is something of a proxy for non-public tests. This makes it a good benchmark.
So 3) he is well aware of his audience and is talking to them directly.
It's a shame. Both AOC and PG are often right in their own way, and then deeply entrenched in others.
If I am honest I believe my final solution will be a combination of Open Claw, a custom knowledge wiki based on Wikmd. I just need a good all for Claw with history that is as good as gpt
Edit: and context too. It inferred my energy supplier from previously chats and so when I just asked a pertinent question it referenced their policy. Admittedly Google will have way more context if they get the product right.
For example; ChatGPT is replacing my Google searching. Not necessarily because it's better, or because it's summaries are better than Google (I find them subjectively better but it's not clear cut).
But because the app has a nice history; can ask a relatively complicated question and go do something else and then come back to it, ask a follow up. Etc.
None of that is specifically an AI benefit, but it's a workflow that really helps, well, flow.
But as an enterprise buyer $50/m and $10K/m is the same bucket in terms of cost. No one will blink until around 100K, depending on what it is.
(The point I am making is; as an enterprise buyer I absolutely know how annoying it is for me to turn up and go "this random regulation, we're interpreting it in this highly specific and unique way, and we want it asap". Hence willingness to pay down that inconvenience)
They will pay $50 for your product... And probably $950 for the terms.
(Not saying that would have been the right thing for you but my advice to folks who find themselves in this position is always 20x or 40x the price - if that is enough to make it worth your bother, then go for it. Good chance theyll pay)
I fully agree that AI could extend access; but to build on what others have said too, lack of physical diagnostics is an issue as is the lack of physical tech infrastructure.
Besides; this article was about diagnosis not prescribing. It's pretty obvious, I think, that diagnosis is one area where AI will perform extremely well in the long run.
I think there are two metrics; the first is outright misdiagnosis, which studies put between 5 and 8% in US/Europe. That's a meaningful number to tackle.
Secondly; overdiagnosis. Where a Dr says on balance it could be X on a difficult to diagnose but dangerous problem (usually cancer). The impact of overdiagnosis is significant in terms of resources, mental health, cost etc.
For example; do you care if the UI has a purple theme or a blue one? Or if it's React or Vur. If you do that's part of your goals, if not it doesn't entirely matter if V1 is Blue and React, but V4 ends up Purple and Vue.
AI makes it cheap to implement complex first drafts and iterations.
I'm building a CRM system for my business; first time it took about 2 weeks to get a working prototype. V4 from scratch took about 5 hours.
They model what looks like intelligence but with very hard limits. The two advantages they have over human brains are perfect recall and data storage. They are also faster.
But the brain is vastly more intelligent:
- It can learn concepts (e.g. language) with an order of magnitude less information
- It responds in parallel to multiple formats of stimuli (e.g. sight/sound)
- LLMs lack the ability to generalise
- The brain interprets and understands what it experienced
That's just the tip of the iceberg. Don't get me wrong: I use AI, it is by far some of the most impressive tech we have built so far, and it has potential to advance society significantly.
But it is definitely, vastly, less intelligent than us.
They are vastly less intelligent than a human and logical leaps that make sense to you make no sense to Claude. It has no concept of aesthetics or of course any vision.
All that said; it got pretty close even with those impediments! (It got worse because the writer tried to force it to act more like a human would)
I think a better approach would be to write a tool to compare screenshots, identity misplaced items and output that as a text finding/failure state. claude will work much better because your dodging the bits that are too interpretive (that humans rock at and LLMs don't)
Which also suggests perhaps it is slightly more common than data suggests
If my children won't speak to each other I will refuse to be the go between because I become a proxy for one to the other. If one then punches the other they won't respect my perspective that this was wrong because I've set myself up as the proxy for the others feelings.
If you need a manger to resolve the above example, the org is broken and the engineers are poor engineers.
What I think is true is people cap out their technical competency, and look to shift their skillset and, globally, we are bad at a) training them to be good managers (because there is a wrong assumption it's an innate skill) and b) weeding out the many who also lack the ability to be a manager.