For posterity since the term has been misused lately, having a very good product isn't a moat in the business sense. There's nothing stopping a competitor from creating a similar product (even if it's difficult), and there's nothing currently stopping OpenAI's users from switching from using Sora to a sufficient competitor if it exists.
Sora is more akin to a company like Apple/Google a decade ago using their vast resources to do what a third-party does, but better (e.g. the Sherlocked incident: https://www.howtogeek.com/297651/what-does-it-mean-when-a-co...).
It definitely is. Having the best product and being able to maintain that best-in-class product status over time through a firm's 'internal capabilities' is very much a moat and a strong one at that. A moat is the business strategy sense is anything that enables a firm to maintain competitive advantage. Having the best product in a category, and being able to maintain that over releases is a strong competitive advantage (especially when there is high willingness to pay or price is a strong competitive dimension compared to the value created).
I think OpenAI's big moats are in userbase feedback and just proprietary trade knowledge after they stopped sharing model details. They may have made some exclusive data source deals with book/textbook and other publishers, though it isn't clear a license is actually needed for that until things work through the courts.
The original "We Have No Moat, And Neither Does OpenAI" leaked memo from Google that memefied the term focuses explicitly on the increasing ease of competitors (especially open-source) entering the ecosystem: https://www.semianalysis.com/p/google-we-have-no-moat-and-ne...
Second: Massive capital expenditure, specifically in this case the huge cost of building or leasing enormous GPU clusters, is *exactly* what he means by this.
He didn't seem to have specific definition at all really.
I think most people attribute it to a "secret sauce technology" in the case of OpenAI, I'm not sure if "finances to lease a huge cluster of GPUs" makes sense here because the main competitors (Google, AWS, Apple, etc) also have access to insane compute as well yet have struggled to get close to GPT4's performance in practice.
That said I do agree that it's a moat for the startups like stability/mistral, etc. They also have access to $/compute, albiet a lot less. And you can see this in their research, as they've been focused on methods to lower the training/inference costs.
So at least in the battle between OpenAI and Google, their moat right now are their models.
If it was as simple as dropping 10's millions on compute they could do that, yet google's bard/gemini have been a year behind GPT4's performance.
That said I do agree that it's a moat for the startups like stability/mistral, etc. They also have access to $/compute, albiet a lot less. And you can see this in their research, as they've been focused on methods to lower the training/inference costs.
*I'm measuring performance by the chatbot arena's elo system and r/locallama
e.g. If ChatGPT being popular gives OpenAI enough extra training data, they're locked in forever having the best model, and it is impossible for anyone - even with unlimited money, and the same technology - to beat them. Because they don't have that critical data.
Yes, Google had the best search product, and got a huge market share simply by being better. Their moat however is that their search rankings are based off the click data of which search results people use and cause them to stop their search because they've found a solution.
They also have a moat to do with advertising pricing, based on volume of advertising customers.
Bing spend a lot of capital, and had the tech ability, but those two moats blocked them gaining more than a tiny market share.
In this case, maybe OpenAI will have a video business moat, maybe they don't...
Facebook has Moat because of their social network. It is very hard to switch to another network. Google with search has no moat because it is easy to switch to a new search engine. OpenAI has no moat because it is easy to switch to a new AI chat once a better product becomes available. AWS has moat because it is hard to switch cloud providers. Apple has moat because people want to buy apple products. etc.
A moat can be seen where even if you have a worse product than the competition, or users hate you, they still use your products because the cost to switch is immense.
This is like saying there’s nothing stopping a competitor from launching reusable rockets into space. Of course there isn’t, but it’s hard and won’t happen for the foreseeable future.
Similarly with a physical moat, it’s not impossible to cross, but it’s hard to do.
There is nothing stoping Microsoft from creating a search engine as good as Google’s.
There is nothing stopping Facebook from creating an iPhone alternative, after all it’s just engineering!
There is nothing stopping Google from beating GPT-4.
Shall I go on?
The point is that "moat" gets conflated with just being ahead in the game. I don't find it a super interesting point of contention, but there is a distinction alright.
I bet we won't get AGI as a progression of this very technology. The impression of "usefulness" will end when "AI" is starting to drink its own Koolaid on a large scale (copilot lol), and when everyone starts using it as super inefficient business interface. Overfitted mediocre mediocrity, on steroids.
Hopefully, this sobriety happens before the economy collapses, as a consequence of all dem bullshit jobs cleansed.
New technologies change the economics of how we satisfy our needs.
When search engines became good, many pundits confidently predicted Google would never replace librarians or libraries. It didn't. It shifted our relationship to knowledge; instead of having to employ an expert in looking things up, we all had to become experts at sifting through a flood of info.
When the cost of producing art-directed and realistic video goes to zero it's hard to predict what's going to happen. Obviously the era of video = veracity is now over. And you can get the equivalent of Martin Scorsese and a million dollar budget to do the video instructions for a hair dryer. Instead of hunting for a gif to express how you feel, captured from an existing TV show or something, you could create a scene on the fly and attach it to a text message. Or maybe you dispense with text messages altogether. Maybe text is only for talking to computers now.
My personal prediction is that the value of a degree in art history is going to go way, way up, because they'll be the best prompt engineers. And just like desktop publishing spawned legions of amateur typesetters, it will create lots of lore among amateur video creators.
I haven't seen a lot of use cases outside of productions and businesses, which shouldn't exist in the first place (at least to this extent).
Some of our "needs" are flawed, since "content" speaks to evolutionary relicts developed in times of scarcity and life in small groups. In the unbounded production of "AI", there is no way to keep up the sense of newness of input indefinitely. I am already fatigued by "AI" """art""". It has no real relevancy. You can't trust any of it.
Every medium where "AI" content becomes prevalent, will lose it's appeal. E.g. if I get the impression a significant proportion of comments here were "AI" generated, I will leave HN. Thing is, all these open platforms can't prevent "AI" spam. So they will die. Look at the frontpage of Reddit... it's almost all reposts, by karma farming bots. Youtube "AI" spam already drowning real content. This is what's going to happen to everything. User content will die. "Content" will die. The web will die. You won't even try, because of "AI" generated fatigue.
> My personal prediction is that the value of a degree in art history is going to go way, way up, because they'll be the best prompt engineers.
Lol. Yeah, "best prompt engineer" in the infinitely abundant production economy...
You people really need to iterate the world you are imagining a few times more and maybe think about some fundamentals a bit.
If I am wrong, life will be hell.
“I’m bored of it, everyone must felt the same way as me.”
Ok
People are more concerned about being stimulated than they are about verisimilitude.
The play with AI isn't to build the tools to help businesses make money, the play is to directly build the businesses that makes the money.
In practice this means, don't focus your business model on building the AI to make text to video happen. Your business model should be an AI studio, if the tech you need doesn't exist, build it.... but if you get beat by someone with more GPU's and more data, cool use the better models. Your business model should focus on using the capability not building it. It's proving quite hard to beat someone with more GPU's, more data, more brain power.
7T is actually possible, but yes it's huge.
IMO HN should have an edit indicator, at least after others have already replied.
If (the best) AI adds 10% to that, $7T is not only possible but a bargain.
Watt couldn't have asked, his engines specifically weren't enough of a difference by themselves even though the revolution as a whole was, and I strongly suspect this is also going to be true for any single AI developer; however a $7T investment in many unrelated chip factories owned by different people and invested over a decade, is something I can believe happening.
https://en.wikipedia.org/wiki/List_of_countries_by_GDP_(nomi...
It's only 2x the AAPL market cap.
However, the OP was incorrect, it's 2x the AAPL market cap.
I think immersive games will also be a big application. Games AI will also benefit from being more strategically intelligent and from being able to negotiate, in a human-like fashion, with human and other AI players. The latter will not only make games better, it will also improve the intelligence of AIs.
The thing that "The Matrix" style plots get wrong is that the machines don't need to coerce us into their virtual prisons, we will submit willingly.
This is the stuff of Brave New World. It's happening to us in real time.
I think rather than replace real human contact, the internet has created an increased demand for it. People need every moment of their lives to be filled with human speech or images.
If I were to take off my "reasonable point" hat and put on my "grandiose bullshit" hat I'd say that in the same way drugs can artificially stimulate various "feel good" parts of your brain, we have found a way to artificially stimulate the "social animal" instinct until we're numb.
I think the real risk of this kind of AI is not that people live in a world of fake videos of their favorite celebrities talking to them, but that entire fake social media ecosystems are created for each individual filled with the content they want to see and fake people commenting on it so they can argue with them about it.
Everybody needs to read The Three Stigmata of Palmer Eldritch by Philip K Dick.
Most podcasters are narcissists
I would be extremely surprised if he could get past the market cap of all current corporations as an investment. That doesn't mean "no, never"[0], but I would be extremely surprised.
$7T in one go would be 6.7% of global GDP, and is approximately the combined GDP of Japan and Canada.
> These videos are crazy. Highly suggest anybody who was playing with Dall-E a couple of years ago, and being mindblown by "an astronaut riding a horse in space" or whatever go back and look at the images they were creating then, and compare that to this.
Indeed, though I will moderate that by analogy: it's been just over 30 years since DOOM was released, and that was followed by a large number of breathless announcements about how each game had "amazing photorealistic graphics that beat everything else" while forgetting that the same people had said the same things about all the other games released since DOOM.
Don't get me wrong: these clips are amazing. They may not be perfect, but it took me a few loops to notice the errors.
I'm sure there are people with better eyes for details than me, who will spot more errors, spot them sooner, and keep noticing them long after GenAI seems perfect to me.
But I also expect that, just as 3D games' journalism spent a long time convinced the products were perfect when they weren't, so too will GenAI journalism spend a long time convinced the products are perfect before they actually are.
[0] a sufficiently capable AI is an economic power in its own right. I previously guessed, and even with it's flaws would continue to guess, that the initial ChatGPT model was about as economically valuable to each user as an industrial placement student, and when I was one of those I was earning £1k/month (about £1.7k/month when adjusted for inflation).
Aside from visual plausibility, there's also the issue of physics: one of the things you would like to use video models for is understanding real-world physics and cause-and-effect for planning or learning _in silico_. Something may look good but get key physics wrong and be useless for, say, robotics.
There is a lot that has to planned and put in place now to get there.
As for people that have opted out of life. We would have a better world if we started encouraging more dreamers/doers like out of the movie Tomorrowland.
on another note I find it funny they released this right after Google announced their new model. Bad luck for Google or did OpenAI just decide to move up their announcement date to steal their thunder?
If you were presented with the fact that whatever your life is is just an illusion, and you are actually a starving slave in North Korea, you would choose to "wake up"?
(I mean, a lot of people do do that!)
I'm not sure there are downsides to living out your life in a simulation while robots take care of your physical form.
There are already sex toys that you.. insert yourself in, and then have scripts that sync up movements with VR videos you are watching.
Crazy times coming in the next few decades.
Improving your ability to connect with and enjoy/learn from people all around the world is one of the main value props of the internet, and tech like this just deepens that potential. Will some people take this to an unhealthy degree that pulls them too far out of reality? Yes. But others will use it to level up their abilities, enrich their lives, create beautiful things, and reduce loneliness.
That said, those people are by definition less relevant to internet consumption metrics
But VFX isn't that big of a market by itself: Global visual effects (VFX) market size was US$ 10.0 Billion in 2023
All of these things are against the terms of service and attempting them may result in a ban.
This is close to what BlackRock is managing!
It's not necessarily too big for a valuation, as a sufficiently capable AI is an economic power in its own right: I previously guessed, and even despite its flaws would continue to guess within the domain of software development at least, that the initial ChatGPT model was about as economically valuable to each user as an industrial placement student, and when I was one of those I was earning about £1.7k/month when adjusted for inflation, US$2.1k at current nominal exchange rates. 100 million users at that rate is $2.52e+12/year in economic productivity, and that's with the current chip supply and (my estimate of) the productivity of a year-old model — and everyone knows that this sector is limited by the chips, and that $7T investment story is supposed to be about improving the supply of those chips.
On the other hand, I think these moats will be destroyed as soon as anyone finds a drastically more efficient (compute- and data-wise) way to train LLMs. Biology would suggest that it doesn't take $100 million worth of GPUs and exaflops of compute to achieve the intelligence of a human.
(Of course it is possible that at that point, OpenAI may then be able to achieve something far superior to human intelligence, but there is a LOT of $$$ out there that only needs human levels of intelligence.)
Biology suggests that a self-replicating machine can exist by ingesting other machines, turning them into energy and then using that energy to power themselves. Biology suggests that these machines can be so small that we cannot even see them.
How close are we to making one of those?
Since we have a much, much better industrial process for manufacturing electronic components, why attempt to make a biological AI if there's no current reason to believe that it being biological is somehow necessary or even beneficial?
Hopefully, the line between the real world and virtual world gets stronger once again.
Sam is probably going to get his $7T if he keeps this up, and when he does everybody else will be locked out forever.
I already know people who have basically opted out of life. They're addicted to porn, addicted to podcasts where it's just dudes chatting as if they're all hanging out together, and addicted to instagram influencers.
100% they would pay a lot of money to be able to hang out with Joe Rogan, or some only fans person, and those pornstars or podcasts hosts will never disagree with them, never get mad at them, never get bored of them, never thing they're a loser, etc.
These videos are crazy. Highly suggest anybody who was playing with Dall-E a couple of years ago, and being mindblown by "an astronaut riding a horse in space" or whatever go back and look at the images they were creating then, and compare that to this.