News for hackers. Stuff that matters.
Re:Google DeepMind by medler on Thursday April 20, 2023 @02:23PM (#35644078)
Is there anyone who has successfully productized AI? ChatGPT isn’t a profitable product, at least not yet. Google Photos and Spotify recommendations are the best AI products I can think of with clear revenue, and in these examples AI is just a cherry on top of a product people would use anyway.
Re:Google DeepMind by dougmwne on Thursday April 20, 2023 @02:36PM (#35644246)
Github Copilot seems like a pretty clear example. They charge a subscription that's in excess of the marginal cost of inference.
Re:Google DeepMind by medler on Thursday April 20, 2023 @03:09PM (#35644729)
That’s a good point. I forgot about Copilot.
Re:Google DeepMind by visarga on Friday April 21, 2023 @06:17AM (#35651794)
Midjourney, NaturalReaders (text to speech reader)
Re:Google DeepMind by andygeorge on Thursday April 20, 2023 @03:48PM (#35645299)
curious if/when MS will get desirable returns on the significant investment needed to run/train copilot
Re:Google DeepMind by dougmwne on Thursday April 20, 2023 @04:08PM (#35645575)
It's a good question, but also helpful to point out that one of the beauties of these models is that you can train them once and deploy to many use cases. The same model can be used by Github, Bing, Office 365, Azure and so on.

And as for the big multi-billion investment in OpenAI, they may have more than made that back up on their valuation already. Plus the deal was structured that OpenAI would pay it's revenues into Microsoft till the investment was paid back and MS would sill end up with a 49% stake.

All in all, sounds like a smart investment from MS and, cerry on top, managed to majorly embarrass a main rival.

Re:Google DeepMind by andygeorge on Thursday April 20, 2023 @04:14PM (#35645668)
agree on it being a good play by MS. will interesting to see if they do spin it out to their other realms
Re:Google DeepMind by zamnos on Thursday April 20, 2023 @07:22PM (#35647870)
The question there is how many of the estimated 100,000 software engineers at Microsoft are using Copilot, and what has been their (I'm sure measured) productivity boost. Microsoft does derive some benefit from Copilot being accessible to the paying subscribers of the world from having them give feedback and in free (and paid) press. But the internal use numbers probably easily justify its initial cost to train.

Say Copilot makes an engineer 2x as productive, their all-in salary is $500k to make the math easy, 1,000 MS sw engineers are using it, and Copilot took $5mm to train (GPT-3 took $4.6mm). Those 1k MS employees now being twice as productive are doing the work of an extra 1k people at $500k, or $500 million's worth in a year. That means $5 million in Copilot training costs are paid for in... 4 days. I have no inside information, so those number are all made up, but I'm pretty sure the initial training costs have already been paid off internally.

We also don't know how many multiples of $5mm it took to produce the initial version of Copilot, nor how many subsequent training runs there have been.

Point is, any significant productivity gains made, across an organization the size of Microsoft engineering, easily pays for big expensive training runs.

Re:Google DeepMind by ssijak on Friday April 21, 2023 @12:17AM (#35649767)
It makes tou nowhere nearly 2x productive. Usefull yes but 2x is a dream
Re:Google DeepMind by visarga on Friday April 21, 2023 @06:11AM (#35651745)
SOME parts of an engineer's work are 2x faster, but not all. Generating code - yes, writing tests and docs - yes, designing the system - no, debugging - no, attending meetings - no, getting your data faster, or moving the other team to finish integration sooner - no help. So it's going to be 10% boost overall, not 100%.

The nice effect is that the AI makes people more confident to try things and go out of their comfort zone. Maybe the quality of the end product will be higher.

Re:Google DeepMind by blackoil on Thursday April 20, 2023 @09:54PM (#35648949)
If the return are computed by increase in market cap, they may already have got that.
Re:Google DeepMind by andygeorge on Saturday April 22, 2023 @08:40PM (#35672252)
did you have a stroke?
Re:Google DeepMind by deanc on Thursday April 20, 2023 @04:03PM (#35645499)
I’d be astonished if they’re even close to breaking even on copilot. In its current incarnation it wouldn’t even lace the boots of what’s coming out of OpenAI.

CopilotX with its OpenAI collab will be the real winner - if it ever gets released to those on the waitlist. I’m not aware of anyone who got in yet, which leads me to believe it doesn’t yet exist.

Re:Google DeepMind by bugglebeetle on Thursday April 20, 2023 @06:59PM (#35647681)
I got access to the Copilot CLI, which is supposed to be part of the Copilot X package eventually. Dunno anyone who has gotten access to Copilot Chat yet, which I expect is what everyone really wants.
Re:Google DeepMind by Aeolun on Thursday April 20, 2023 @09:09PM (#35648658)
> In its current incarnation it wouldn’t even lace the boots of what’s coming out of OpenAI.

I don’t know about you, but Copilot is part of my daily work, while OpenAI ChatGPT is still more or less a toy to me.

Re:Google DeepMind by fastball on Thursday April 20, 2023 @09:38PM (#35648860)
* * *
Re:Google DeepMind by visarga on Friday April 21, 2023 @06:09AM (#35651729)
GPT4 is arguably much better at coding, hence the "paradigm shift".
Re:Google DeepMind by Kiro on Friday April 21, 2023 @02:24AM (#35650360)
Copilot is and has always been OpenAI so not sure what you're talking about.
Re:Google DeepMind by riffraff on Thursday April 20, 2023 @02:39PM (#35644302)
if you consider Spotify recommendations as AI then you should consider also Youtube and every social network based on a non-time based timeline and ads, no?
Re:Google DeepMind by gilbetron on Thursday April 20, 2023 @02:43PM (#35644358)
I've seen MidJourney's estimated revenue at about $750k/month. Not bad.
Re:Google DeepMind by yunwal on Thursday April 20, 2023 @03:16PM (#35644822)
This seems likely lower than their costs. Is there a breakdown somewhere?
Re:Google DeepMind by paxys on Thursday April 20, 2023 @02:51PM (#35644466)
OpenAI is growing revenues from ~0 in 2022 to $300M in 2023 to $1B in 2024. That sounds like a product to me.
Re:Google DeepMind by medler on Thursday April 20, 2023 @03:08PM (#35644720)
It is currently April 2023. “~0 in 2022” is the only part of that that seems credible. I not convinced of OpenAI’s rosy predictions of future explosive growth.
Re:Google DeepMind by brokencode on Thursday April 20, 2023 @06:47PM (#35647558)
The fact that Microsoft is baking GPT into all of their products guarantees explosive growth.

ChatGPT is also one of the fastest growing consumer products in history by number of users. At $20 a month for plus, it could be a significant revenue stream.

Then add all the companies like Duolingo and Snapchat that are using GPT as well.

If you don’t see this as explosive growth, then I don’t know what to tell you.

Re:Google DeepMind by mmmmpancakes on Thursday April 20, 2023 @09:44PM (#35648891)
> The fact that Microsoft is baking GPT into all of their products guarantees explosive growth.

Why?

Re:Google DeepMind by brokencode on Thursday April 20, 2023 @10:50PM (#35649266)
Because Microsoft is the largest software company in the world. Their products are in wide use by virtually all businesses and schools in the country. Judging by the popularity of ChatGPT, these features will be very popular and heavily used.
Re:Google DeepMind by tensor on Thursday April 20, 2023 @03:08PM (#35644717)
"Hopes to grow" revenues. Current estimates put hardware costs alone at $700/day, so even if they hit $300M in 2023 that won't make them profitable. This isn't even counting the people costs and other operation costs required to run a company.
Re:Google DeepMind by generalizations on Thursday April 20, 2023 @03:36PM (#35645118)
And yet, $300M is only 1.25M subscribers at the current $20/mo rate. If we say that they need a $1B / year to be comfortably profitable, that's ~4.2M subscribers. A good rule of thumb is that you can hope to convert about 10% of your free user base to paid; one random source says they have 100M monthly active users - which at 10% conversion, is $2.4B / year. I think they'll be fine.
Re:Google DeepMind by illiarian on Thursday April 20, 2023 @05:34PM (#35646681)
How much money will they spend servicing requests for those 4.2M subscribers?
Re:Google DeepMind by ZephyrBlu on Thursday April 20, 2023 @06:21PM (#35647317)
10% is insanely high conversion for B2C freemium. It’s closer to 1% for most products.
Re:Google DeepMind by anonylizard on Thursday April 20, 2023 @08:13PM (#35648264)
Does GPT-4 look like 'most products'?

You are talking about a revolutionary product that literally dominates mindshare from consumers to students to CEOs to governments. Its a pure monopoly that has insanely wide utility and instantly obvious value proposition.

Re:Google DeepMind by ZephyrBlu on Thursday April 20, 2023 @08:21PM (#35648319)
Do you know anything about B2C freemium products? 10% conversion over 10s-100s of millions of users is literally insane.

It doesn't matter how revolutionary GPT-4 is, people's willingness to pay for anything is generally very low. ChatGPT premium is also a very expensive subscription for a consumer product!

Re:Google DeepMind by anonylizard on Friday April 21, 2023 @12:09AM (#35649740)
People are willing to pay $10k a year for college, very high conversion rate. People are willing to pay for tutoring, at rate that's probably about 10% of student base, despite its very high costs ($50/h, not $20/m)

At the very minimum, I can already see every university and high school student paying for GPT-4. Its a way way way more powerful essay writer and personal tutor than GPT3.5, that alone is incentive to upgrade. For only $20 a month.

Know what GPT-4 currently is insanely capacity limited. So far, the limitation is not on the demand side, but the supply side.

Getting 100 million users in 3 months with 0 marketing or network effects already annihilates existing records, getting 10% conversion is nothing special.

Re:Google DeepMind by iudqnolq on Friday April 21, 2023 @12:18AM (#35649771)
The cheating sites I see on the first page of Google seem to charge around $10-$30/page. GPT is cheaper, but lower quality. I don't think the market for tens of dollars cheaper but shittier quality than buyessayfriend.com is anywhere near every highschool and college student.
Re:Google DeepMind by ZephyrBlu on Friday April 21, 2023 @06:42AM (#35651930)
You could have saved yourself and everyone else the time by instead writing “I have no idea what I’m talking about and I don’t understand constraints”.

https://twitter.com/visakanv/status/1113154447050334208

Re:Google DeepMind by mda on Sunday April 23, 2023 @09:53AM (#35676246)
Look what happened to image generators, no one talks about Dall-e or whatever that was.
Re:Google DeepMind by vasco on Thursday April 20, 2023 @03:36PM (#35645117)
Do you have the order of magnitude right at $700/day? That's not much at all.
Re:Google DeepMind by okdood64 on Thursday April 20, 2023 @05:19PM (#35646505)
It's not 2024 yet, and 2023 just started.
Re:Google DeepMind by illiarian on Thursday April 20, 2023 @05:34PM (#35646671)
Revenues mean nothing if your expenses outpace them. What's the net profit?
Re:Google DeepMind by Takennickname on Thursday April 20, 2023 @03:29PM (#35645017)
GPT API is a successful product. All those start ups that are just a thin layer over GPT that are funded by YCombinator are paying for API use and that's profitable for OpenAI.
Re:Google DeepMind by nomel on Thursday April 20, 2023 @04:36PM (#35645921)
> and that's profitable for OpenAI.

Reference?

"Profitable" means they're making more money than they're using, at this moment.

Re:Google DeepMind by Takennickname on Thursday April 20, 2023 @05:48PM (#35646826)
Are you implying openai is selling access to their API at a loss?
Re:Google DeepMind by nomel on Thursday April 20, 2023 @06:14PM (#35647217)
No, I would like facts, not assumptions. It's definitely not safe to assume they are making a profit, as a whole, or per transaction. It's more complicated than that.

Profit has a strict definition of $revenue - $cost, for a business operation as a whole, which leaves money in the bank at the end of the month.

They could be making more money for a single query than the cost of compute time for that single query, but that may not cover the engineering and idle servers. They could be running at a loss with the assumption that they can improve efficiency per transaction soon. They could be running at a "loss" because they're giving some of the compute away for free right now, to improve the training with the user responses. Or maybe they are making fistfuls of money. "Profitable" has a strict meaning, shouldn't be assumed, and definitely isn't required, at this point in their operation.

I'm very interested to know if they are profitable, at the moment, but I don't think that's been publicly disclosed yet, and I can't find anything. A reference is required.

Re:Google DeepMind by Takennickname on Friday April 21, 2023 @04:20AM (#35651067)
I don't have a reference. I'm taking the very reasonable assumption that openai is making money on API calls based on how much they charge compared to others in this space, the favorable pricing they receive from Microsoft, their ability to constantly bring down the costs and push the savings to their consumers, their unwillingness to lower the cost of Dall-E even though it's more expensive than it's competitors.

Very reasonable assumptions. You will never get certainty, even if they say they're profitable maybe they're just lying for investors. If you see their bank account total go up every month maybe it's a ponzi scheme.

For my heuristics, if not profitable, at least close, and definitely a major success in acquiring market share and customer mind share.

Re:Google DeepMind by jabradoodle on Friday April 21, 2023 @05:23AM (#35651441)
So, because Fraud is possible, unfounded speculation is the best we have?
Re:Google DeepMind by Takennickname on Friday April 21, 2023 @07:33AM (#35652276)
I've given plenty of evidence as to why it's a reasonable assumption. But doesn't seem like you have much access to nuance in your thinking.
Re:Google DeepMind by jabradoodle on Friday April 21, 2023 @07:58AM (#35652447)
There is a world in between, we cannot be sure of anything because of Fraud, and here is some rough guess work.

If you want to claim the latter as evidence then fair enough, I would call it speculation.

In either case there is no need to resort to petty insults.

Re:Google DeepMind by Takennickname on Friday April 21, 2023 @08:21AM (#35652638)
It was not a petty insult. The options you gave are "fraud" or "unfounded speculation." Literally lacks any kind of nuance. What sort of nuance would you say you contributed?
Re:Google DeepMind by nomel on Friday April 21, 2023 @12:47PM (#35656469)
I think it would be better to make it clear that something is an assumption rather than stating it as fact, to not add to the noise. In the world of tech (and any R&D heavy group), initially running at a loss is the norm, not the exception.
Re:Google DeepMind by zamnos on Thursday April 20, 2023 @07:28PM (#35647927)
How do you want to define AI? Google's been using ML models to power various Google products for years. Translate was a big switch over, back in 2016, and it powers the Google Search answer box. I have no idea how profitable that answer box is, but I'm fairly certain that Google Search is profitable. The Google Home speaker voice recognition is also powered by ML models.
Re:Google DeepMind by nr2x on Thursday April 20, 2023 @07:30PM (#35647950)
Assistant however never made money.
Re:Google DeepMind by nr2x on Thursday April 20, 2023 @07:30PM (#35647946)
I use GPT about 100x more than search now for my day to day work. I pay them $20/mo. I’d likely pay $100 or more for the value I’m getting.

They’ll figure it out.

Re:Google DeepMind by kenjackson on Friday April 21, 2023 @12:55AM (#35649942)
TikTok uses a bunch of AI. From their algorithm for the FYP. To vision for classification of videos. And sound processing to bucket sounds/music. This feeds into their rec engine as well as their safety engine.