News for hackers. Stuff that matters.
Re:Behind the curtain: what it feels like to work in AI righ... by nicpottier on Thursday April 06, 2023 @04:47PM (#35474176)
Until we see otherwise, don't we have to assume there's some secret sauce? Bard doesn't match GPT4 and it isn't for a lack of trying. (though perhaps that will change, so far that's the case)
Re:Behind the curtain: what it feels like to work in AI righ... by xnx on Thursday April 06, 2023 @04:51PM (#35474233)
Google is going slow. They might be behind, but we haven't seen their best effort yet. Google has a 540 billion parameter model.
Re:Behind the curtain: what it feels like to work in AI righ... by nicpottier on Thursday April 06, 2023 @05:01PM (#35474377)
So they say, and I agree this seems likely. But until they release it that's all talk, and they have plenty of incentive to release it.
Re:Behind the curtain: what it feels like to work in AI righ... by nr2x on Thursday April 06, 2023 @11:15PM (#35477612)
And plenty of reason not to: search ads.
Re:Behind the curtain: what it feels like to work in AI righ... by nr2x on Thursday April 06, 2023 @11:14PM (#35477608)
Google also has Sundar and Ruth who’d rather focus on how to get another ad on the SERP than kill the golden goose. They’re not going slow, they just don’t have the leadership for the moment.
Re:Behind the curtain: what it feels like to work in AI righ... by mewpmewp2 on Thursday April 06, 2023 @05:07PM (#35474457)
Maybe it is just time to train and also good training data for prompts which openai has gathered for so long already? E.g. there is a bottleneck on how fast you can train and also gather good data.
Re:Behind the curtain: what it feels like to work in AI righ... by UncleOxidant on Thursday April 06, 2023 @05:12PM (#35474537)
Possibly, but wouldn't Google and Meta have access to way more compute resources and data than OpenAI? Google has been touting their TPUs for several years now.
Re:Behind the curtain: what it feels like to work in AI righ... by Robotbeat on Thursday April 06, 2023 @10:29PM (#35477297)
OpenAI has access to Microsoft and Azure. That’s bigger than Meta, roughly on par with Google in terms of capability and higher in terms of market cap.
Re:Behind the curtain: what it feels like to work in AI righ... by chillfox on Thursday April 06, 2023 @10:50PM (#35477426)
Google has the compute, from the comparisons I have seen Bard smokes GPT-3.5-Turbo on response times. So my guess is that internal politics prevents them from putting out something better. There would have to be immense pressure from the search division to not make them obsolete.
Re:Behind the curtain: what it feels like to work in AI righ... by int_19h on Friday April 07, 2023 @04:32PM (#35486601)
Bard is also a fair bit worse than GPT-3.5, though, so that can be a function of model size.
Re:Behind the curtain: what it feels like to work in AI righ... by nr2x on Thursday April 06, 2023 @11:17PM (#35477625)
Without Nadella footing the compute bills, nobody would be taking about OpenAI. He’s brilliant, he let the start up take on huge risk to quietly claim the gains for m$.
Re:Behind the curtain: what it feels like to work in AI righ... by saynay on Thursday April 06, 2023 @04:58PM (#35474329)
Bard would not trick anyone into thinking it was sentient, yet something they have supposedly did. I just think Google has far more to lose than Bing, so they are being more cautious.
Re:Behind the curtain: what it feels like to work in AI righ... by dragonwriter on Thursday April 06, 2023 @05:06PM (#35474446)
> Bard would not trick anyone into thinking it was sentient, yet something they have supposedly did

Bard is overtly a reduced-resources model compared to the best version of the same technology (which, if true, is probably a boneheadedly bad choice for a public demo when everyone is already wowed by the people who got theirs out first, but easily explains that disparity. Though so does “guy who wanted public attention made stuff up well-calibrated to that goal.”)

Re:Behind the curtain: what it feels like to work in AI righ... by Animats on Thursday April 06, 2023 @09:12PM (#35476823)
> Bard is overtly a reduced-resources model compared to the best version of the same technology

There's a scaling problem. ChatGPT/LLM systems cost far more to run per query than the Google search engine. Google can't afford to make those the first line query reply.

A big business model question is whether Google will insist you be logged in to get to the large language model.

At Google scale, these things are going to have to be a hierarchy. Not everything needs to go to a full LLM system. Most Google queries by volume can be answered from a a cache.

Re:Behind the curtain: what it feels like to work in AI righ... by jacquesm on Friday April 07, 2023 @02:47AM (#35478853)
> Most Google queries by volume can be answered from a a cache.

And given how aggressively they limit the number of search results (in spite of listing some ridiculous number of results on page #1) that percentage may well be very large.