Gemini: Google's most capable AI model yet

Re:Gemini: Google's most capable AI model yet by Jensson on Wednesday December 06, 2023 @04:39PM (#38549878)

How do you know GPT-4 is 1 shot? The details about it aren't released, it is entirely possible it does stuff in multiple stages. Why wouldn't OpenAI use their most powerful version to get better stats, especially when they don't say how they got it?

Google being more open here about what they do is in their favor.

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by jiggawatts on Wednesday December 06, 2023 @05:41PM (#38550496)

There's a rumour that GPT-4 runs every query either 8x or 16x in parallel, and then picks the "best" answer using an additional AI that is trained for that purpose.

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by mewpmewp2 on Wednesday December 06, 2023 @06:15PM (#38550789)

It would have to pick each token then, no? Because you can get a streaming response, which would completely invalidate the idea of the answer being picked after.

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by refulgentis on Wednesday December 06, 2023 @07:24PM (#38551314)

It's false, it's the 9 months-down-the-line telephone game of a unsourced rumor re: mixture of experts model. Drives me absolutely crazy.

Extended musings on it, please ignore unless curious about evolution patterns of memes:

Funnily enough, it's gotten _easier_ to talk about over time -- i.e. on day 1 you can't criticize it because it's "just a rumor, how do you know?" -- on day 100 it's even worse because that effect hasn't subsided much, and it spread like wildfire.

On day 270, the same thing that gave it genetic fitness, the alluring simplicity of "ah yes, there's 8x going on", has become the core and only feature of the Nth round of the telephone game. There's no more big expert-sounding words around it that make it seem plausible.

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by theendisney2 on Wednesday December 06, 2023 @09:06PM (#38551957)

It thinks about your question forever...

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by jacquesm on Wednesday December 06, 2023 @10:16PM (#38552430)

That genetic fitness is exactly why those stupid conspiracy theories refuse to die out: they've adapted to their hosts.

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by FuckButtons on Thursday December 07, 2023 @12:40AM (#38553234)

As with most zombie theories, it exists because there is a vacuum of evidence to the contrary, not because it’s true.

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by verdverm on Wednesday December 06, 2023 @07:46PM (#38551490)

I recall reading something about it being a MoE (mixture of experts) which would align with what you are saying

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by theGnuMe on Wednesday December 06, 2023 @10:06PM (#38552348)

So beam search?

[ Parent | on HN ]

Re:Gemini: Google's most capable AI model yet by refulgentis on Friday December 08, 2023 @07:47AM (#38568371)

Same way I know the latest BMW isn't running on a lil nuke reactor. I don't, technically. But there's not enough comment room for me to write out the 1000 things that clearly indicate it. It's a "not even wrong" question on your part

[ Parent | on HN ]