News for hackers. Stuff that matters.
Re:Gemini 2.0: our new AI model for the agentic era by bradhilton on Wednesday December 11, 2024 @10:51AM (#42388966)
Beats Gemini 1.5 Pro at all but two of the listed benchmarks. Google DeepMind is starting to get their bearings in the LLM era. These are the minds behind AlphaGo/Zero/Fold. They control their own hardware destiny with TPUs. Bullish.
Re:Gemini 2.0: our new AI model for the agentic era by p1esk on Wednesday December 11, 2024 @10:58AM (#42389060)
Are these benchmarks still meaningful?
Re:Gemini 2.0: our new AI model for the agentic era by maeil on Wednesday December 11, 2024 @11:53AM (#42389783)
No, and they haven't been for at least half a year. Utterly optimized for by the providers. Nowadays if a model would be SotA for general use but not #1 on any of these benchmarks, I doubt they'd even release it.
Re:Gemini 2.0: our new AI model for the agentic era by CamperBob2 on Wednesday December 11, 2024 @03:14PM (#42392375)
I've started keeping an eye out for original brainteasers, just for that reason. GCHQ's Christmas puzzle just came out [1], and o1-pro got 6 out of 7 of them right. It took about 20 minutes in total.

I wasn't going to bother trying those because I was pretty sure it wouldn't get any of them, but decided to give it an easy one (#4) and was impressed at the CoT.

Meanwhile, Google's newest 2.0 Flash model went 0 for 7.

1: https://metro.co.uk/2024/12/11/gchq-christmas-puzzle-2024-re...

Re:Gemini 2.0: our new AI model for the agentic era by nrvn on Wednesday December 11, 2024 @04:19PM (#42393095)
Did it get the 8 right? The linked article provides the wrong answer btw.
Re:Gemini 2.0: our new AI model for the agentic era by CamperBob2 on Wednesday December 11, 2024 @07:01PM (#42394543)
I didn't see a straightforward way to submit the final problem, because I used different contexts for each of the 7 subproblems.

Given the right prompt, though, I'm sure it could handle the 'find the corresponding letter from the landmarks to form an anagram' part. That's easier than most of the other problems.

You're saying the ultimate answer isn't 'PROTECTING THE UNITED KINGDOM'?

Re:Gemini 2.0: our new AI model for the agentic era by nrvn on Thursday December 12, 2024 @05:59AM (#42398150)
if you follow the sleigh morse path starting from the robin it will be 'united in protecting the kingdom'.
Re:Gemini 2.0: our new AI model for the agentic era by p1esk on Wednesday December 11, 2024 @04:41PM (#42393292)
Wow! That’s all I need to know about Google’s model.
Re:Gemini 2.0: our new AI model for the agentic era by Workaccount2 on Wednesday December 11, 2024 @05:43PM (#42393879)
What is impressive about this new model is that it is the lightweight version (flash).

There will probably be a 2.0 pro (which will be 4o/sonnet class) and maybe an ultra (o1(?)/Opus).

Re:Gemini 2.0: our new AI model for the agentic era by danpalmer on Wednesday December 11, 2024 @05:09PM (#42393570)
That's a comparison of multiple GPT-4 models working together... against a single GPT-4 mini style model.
Re:Gemini 2.0: our new AI model for the agentic era by p1esk on Thursday December 12, 2024 @12:21AM (#42396458)
multiple GPT-4 models working together

What do you mean? Is o1 not a single model?

Re:Gemini 2.0: our new AI model for the agentic era by iamdelirium on Wednesday December 11, 2024 @04:42PM (#42393301)
Why are you comparing flash vs o1-pro, wouldn't a more fair comparison be flash vs mini?
Re:Gemini 2.0: our new AI model for the agentic era by iamdelirium on Wednesday December 11, 2024 @04:49PM (#42393368)
I just ask o1-mini the first two questions and it got it wrong.
Re:Gemini 2.0: our new AI model for the agentic era by CamperBob2 on Wednesday December 11, 2024 @06:57PM (#42394511)
It's the only Google model that my account has access to that accepts .PNG files. I assumed it was the latest/greatest experimental 2.0 release.

If they want a rematch, they'll need to bring their 'A' game next time, because o1-pro is crazy good.

Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @10:58AM (#42389062)
Regarding TPU’s, sure for the stuff that’s running on the cloud.

However their on device TPUs lag behind the competition and Google still seem to struggle to move significant parts of Gemini to run on device as a result.

Of course, Gemini is provided as a subscription service as well so perhaps they’re not incentivized to move things locally.

I am curious if they’ll introduce something like Apple’s private cloud compute.

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Wednesday December 11, 2024 @11:03AM (#42389131)
i don’t think they need to win the on device market.

we need to separate inference and training - the real winners are those who have the training compute. you can always have other companies help with inference

Re:Gemini 2.0: our new AI model for the agentic era by vineyardmike on Wednesday December 11, 2024 @12:09PM (#42390029)
I don’t think the AI market will ever really be a healthy one until inference vastly outnumbers training. What does it say about AI if training is done more than inference?

I agree that the in-device inference market is not important yet.

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Wednesday December 11, 2024 @12:28PM (#42390273)
done more != where the value is at

inference hardware is a commodity in a way that training is not

Re:Gemini 2.0: our new AI model for the agentic era by maeil on Wednesday December 11, 2024 @11:51AM (#42389754)
> i don’t think they need to win the on device market.

The second Apple comes out with strong on-device AI - and it very much looks like they will - Google will have to respond on Android. They can't just sit and pray that e.g. Samsung makes a competitive chip for this purpose.

Re:Gemini 2.0: our new AI model for the agentic era by petra on Wednesday December 11, 2024 @12:31PM (#42390314)
But given inference time compute, to give a strong reply reasonably fast, you'll need a lot of compute, very rarely used.

Economically this fits the cloud much better.

Re:Gemini 2.0: our new AI model for the agentic era by reportingsjr on Wednesday December 11, 2024 @02:13PM (#42391553)
The Android on chip AI is and has been leagues better than what is available on iOS.

If anything, I think the upcoming iOS AI update will bring them to a similar level as android/google.

Re:Gemini 2.0: our new AI model for the agentic era by SimianSci on Wednesday December 11, 2024 @02:44PM (#42391951)
I think Apple is uniquely disadvantaged in the AI race to a point people dont realize. They have less training data to use, having famously been focused on privacy for its users and thus having no particular advantage in this space due to not having customer data to train on. They have little to no cloud business, and while they operate a couple of services for their users, they do not have the infrastructure scale to compete with hyperscaler cloud vendors such as Google and Microsoft. Most of what they would need to spend on training new models would require that they hand over lots of money to the very companies that already have their own models, supercharging their competition.

While there is a chance that Apple might come out with a very sophisticate on-device model. The problem here is that they would only be able to compete with other on-device models. The magnitude of compute needed to keep pace with SOA models is not achievable on a single device. It will take many generations of Apple silicon in order to compete with the compute of existing datacenters.

Google also already has competitive silicon in this space with the Tensor series processors, which are being fabbed at Samsung plants today. There is no sitting and praying necessary on their part as they already compete.

Apple is a very distant competitor in the space of AI, and I see no reason to assume this will change, they are uniquely disadvantaged by several of the choices they made on their way to mobile supremacy. The only thing they currently have going for them is the development of their own ARM silicon which may give them the ability to compete with Google's TPU chips, but there is far more needed to be competitive here than the ability to avoid the Nvidia tax.

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Wednesday December 11, 2024 @03:08PM (#42392284)
yeah i’ve never understood the outsized optimism for apple’s ai strategy, especially on hn.

they’re a little bit less of a nobody than they used to be, but they’re basically a nobody when it comes to frontier research/scaling. and the best model matters way more than on-device which can always just be distilled later and find some random startup/chipco to do inference

Re:Gemini 2.0: our new AI model for the agentic era by msabalau on Wednesday December 11, 2024 @03:59PM (#42392905)
Theory: Apple's lifestyle branding is quite important to the identity of many in the community here. I mean, look at the buy-in at launch for Apple Vision Pro by so many people on HN--it made actual Apple communities and publications look like jaded skeptics.
Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @10:23PM (#42395905)
Oh please, this is the classic “everyone who chooses differently than myself is <superficial/dumb/misinformed>” argument that a lot of people use when it comes to tech nerd identity politics.

Is it really that hard to imagine people have different viewpoints, and decisions than yourself without being painted as vapid, airheads?

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Thursday December 12, 2024 @11:55AM (#42400860)
I work in this industry, been working professionally on transformers since 2018.

The level of optimism for Apple AI capabilities on here is wrong. I can imagine people having wrong viewpoints, but it is wrong.

Re:Gemini 2.0: our new AI model for the agentic era by simonw on Wednesday December 11, 2024 @05:00PM (#42393474)
"having famously been focused on privacy for its users and thus having no particular advantage in this space due to not having customer data to train on"

That may not be as big a disadvantage as you think.

Anthropic claim that they did not use any data from their users when they trained Claude 3.5 Sonnet.

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Wednesday December 11, 2024 @05:49PM (#42393923)
sure but they certainly acquired data from mass scraping (including of data produced by their users) and/or data brokering aka paying someone to do the same.
Re:Gemini 2.0: our new AI model for the agentic era by mark_l_watson on Wednesday December 11, 2024 @08:30PM (#42395181)
It is likely Apple can get additional data by creating synthetic data for user interactions.

About 7 years ago I trained GAN models to generate synthetic data, and it worked so well. The state of the art has increased a lot in 7 years, so Apple will be fine.

Re:Gemini 2.0: our new AI model for the agentic era by SimianSci on Thursday December 12, 2024 @02:25PM (#42402413)
For a while there I would have been in agreeance with you, but the thought that models can be trained purely on synthetic data has shown to be wrong on multiple levels. Synthetic data needs to be reviewed by individuals to ensure data quality, significantly reducing the speed at which an organization can adopt training data. Reasonable engineers would suggest that the answer to this is to have other language models review the synthetic data, but we have seen that this is what leads to model collapse due to compounding issues around hallucinations.

At best Synthetic data is a "slow follow" for training a model due to the need for human review, but a competitive model, it does not make.

Re:Gemini 2.0: our new AI model for the agentic era by maeil on Wednesday December 11, 2024 @10:00PM (#42395777)
For clarity, I was only talking about the hardware side, not the software one. I don't think the models matter too much, by the time the hardware is ready there will be open models that Apple can take and modify to their liking.

Besides, did Anthropic and e.g. Mistral inherently have such troves of data to train on that Apple doesn't? For the last 6 months, Anthropic has had the SOTA model for the average production usecase.

> Google also already has competitive silicon in this space with the Tensor series processors, which are being fabbed at Samsung plants today. There is no sitting and praying necessary on their part as they already compete.

Intel had a much bigger advantage with x86, and look where we are now. I find it hard to believe that creating a good AI chip isn't a much smaller challenge than it was to do Apple Silicon. The upcoming SE uses their in-house 5G modem, another huge hardware achievement that no one else has been able to do.

With that in mind, how can you bet against Apple when it comes to designing chips at this point? It's not like Amazon et al aren't producing their own AI chips too. Let alone all of the startups like Cerebras. That indicates the moat and barriers are likely much lower than Apple Slicion or the 5G modem.

If I'm talking nonsense, do correct me.

Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @10:21PM (#42395891)
There’s an easy solution here: Apple isn’t trying to compete with the big models everyone else is running. They’re betting in the opposite direction that many small models is a better value ad for their customers. And they can call out to other services as needed for the larger stuff.

I’m in the camp that this is the right call for consumers, instead of trying to compete on the large model side. They’ve yet to deliver on their full promise, but if they can, it’s the place where I think more of the industry will go (for consumers)

And regarding Google’s mobile tensor chips, they are infamously behind all other players in the market space for the same generation of processor. They don’t share the same advantages they do in the server space.

Re:Gemini 2.0: our new AI model for the agentic era by mike_hearn on Thursday December 12, 2024 @05:52AM (#42398115)
Apple have trained their own foundation LLM.
Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Thursday December 12, 2024 @11:53AM (#42400839)
hardly even qualifies for ‘fast follow’, more like ‘surprisingly slow follow’

their models aren’t even that good. sorry apple fanboys but the talent isn’t there

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Thursday December 12, 2024 @11:53AM (#42400847)
training bigger models gets you small models for free plus a higher upper bound in capabilities.

Apple just isn’t very capable in this space, not sure what’s so hard to accept

Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @11:38AM (#42389593)
At what point does the on device stuff eat into their market share though? As on device gets better, who will pay for cloud compute? Other than enterprise use.

I’m not saying on device will ever truly compete at quality, but I believe it’ll be good enough that most people don’t care to pay for cloud services.

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Wednesday December 11, 2024 @12:02PM (#42389916)
You're still focused about inference :)

inference basically does not matter, it is a commodity

Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:08PM (#42390019)
You’re still focused about training :)

training doesn’t matter if inference costs are high and people don’t pay for them

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Wednesday December 11, 2024 @12:28PM (#42390278)
but inference costs arent high already and there are tons of hardware companies that can do relatively cheap LLM inference
Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:42PM (#42390442)
Inference costs per invocation aren’t high. Scale it out to billions of users and it’s a different story.

Training is amortized over each inference, so the cost of inference also needs to include the cost of training to break even unless made up elsewhere

Re:Gemini 2.0: our new AI model for the agentic era by rowanG077 on Wednesday December 11, 2024 @01:10PM (#42390794)
That makes no sense. Inference cost dwarf training cost if you have a succesfull product pretty quickly. Afaik there is no commodity hardware that can run state of the art models like chatgpt-o1.
Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Wednesday December 11, 2024 @01:44PM (#42391245)
> Afaik there is no commodity hardware that can run state of the art models like chatgpt-o1.

Stack enough GPUs and any of them can run o1. Building a chip to infer LLMs is much easier than building a training chip.

Just because one cost dwarfs another does not mean that this is where the most marginal value from developing a better chip will be, especially if other people are just doing it for you. Google gets a good model, inference providers will be begging to be able to run it on their platform, or to just sell google their chips - and as I said, inference chips are much easier.

Re:Gemini 2.0: our new AI model for the agentic era by menaerus on Wednesday December 11, 2024 @03:33PM (#42392630)
Each GPU costs ~50k. You need at least 8 of them to run mid-sized models. Then you need a server to plug those GPUs into. That's not commodity hardware.
Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Wednesday December 11, 2024 @05:48PM (#42393911)
more like ~$16k for 16 3090s. AMD chips can also run these models. The parts are expensive but there is a competitive market in processors that can do LLM inference. Less so in training.
Re:Gemini 2.0: our new AI model for the agentic era by menaerus on Thursday December 12, 2024 @03:56AM (#42397477)
> more like ~$16k for 16 3090s

I don't know where did you get that price from but 1x RTX 3090 is $1,900. 16x is ~$30,000.

> The parts are expensive

Now that we invested ~$30k in GPUs, we only need to find a motherboard that can accommodate 16x pcie4 x16 GPUs, right? And we also need a CPU that can drive that many pcie4 x16 lanes?

Well, none of them exist, not even in the server parts sector let alone client commodity hardware. In any case, you'd need two CPUs so even with this imaginary motherboard we are already entering the server rack design space. And that costs 100's of thousands of $$$.

> but there is a competitive market in processors that can do LLM inference

Nothing but the smallest and smallish models. If that existed then why would you set yourself out building a 16x RTX 3090 machine?

Sorry, but you're just spitting out non-sense.

Re:Gemini 2.0: our new AI model for the agentic era by whimsicalism on Thursday December 12, 2024 @11:57AM (#42400902)
You can just run the GPUs on different nodes, it will still let you run the model. I think the definition of ‘commodity hardware’ in your head is different than the colloquial definition.

GoogleFS was run on ‘commodity hardware’ ie normal disks, of course they were still in a data center but the hardware was still commodity. Whether something is expensive is entirely different from whether it is a commodity, I think you are conflating commodity and consumer.

Re:Gemini 2.0: our new AI model for the agentic era by rowanG077 on Thursday December 12, 2024 @03:10PM (#42402895)
Chip level is only a tiny part of the story. Training can happen with a big boy variant of "it works on my machine". Inference require a world wide network of GPUs. Chip level is the last thing you will be worrying about.
Re:Gemini 2.0: our new AI model for the agentic era by mupuff1234 on Wednesday December 11, 2024 @11:13AM (#42389250)
Majority of people want better performance, running locally is just a nice to have feature.
Re:Gemini 2.0: our new AI model for the agentic era by griomnib on Wednesday December 11, 2024 @12:18PM (#42390123)
Latency is a huge factor in performance, and local models often have a huge edge. Especially on mobile devices that could be offline entirely.
Re:Gemini 2.0: our new AI model for the agentic era by KoolKat23 on Thursday December 12, 2024 @04:38AM (#42397703)
Definitely not when it comes to LLM's, the larger more useful local models are not that fast and latency is not an issue, just look at this Google models voice function or even openai's advanced voice.
Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @11:34AM (#42389544)
They’ll care though when they have to pay for it, or when they’re in an area with poor reception.
Re:Gemini 2.0: our new AI model for the agentic era by vineyardmike on Wednesday December 11, 2024 @12:19PM (#42390148)
Poor reception is rapidly becoming a non-issue for most of the developed world. I can’t think of the last time I had poor reception (in America) and wasn’t on an airplane.

As the global human population increasingly urbanizes, it’ll become increasingly easy to blanket it with cell towers. Poor(er) regions of the world will increase reception more slowly, but they’re also more likely to have devices that don’t support on-device models.

Also, Gemini Flash is basically positioned as a free model, (nearly) free API, free in GUI, free in Search Results, Free in a variety of Google products, etc. No one will be paying for it.

Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:32PM (#42390323)
Many major cities have significant dead spots for coverage. It’s not just for developing areas.

Flash is free for api use at a low rate limit. Gemini as a whole is not free to Android users (free right now with subscription costs beyond a time period for advanced features) and isn’t free to Google without some monetary incentive. Hence why I also originally ask about private cloud compute alternatives with Google.

Re:Gemini 2.0: our new AI model for the agentic era by michaelmrose on Wednesday December 11, 2024 @06:32PM (#42394302)
I ride a ferry from a city of 50k to a city of 700k in the US and work in a building with apartments upstairs basically a concrete cave.

I see poor reception in both areas and only one has WiFi.

Re:Gemini 2.0: our new AI model for the agentic era by mupuff1234 on Wednesday December 11, 2024 @11:39AM (#42389601)
They pay to run it locally as well (more expensive hardware)

And sure, poor reception will be an issue, but most people would still absolutely take a helpful remote assistant over a dumb local assistant.

And you don't exactly see people complaining that they can't run Google/YouTube/etc locally.

Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:02PM (#42389921)
Your first sentence has the fallacy that you’re attributing the cost of the device to a single feature against the cost of that single feature.

Most people are unlikely to buy the device for the AI features alone. It’s a value add to the device they’d buy anyway.

So you need the paid for option to be significantly better than the free one that comes with the device.

Your second sentence assumes the local one is dumb. What happens when local ones get better? Again how much better is the cloud one to compete on cost?

To your last sentence, it assumes data fetching from the cloud. Which is valid but a lot of data is local too. Are people really going to pay for what Google search is giving them for free?

Re:Gemini 2.0: our new AI model for the agentic era by mupuff1234 on Wednesday December 11, 2024 @12:08PM (#42390016)
I think it's a more likely assumption that on device performance will trail off device models by a significant margin for at least the next few years - of course if magically you can make it work locally with the same level of performance it would be better.

Plus a lot of the "agentic" stuff is interaction with the outside world, connectivity is a must regardless.

Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:09PM (#42390030)
My point is that you do NOT need the same level of performance. You need an adequate level of performance that the cost to get more performance isn’t worth it to most people.
Re:Gemini 2.0: our new AI model for the agentic era by mupuff1234 on Wednesday December 11, 2024 @12:13PM (#42390073)
And my point is that it's way too early to try to optimize for running locally, if performance really stabilizes and comes to a halt (which may likely happen) then it makes more sense to optimize.

Plus once you start with on device features you start limiting your development speed and flexibility.

Re:Gemini 2.0: our new AI model for the agentic era by jsight on Wednesday December 11, 2024 @12:51PM (#42390554)
It isn't really hypothetical. Lots of good models run well on a modern Macbook Pro.
Re:Gemini 2.0: our new AI model for the agentic era by YetAnotherNick on Wednesday December 11, 2024 @11:48AM (#42389717)
You can run model >100x faster in cloud compared to on device with DDR RAM. This would make up for the reception.
Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:03PM (#42389934)
And you can’t run the cloud model at all if you can’t talk to the cloud.
Re:Gemini 2.0: our new AI model for the agentic era by YetAnotherNick on Wednesday December 11, 2024 @12:25PM (#42390231)
Yes, but I can't imagine situations where I "have" to run a model when I don't have internet at that time. My life would be more affected with the rest of the internet than having to run a small stupid model locally. At the very least until the hallucination is completely solved, as I need internet to verify the models.
Re:Gemini 2.0: our new AI model for the agentic era by dagmx on Wednesday December 11, 2024 @12:34PM (#42390339)
You’re assuming the model is purely for generation though. Several of the Gemini features are lookup of things across data available to it. A lot of that data can be local to device.

That is currently Apple’s path with Apple Intelligence for example.

Re:Gemini 2.0: our new AI model for the agentic era by michaelmrose on Wednesday December 11, 2024 @06:35PM (#42394328)
Hallucination can't be solved because bogus output is categorically the same sort of thing as useful output.

It has no world model. It doesn't know truth any more than it knows bullshit just a statistical relationship between words.

Re:Gemini 2.0: our new AI model for the agentic era by YetAnotherNick on Wednesday December 11, 2024 @11:45AM (#42389702)
If the model weights is not open, you can't run it on device anyways.
Re:Gemini 2.0: our new AI model for the agentic era by kridsdale1 on Wednesday December 11, 2024 @11:50AM (#42389743)
The Pixel 9 runs many small proprietary Gemini models on the internal TPU.
Re:Gemini 2.0: our new AI model for the agentic era by griomnib on Wednesday December 11, 2024 @12:17PM (#42390113)
And yet these new models still haven’t reached feature parity with Google Assistant, which can turn my flashlight on, but with all the power of burning down a rainforest, Gemini still cannot interact with my actual phone.
Re:Gemini 2.0: our new AI model for the agentic era by lern_too_spel on Wednesday December 11, 2024 @01:27PM (#42391001)
I just tried asking my phone to turn on the flashlight using Gemini. It worked. https://9to5google.com/2024/11/07/gemini-utilities-extension...
Re:Gemini 2.0: our new AI model for the agentic era by griomnib on Wednesday December 11, 2024 @02:26PM (#42391707)
Ok I tried literally last week on Pixel 7a and it didn’t work. What model do you have? Maybe it requires a phone that can do on-device models?
Re:Gemini 2.0: our new AI model for the agentic era by staticman2 on Wednesday December 11, 2024 @05:21PM (#42393689)
I just tried it on my Galaxy Ultra s23 and it worked. I then disconnected internet and it did not work.
Re:Gemini 2.0: our new AI model for the agentic era by _puk on Wednesday December 11, 2024 @06:22PM (#42394217)
Works on a Pixel 4A 5G..

Pretty sure that's not doing any fancy on-device models!

That said, there was a popup today saying that assistant is now using Gemini, so I just enabled it to try. Could well have changed in the last week.

Re:Gemini 2.0: our new AI model for the agentic era by YetAnotherNick on Wednesday December 11, 2024 @12:28PM (#42390271)
Gemini nano weights are leaked and google doesn't care about it being leaked. Google would definitely care if Pro weights are leaked.
Re:Gemini 2.0: our new AI model for the agentic era by onlyrealcuzzo on Wednesday December 11, 2024 @03:00PM (#42392162)
Is there any phone in the world that can realistically run pro weights?
Re:Gemini 2.0: our new AI model for the agentic era by JeremyNT on Wednesday December 11, 2024 @01:11PM (#42390816)
Yeah they've been slow to release end-user facing stuff but it's obvious that they're just grinding away internally.

They've ceded the fast mover advantage, but with a massive installed base of Android devices, a team of experts who basically created the entire field, a huge hardware presence (that THEY own), massive legal expertise, existing content deals, and a suite of vertically integrated services, I feel like the game is theirs to lose at this point.

The only caution is regulation / anti-trust action, but with a Trump administration that seems far less likely.

Re:Gemini 2.0: our new AI model for the agentic era by VirusNewbie on Wednesday December 11, 2024 @01:37PM (#42391134)
If you look at where talent is going, it's Anthropic that is the real competitor to Google, not OpenAI.