News for hackers. Stuff that matters.
Re:Gemini 4 Argon by mridulmalpani on Wednesday September 30, 2026 @05:01PM (#49914406)
I wonder, why Google don't make Gemini - open weights model?

Considering, Gemini 4 is in the same ballpark as SOTA models, just open source it and kill any competition from openAI and Anthropic, and be market leader.

This will be so good on so many dimensions - buying time for Google to iterate on next model, best for all folks like us, kill funding or destroy valuation of competitors and force them to be open up their model or force them to a create a much superior model than open source Gemini.

Only downside, is revenue loss from Gemini API, which I am not sure is really significant as compared to Google other revenue sources and a part of this can be captured by GCP, as you need to host the model somewhere.

Re:Gemini 4 Argon by bitexploder on Wednesday September 30, 2026 @06:35PM (#49915354)
No one on the planet could run a frontier model. The amount of VRAM you need would bankrupt a normal person.

I suspect most people don't have enough storage space to even download a frontier model.

Re:Gemini 4 Argon by freecodeio on Wednesday September 30, 2026 @06:53PM (#49915528)
all the enterprise clients which the two frontier companies rely on have the money to buy the hardware and run a frontier model themselves, it just becomes a nobrainer to buy your own hardware if you have 10-20b token output per week
Re:Gemini 4 Argon by tandr on Wednesday September 30, 2026 @07:17PM (#49915723)
Well... given that I have codex reporting 1b tokens consumed for my couple-days long session, I suspect 10-20b is not that hard to reach for a company of 10 devs. It would be interesting to know what is "rental fee" for a model like Astra or Sol 6.1, and how much hardware they actually need - not just gpu, but all of it?
Re:Gemini 4 Argon by bitexploder on Wednesday September 30, 2026 @10:34PM (#49917017)
To be comfortable you need 300 to 400 terabytes of storage. You need the GPUs and the cooling for them. They don't need a lot more. You put models in memory and you do math really fast and make tokens. You need some CPU and RAM infrastructure for like prompt caches and things like that, which does add up, but the dominant cost is by far the GPUs and VRAM. Everything else is a pretty easy step down to afford. You probably need to have multiple different models, right? Like if you want an Astra plus a Sol plus, you know, like a Luna-class model, say, you probably need like 10 terabytes for Astra, probably 3 to 4 terabytes for Sol, and 1 to 2 for Luna, maybe less, maybe one or half a billion even for Luna. That's RAM. You need So all total you need 15 to 16 terabytes of active VRAM to keep those models resident. That's not counting what you want to keep in cash and whatever hosting constraints these models have that aren't public. That much VRAM is five to eight million dollars right now.

Plus what models are you running? The biggest models you can run are like in the terabyte range or Qwen or GLM. Kimi K3 is there, but GLM 5.3 is very competitive. Using voice dictation, hands hurt, sorry for any errors. You still want many terabytes of RAM to run say multiple GLM+DeepSeek V4.1 for some actual concurrency.

Re:Gemini 4 Argon by bitexploder on Wednesday September 30, 2026 @10:28PM (#49916973)
We have had this discussion for a decade regarding cloud hosting. There are definitely workloads and AI inference that you want to do in-house. Hosting these GPUs and models and setting up the interconnect and balancing it is really hard right now. It's not traditional infrastructure. It is exotic. Typical enterprise is at such a disadvantage to try and host this completely themselves. And models are constantly updating. And what models are you going to run? Six months ago, things that probably cost you a billion tokens probably cost you 50 to 100 million now, given how much more efficient models have gotten, or at least they cost that much. I don't know. It's just not a given.
Re:Gemini 4 Argon by dash-44 on Thursday October 01, 2026 @12:56AM (#49917890)
This comment makes no sense. The original comment wasn't specifically to do with the average person hosting at home.

There are already: - hundreds of western providers hosting open models, including large ones such as Kimi K3 which is near Opus/Sol sizes.

- people hosting large models such as Kimi K3 at home. Check on reddit, there are people with 20x DGX Spark setups etc.

Re:Gemini 4 Argon by bitexploder on Thursday October 01, 2026 @01:25AM (#49918031)
I was being dramatic, but no normal person is running 20x DGX spark. That is 100K of slow VRAM. Not sure it makes a lot of sense TBH.
Re:Gemini 4 Argon by misiti3780 on Thursday October 01, 2026 @10:18AM (#49922033)
20? I have 1 and it seems they can only be configured up to 4.
Re:Gemini 4 Argon by bitexploder on Thursday October 01, 2026 @11:19AM (#49922863)
I was replying to parent suggesting you buy 20 DGX to run a multi terabyte model as a normal human / hobbyist.
Re:Gemini 4 Argon by tantalor on Wednesday September 30, 2026 @05:12PM (#49914531)
Re:Gemini 4 Argon by losvedir on Wednesday September 30, 2026 @05:39PM (#49914842)
They do release the model weights for Gemma. But could anyone actually run Gemini 4 weights? It's probably like a 10T model, which you need an industrial rack for anyway.
Re:Gemini 4 Argon by copperx on Thursday October 01, 2026 @03:27AM (#49918770)
You're saying no entity has industrial racks ?
Re:Gemini 4 Argon by 5555watch on Wednesday September 30, 2026 @05:09PM (#49914502)
Google has a small stake in Anthropic
Re:Gemini 4 Argon by aviinuo on Wednesday September 30, 2026 @05:27PM (#49914714)
A small stake on the order of a quarter trillion dollars
Re:Gemini 4 Argon by mridulmalpani on Wednesday September 30, 2026 @05:14PM (#49914551)
Yeah, but I don't think, that is the primary reason.

I am just trying to understand - why Google haven't done and have no plans for it. They have done it for Android and have Gemma models too.

Re:Gemini 4 Argon by sidibe on Wednesday September 30, 2026 @09:06PM (#49916459)
Doesn't make sense for them to give away weights. They sell their own service using that and killing the competition (that they have a stake in) isn't in their interest either because their cloud growth is based on other companies' continuing heavy investment in this space.
Re:Gemini 4 Argon by loufe on Wednesday September 30, 2026 @05:27PM (#49914708)
And a stake in SpaceX
Re:Gemini 4 Argon by sumitkumar on Thursday October 01, 2026 @12:55AM (#49917880)
It will hurt their cloud business as that model would be served by everyone and not just them.
Re:Gemini 4 Argon by mattstir on Thursday October 01, 2026 @04:50AM (#49919343)
Frontier LLMs that Google doesn't control are existential threats to Google's business model. If no one is using Google search or browsing websites themselves because they're asking LLMs, Google doesn't make ad revenue. Gemini at least has a path to monetization for Google (subscriptions, ads baked into responses).
Re:Gemini 4 Argon by mattmaroon on Thursday October 01, 2026 @06:43AM (#49920064)
A competing model still needs a search index behind it to be a threat to Google. An open weight model doesn’t have that. The other frontier models still struggle to fulfill a lot of queries for lack of one.
Re:Gemini 4 Argon by Rastonbury on Friday October 02, 2026 @09:58AM (#49933611)
Quite probable that OAI at least is building one, given all the posts about bots hammering sites and the agent swarm hacks all about to trying to game search query results