News for hackers. Stuff that matters.
Re:Grok3 Launch by nmca on Tuesday February 18, 2025 @01:07PM (#43093049)
This is grok 3, so not a debut
Re:Grok3 Launch by cj on Tuesday February 18, 2025 @01:25PM (#43093257)
Maybe this is Grok’s “ChatGPT moment”. Similar to how OpenAI’s debut was with GPT-3.5 (not their first version)

Debut in the sense that it’s something good enough that it’s getting mainstream attention.

Re:Grok3 Launch by bangaladore on Tuesday February 18, 2025 @01:25PM (#43093262)
It is a debut of their thinking mode iirc.

Unfortunately LLMs are shifting compute time to test time instead of train time. I don't really like this and frankly it shows a stalling of the architectures, data sets, etc...

Re:Grok3 Launch by minihat on Tuesday February 18, 2025 @02:32PM (#43093998)
Another take is that the base models are now good enough that spending more money for more intelligence is viable at test time. A threshold has been crossed.
Re:Grok3 Launch by bangaladore on Tuesday February 18, 2025 @03:18PM (#43094510)
I guess I'd always thought the direct opposite.

Naively, I feel to be useful, the goal of LLMs should be to more power efficient. So that eventually all devices can be smarter.

Power efficiency can be gained through less time-time, or more "intelligence" or some combination of the two. I'm not convinced these SOTA models are doing much more than increasing test-time.

Re:Grok3 Launch by holoduke on Tuesday February 18, 2025 @03:40PM (#43094805)
Biggest impacts on power efficiency will be the advances in node size and transistor type like nanosheet or forksheet. Algorithm will help just a little.