News for hackers. Stuff that matters.
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by a13n on Wednesday April 24, 2024 @01:06PM (#40147005)
Seems like capitalism is doing its thing here. The potential future revenue from having the best model is presumably in the trillions.
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by sangnoir on Wednesday April 24, 2024 @02:30PM (#40147925)
> The potential future revenue from having the best model is presumably in the trillions.

I heard this winner-takes-all spiel before - only last time, it was about Uber or Tesla[1] robo-taxis making car ownership obsolete. Uber has since exited the self-driving business, Cruise is on hold/unwinding and the whole self-driving bubble has mostly deflated, and most of the startups are long gone, despite the billions invested in the self-driving space. Waymo is the only company with robo-taxis, albeit in only 2 tiny markets and many years away from general availability.

1. Tesla is making robo-taxi noises once more, and again, to juice investor sentiment.

Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by a13n on Wednesday April 24, 2024 @03:05PM (#40148240)
Uber and Tesla are valued at 150B and 500B respectively, I'd say in terms of an ROI on deploying large amounts of capital these are both huge success stories.

No investment in an emerging market is a sure thing, it's an educated guess. You have to take a lot of swings to occasionally hit a homerun, and investing in AI seems like the most plausible swing to make at this time.

Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by sangnoir on Wednesday April 24, 2024 @03:26PM (#40148489)
I didn't claim there's no positive ROI. I only noted that the breathlessly promised "trillion+ dollar self-driving market" failed to materialize.

I suspect the AI market will have a similar trajectory in the next decade: no actual AGI - maybe one company still plugging away at it, a couple of very successful companies whose core competencies don't include AI, but with billions in market cap, and a lot of failed startups littering the way there.

Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by bugbuddy on Wednesday April 24, 2024 @01:43PM (#40147459)
L0L Trillions ROFL
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by hnthrowaway9812 on Wednesday April 24, 2024 @07:19PM (#40151131)
It doesn't seem like that's true at all.

If the "best model" only stays the best for a few months and if, during those few months, the second best model is near indistinguishable, then it will be extremely hard to extract trillions of dollars.