News for hackers. Stuff that matters.
Re:I'm Not Convinced the AI Bubble Exists by somenameforme on Monday November 09, 2026 @01:47AM (#50421942)
His analysis fails to consider trend lines in inference costs. A couple of years ago inference required a supercomputing cluster. Today, you can run quantized frontier tier models on video cards with a $1600 MSRP. At current trends we'll be running frontier models on a typical gaming computer setup in a couple of years. That is going to destroy centralization possibilities.

It also fails to consider the impact of 'good enough.' A lot of the build-out right now is in anticipation of trying to push the frontier level. But there comes a time, a time we're already arguably past, where models being used for a specific task will already be able to complete that task efficiently. Going way beyond the present should enable LLMs to solve ever more esoteric problems, but in economic terms if a company's goal is to harvest corn, and your corn harvester works well enough, they're not going to care whether or not that corn harvester can also solve Fugazi's 7th Great Conjecture in exomathematics.

Re:I'm Not Convinced the AI Bubble Exists by xvector on Monday November 09, 2026 @07:47AM (#50424851)
Hey, I run local inference on a few RTX 6000s and will say it's pure delusion to think you get "quantized frontier tier inference" on a modern $1600 video card.

I get that you want this to be true. It is not true.

It is not frontier tier, it is not anywhere close, and if you think this you are out of touch with the frontier

Re:I'm Not Convinced the AI Bubble Exists by somenameforme on Monday November 09, 2026 @08:10AM (#50425108)
Here [1] are some various benchmarks for a RTX 4090 on models like Qwen 3.8, where it usually hits around 43 tokens/s. You can find similar vids on YouTube showing it live for comparison, 'proof' if you doubt, etc. And yes, it is frontier tier.

[1] - https://getrigbase.com/gpus/rtx-4090/

Re:I'm Not Convinced the AI Bubble Exists by xvector on Monday November 09, 2026 @11:13AM (#50427544)
Dude, why do you think I care about benchmarks on a 4090 when I know for a fact my 6000 Blackwells are insufficient?
Re:I'm Not Convinced the AI Bubble Exists by somenameforme on Monday November 09, 2026 @09:59PM (#50435541)
If you're doing less with more then I'd imagine you'd certainly care, because that means the problem is you, and not your hardware.
Re:I'm Not Convinced the AI Bubble Exists by xvector on Tuesday November 10, 2026 @09:54AM (#50441244)
The problem is that open models are benchmaxxed and are fairly useless on hardware of this size.