Re:I'm Not Convinced the AI Bubble Exists
by xvector on Monday November 09, 2026 @07:47AM
(#50424851)
Hey, I run local inference on a few RTX 6000s and will say it's pure delusion to think you get "quantized frontier tier inference" on a modern $1600 video card.
I get that you want this to be true. It is not true.
It is not frontier tier, it is not anywhere close, and if you think this you are out of touch with the frontier
Re:I'm Not Convinced the AI Bubble Exists
by somenameforme on Monday November 09, 2026 @08:10AM
(#50425108)
Here [1] are some various benchmarks for a RTX 4090 on models like Qwen 3.8, where it usually hits around 43 tokens/s. You can find similar vids on YouTube showing it live for comparison, 'proof' if you doubt, etc. And yes, it is frontier tier.
Re:I'm Not Convinced the AI Bubble Exists
by xvector on Monday November 09, 2026 @11:13AM
(#50427544)
Dude, why do you think I care about benchmarks on a 4090 when I know for a fact my 6000 Blackwells are insufficient?
Re:I'm Not Convinced the AI Bubble Exists
by somenameforme on Monday November 09, 2026 @09:59PM
(#50435541)
If you're doing less with more then I'd imagine you'd certainly care, because that means the problem is you, and not your hardware.
It also fails to consider the impact of 'good enough.' A lot of the build-out right now is in anticipation of trying to push the frontier level. But there comes a time, a time we're already arguably past, where models being used for a specific task will already be able to complete that task efficiently. Going way beyond the present should enable LLMs to solve ever more esoteric problems, but in economic terms if a company's goal is to harvest corn, and your corn harvester works well enough, they're not going to care whether or not that corn harvester can also solve Fugazi's 7th Great Conjecture in exomathematics.