Re:Ask HN: MacBook vs. Dedicated GPU for LLM
by gizajob on Saturday June 27, 2026 @12:52AM
(#48695245)
The hardware is here today for people prepared to tolerate mild amounts of latency. It’s easy to forget that computing tasks used to often take major amounts of time - rendering an audio file, rendering a video, transcoding – all kinds of tasks took minutes or even hours of the computer spinning its fans on maximum just to deliver the result. AI and agentic AI and diffusion is the next round of that - trading a small bit of your waiting time for phenomenal power. The datacentre builders trying to get you hooked on instant responses on the LLM platforms have made you think that a “good” AI responds instantly and completely interactively - they can still be brilliant with a bit of delay. And having a competent agent doing things on my local machine, it doesn’t really matter if it takes ten minutes or an hour or six hours to complete a task while I’m out doing other things.
Re:Ask HN: MacBook vs. Dedicated GPU for LLM
by Frannky on Saturday June 27, 2026 @01:08AM
(#48695320)
Hmm, I have access to A100s and a GB10, but if I use the models hosted there to code, I waste a lot of time waiting for answers and correcting errors. The amount of work I get done thanks to the quality and speed of frontier hosted models let me be insanely productive and have a lot of free time. I could use the slow local setup, but at what price?
Re:Ask HN: MacBook vs. Dedicated GPU for LLM
by gizajob on Saturday June 27, 2026 @01:16AM
(#48695359)
Well if all that was taken away from you and you had to go to the bank to ask for the money to rebuild so you could become as productive as you are now, what would that cost and would the bank loan you the money?
Re:Ask HN: MacBook vs. Dedicated GPU for LLM
by FireBeyond on Saturday June 27, 2026 @01:09AM
(#48695327)
The racks we're deploying are effectively GB300 NVL72s: 72 Blackwell Ultra GPUs 36 Grace CPUs, 20.7TB of unified HBM3e.
Works out to about 1.1exaflops of fp4. Networking is 800gbps.
120kW per rack.
Re:Ask HN: MacBook vs. Dedicated GPU for LLM
by gizajob on Saturday June 27, 2026 @01:21AM
(#48695386)
That’s a majorly impressive computer. What’s the price of that per rack? Deploying for what?
Re:Ask HN: MacBook vs. Dedicated GPU for LLM
by FireBeyond on Saturday June 27, 2026 @01:37AM
(#48695482)
$3-4M per rack. A variety of workloads...
Competition and innovation will hopefully make the bubble pop, and we'll get reasonably priced local hardware to run very intelligent models. Something like Talaas with GLM 5.2 would be pretty cool. Or Apple printing the latest model onto hardware—it would give a new reason to buy a new Mac every year (a new ai model with every new version).