Re:Serving AI from the Basement – 192GB of VRAM Setup
by bongodongobob on Sunday September 08, 2024 @03:21PM
(#41482481)
You're interested in the different between a single CPU and 8 GPUs? A Ford fiesta vs a freight train.
[ Parent
| on HN ]
Re:Serving AI from the Basement – 192GB of VRAM Setup
by mrnonchalant on Sunday September 08, 2024 @03:25PM
(#41482508)
One can be interested in the differences between a Ford Fiesta and a freight train…
Re:Serving AI from the Basement – 192GB of VRAM Setup
by therouwboat on Sunday September 08, 2024 @03:45PM
(#41482643)
Are you fucking kidding me? A single train car can weight 130 tons, a fiesta can carry maybe 500kg, its not even close. /s
Re:Serving AI from the Basement – 192GB of VRAM Setup
by bongodongobob on Sunday September 08, 2024 @04:29PM
(#41482947)
How is that even sarcasm
Re:Serving AI from the Basement – 192GB of VRAM Setup
by skavi on Sunday September 08, 2024 @03:28PM
(#41482534)
A single SoC, which includes a GPU (two GPUs, kinda).
Re:Serving AI from the Basement – 192GB of VRAM Setup
by TaylorAlexander on Sunday September 08, 2024 @08:27PM
(#41484443)
Yeah. I can’t afford a freight train.
Re:Serving AI from the Basement – 192GB of VRAM Setup
by defrost on Sunday September 08, 2024 @08:41PM
(#41484514)
Keep an eye on the SV going out of business fire sales. Not all the AI kites will fly.
As for actual trains, they can be suprisingly affordable (to live in):
https://atrservices.com.au/product/sa-red-hen-416/ https://en.wikipedia.org/wiki/South_Australian_Railways_Redh...
and the freight rolling stock flatcars make great bridges (single or sectioned) with concrete pylons either end for farms - once the axles are shot they can go pretty damn cheap and the beds are good enough to roll a car or small truck over.
addendum: in case you miss fresh reply to old comment: https://news.ycombinator.com/item?id=41484529