News for hackers. Stuff that matters.
Re:I Run LLMs Locally by europeanplug09 on Monday December 30, 2024 @03:20AM (#42547520)
>You need a lot of space for that, cooling, and a good fuse

Or live in europe where any wall-socket can give you closer to 3kW. For crazier setups like charging your EV you can have three-phase plugs with ~22kW to play with. 1m2 of floor-space isn't that substantial either unless you already live in a closet in middle of the most crowded city.

Re:I Run LLMs Locally by dotancohen on Monday December 30, 2024 @03:49PM (#42553352)
3 phase 240v at 16amps is just about 11kW. You're not going to find anything above that residential unless it was purpose-built.

That's still a lot of power, though, and does not invalidate your point.