Re:Tinybox of tinygrad by George Hotz is finally entering pr...
by andersa on Tuesday August 27, 2024 @10:27AM
(#41367923)
I don't think they're intended for rack usage like that. More like for people to put under their desks... there would be no reason to build the giant case with fancy silent-ish cooling if you're going to put them next to your other jet engines.
Re:Tinybox of tinygrad by George Hotz is finally entering pr...
by anon389r58r58 on Tuesday August 27, 2024 @10:59AM
(#41368300)
Fully agree, and I think the tinybox is great if you put only one of them somewhere in your local office.
I just don't think it makes sense to connect multiple of them into a "cluster" to work with bigger models, as the networking bandwidth isn't good enough and you'd have to fit multiple of these big boxes into your local space. Then I might as well put up a rack in a separate room.
Re:Tinybox of tinygrad by George Hotz is finally entering pr...
by StrangeDoctor on Tuesday August 27, 2024 @11:27AM
(#41368631)
there's an ocp 3.0 mezzanine, so no need to remove a card and you'd get 200gbps, unless I've missed something about needing to remove a card to access it. But yeah stacking these or racking them seems less than ideal.
The problem of the form factor will remain. The tinybox is 15U big for compute that you'd normally expect to find in a 4U form factor.