News for hackers. Stuff that matters.
Re:Tinybox of tinygrad by George Hotz is finally entering pr... by threeseed on Tuesday August 27, 2024 @06:46AM (#41366110)
Very unusual specs on paper.

- Air cooling 6x4090 and a 32 core CPU for sustained peak workloads.

- 3200W total power when a single 4090 can draw close to 600W.

Maybe they are targeting startups who aren't interested in overclocking.

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by arder on Tuesday August 27, 2024 @06:56AM (#41366168)
I think the plan with this all along was George went off and built exactly what he thinks he needs for his specific work and then just makes it available. So is the wildly underpowered CPU bad? I don't know, I don't know his use case.

It also seems just weird from a business point of view. He's not going to sell many, he's not going to offer support, he's not at a scale where vendors are going to offer much particular support, and despite being absolutely tiny in scale he's still offering two totally different SKUs.

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by jagrsw on Tuesday August 27, 2024 @06:53AM (#41366148)
This thing could run off a single US outlet (1600W) with some throttling, if I'm not mistaken?

Shame it wasn't designed for EU sockets. 230V*16A = 3700W, or double that on separate breakers!

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by apexalpha on Tuesday August 27, 2024 @07:54AM (#41366561)
3200W seems perfect for a EU socket.

Seperate breakers aren't really a thing here, at least in my country, usually if you need more power you draw 400V

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by Hellolearning on Tuesday August 27, 2024 @12:19PM (#41369220)
No it doesn't. A standard EU Socket is not certified for 24/7 3.2kW.

You should max. pull 2.7kW.

For everything else you need a blue eu socket or camper socket.

I learned this due to my EV which is able to be charged through a normal socket but it regulates it down due to this on purpose and has a temperature sensor build in as well.

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by xxpor on Tuesday August 27, 2024 @12:39PM (#41369543)
US circuits are the same way. "Sustained use" (over 3 hours IIRC) has to be de-rated to 80% of max. So an EV can draw 40A on a 50A circuit.
Re:Tinybox of tinygrad by George Hotz is finally entering pr... by andersa on Tuesday August 27, 2024 @01:49PM (#41370517)
So if it doesn't use 3.2kW continuously, but varies significantly based on what it's doing (perhaps even idle sometimes) then it's fine?
Re:Tinybox of tinygrad by George Hotz is finally entering pr... by jagrsw on Tuesday August 27, 2024 @04:31PM (#41372628)
Is it per spec, or from experience?
Re:Tinybox of tinygrad by George Hotz is finally entering pr... by Hellolearning on Wednesday August 28, 2024 @10:53AM (#41380213)
from spec. full load only needs to be supported for up to an hour
Re:Tinybox of tinygrad by George Hotz is finally entering pr... by bguebert on Tuesday August 27, 2024 @07:22AM (#41366326)
On their site they say it can run at 220V 15A if you got that.

https://docs.tinygrad.org/tinybox/

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by jagrsw on Tuesday August 27, 2024 @08:41AM (#41366903)
Just being nitpicky - I'm from the EU, but I think in the US, you can get either:

  240V: Split-phase, this gives you 120V between each leg and neutral, and 240V across the two legs.
  208V: The interphase in a 3-phase system.
Might be still within tolerance of 220V :)

HTH, ducking out :)

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by georgehotz on Tuesday August 27, 2024 @11:23AM (#41368592)
Specs on website updated, anywhere from 100-240V is fine
Re:Tinybox of tinygrad by George Hotz is finally entering pr... by WithinReason on Tuesday August 27, 2024 @06:57AM (#41366172)
A 4090 draws 450W unless you unlock the power limit
Re:Tinybox of tinygrad by George Hotz is finally entering pr... by Timshel on Tuesday August 27, 2024 @07:14AM (#41366268)
Transient might be an issue. GN discuss transients of ~30/40% over the nominal 450w (https://www.youtube.com/watch?v=j9vC9NBL8zo&t=616s).

And with a distributed training you can end-up with "synchronized" transients over all cards :(.

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by jagrsw on Tuesday August 27, 2024 @08:34AM (#41366845)
I hold an electrical certification in the EU, though I'm not currently practicing.

A quick point: transient surges are usually fine. Both cables and circuit breakers are designed to fail (trip or burn out) under sustained overloads. For example, a 16A Class C circuit breaker might take around an hour to trip with a constant 17A load, but a ~80A load would trip it ~instantly.

PS: Of course, everything is a matter of integration over time (heat dissipation in cables mostly).

Re:Tinybox of tinygrad by George Hotz is finally entering pr... by zten on Tuesday August 27, 2024 @01:35PM (#41370352)
The workstation equivalent, the RTX 6000 Ada, defaults to 300W. You can get most of the performance of a 4090 by capping the power.