News for hackers. Stuff that matters.
Re:ECC matters by CydeWeys on Sunday January 03, 2021 @11:48AM (#25622859)
> but even low-end Ryzen Threadripper CPUs have TDP of 180W, which is a bit higher than I'd like.

Why does it matter? It doesn't idle that high; it only goes that high of you're using it flat out, in which case the extra power usage is justified because it's giving that much more performance over a 100 W TDP CPU. Now I totally get it if you don't want to go Threadripper just for ECC because it's more expensive, but max power draw, which you don't even have to use? I've never seen anyone shop a desktop CPU by TDP, rather than by performance and price.

Re:ECC matters by phkahler on Sunday January 03, 2021 @12:12PM (#25623080)
>> I've never seen anyone shop a desktop CPU by TDP, rather than by performance and price.

Oh oh, me! Back in the day I bought a 65W CPU for a system that could handle a 90W. I wanted quiet and figured that would keep fan noise down at a modest performance penalty. It should also last longer, being the same design but running cooler. I ran that from 2005 until a few years ago (it still run fine but is in storage).

Planning to continue this strategy. I suspect it's common among SFF enthusiasts.

Re:ECC matters by mlyle on Sunday January 03, 2021 @12:54PM (#25623435)
On AMD, with Ryzen Master, you can set the TDP-envelope of the processor to what you want. Then the boost/frequency/voltage envelope it chooses to operate in under sustained load is different.

IMO, shopping by performance/watt makes sense. Shopping by TDP doesn't. (Especially since there is no comparing the AMD and Intel TDP numbers as they're defined differently; neither is the maximum the processor can draw, and Intel significantly exceeds the specified TDP on normal workloads).

Re:ECC matters by vvanders on Sunday January 03, 2021 @01:01PM (#25623503)
TDP matters a fair bit in SFF(Small Form Factor) PCs. For instance the 3700x is a fantastic little CPU since it has a 65W TDP but pretty solid performance.

In a sandwich style case you're usually limited to low profile coolers like Noctua L9i/L9a since vertical height is pretty limited.

Re:ECC matters by mlyle on Sunday January 03, 2021 @01:08PM (#25623568)
Performance/watt matters. You can just set TDP to what you want with throttling choices.

If you want a 45W TDP from the 3700X, you can just pop into Ryzen Master and ask for a 45W TDP. Boom, you're running in that envelope.

I think shopping based on TDP is not the best, because it's not comparable between manufacturers and because it's something you can effectively "choose".

Re:ECC matters by mongol on Sunday January 03, 2021 @01:42PM (#25623908)
How do you do that? Is it a setting in the bios? Or can it be done runtime? If so, how? It sounds interesting if I can run a beefy rig as a power efficient device, for always-on scenarios, and then boost it when I need.
Re:ECC matters by mlyle on Sunday January 03, 2021 @01:55PM (#25624029)
> How do you do that? Is it a setting in the bios? Or can it be done runtime?

On AMD, it's a utility you run. I believe you may require a reboot to apply it. On some Intel platforms, it's been settings in the BIOS.

> It sounds interesting if I can run a beefy rig as a power efficient device, for always-on scenarios, and then boost it when I need.

This is what the processor is doing internally anyways. It throttles voltage and frequency and gates cores based on demanded usage. Changing the TDP doesn't change the performance under a light-to-moderate workload scenario at all.

Ryzen Master lets you change some of the tuning for the choices it makes about when and how aggressively to boost, though, too.

Re:ECC matters by Cloudef on Sunday January 03, 2021 @02:17PM (#25624243)
Ryzen Master doesnt seem to be available for linux so you end up with bunch of unnofficial hacks that may or may not work. I run sff setup myself, originally wanted to get 3600 but it was out of stock, and the next tdp friendly processor was 3700x.
Re:ECC matters by mlyle on Sunday January 03, 2021 @02:22PM (#25624308)
That's an annoyance, but on Linux you have infinite more control of thermal throttling and you can get whatever thermal behavior you want. Thermald has been really good on Intel, and now that Google contributed RAPL support you can get the same benefits on AMD-- pick exactly your power envelope and thermal limits.
Re:ECC matters by vvanders on Sunday January 03, 2021 @03:08PM (#25624775)
Yeah but can I get a metric ton of benchmarks at that 45w setpoint?

I don't really see the reason in paying for a 100w TDP premium if I'm just going to scale it down to 65w.

Re:ECC matters by mlyle on Sunday January 03, 2021 @06:02PM (#25626109)
> Yeah but can I get a metric ton of benchmarks at that 45w setpoint?

Yup, they're out there.

> I don't really see the reason in paying for a 100w TDP premium if I'm just going to scale it down to 65w.

You might want the core count or peak performance for the very short term. When I was looking, running 65W parts in the 45W envelope was only about a 7% penalty, so you get a bunch more performance/watt.

Re:ECC matters by phkahler on Monday January 04, 2021 @10:31AM (#25632547)
I'm running a 2400G in a Mellori-ITX. Another issue is sizing the power supply.
Re:ECC matters by ReactiveJelly on Sunday January 03, 2021 @01:23PM (#25623693)
Back when my daily driver was a Core 2 laptop, someone told me that capping the clock frequency would make it unusable.

As a petty "Take that", I dropped the max frequency from 2.0 GHz to 1.0 GHz. I ran a couple benchmarks to prove the cap was working, and then just kept it at 1.0 for a few months, to prove my point.

It made a bigger difference on my ARM SBC, where I tried capping the 1,000 MHz chip to 200 or 400 MHz. That chip was already CPU-bound for many tasks and could barely even run Firefox. Amdahl's Law kicked in - Halving the frequency made _everything_ twice as slow, because almost everything was waiting on the CPU.

Re:ECC matters by mlyle on Sunday January 03, 2021 @01:32PM (#25623792)
The funny thing is, on modern processors-- throttling TDP only affects when running flat out all-core workloads. A subset of cores can still boost aggressively, and you can run all-core max-boost for short intervals.

And the relationship between power and performance isn't linear as processor voltages climb trying to squeeze out the last bit of performance.

So if you want to take a 105W CPU and ask it to operate in a 65W envelope, you're not giving up even 1/3rd of peak performance, and much less than that of typical performance.

Re:ECC matters by lynguist on Monday January 04, 2021 @07:19AM (#25630387)
You’re giving up 0 of peak single thread performance. A single core in turbo across Intel and AMD, mobile and desktop uses max 50W.
Re:ECC matters by chrismorgan on Monday January 04, 2021 @09:11AM (#25631523)
Here are some numbers on single core power consumption, ⅌ https://www.anandtech.com/show/16214/amd-zen-3-ryzen-deep-di...:

AMD Ryzen 9 5950X: 20.6W for a single core at 5050MHz, 49W for the whole package. (And it’s generally the package figure that you care about.)

AMD Ryzen 9 5900X: 17.9W/54W at 4875MHz.

AMD Ryzen 7 5800X: 17.3W/37W at 4825MHz.

AMD Ryzen 5 5600X: 11.8W/28W at 4650MHz (though the highest core reading is 13W, at three cores loaded).

You’re both correct: by simply restricting that power envelope by 40%, you shed a lot less multi-threaded performance than people realise, and no single-threaded performance.

Look at the 5950X figures, and you observe that at about 120W, it can run 6 cores at 4,650MHz (27,900 core–MHz), or 16 cores at 3,775MHz (60,400 core–MHz).

Expressed one way: by dropping the frequency by 20%, power per watt increased by around 2.7×.

Expressed another way: let’s skip a 65W envelope—put this particular 105W chip in a 40W envelope and you lose only 20% of your six-cores performance. Seriously. But I’m not sure what the curve would look like if you load all 16 cores at a 40W envelope, what speed they’d be going at.

(But do remember that “TDP” is a bit of a mess as a concept, and that we’re depending on non-core power consumption being generally fairly consistent regardless of load.)

Re:ECC matters by sam_lowry_ on Sunday January 03, 2021 @12:22PM (#25623156)
Hm... My 2013 NUC in fanless Akasa enclosure runs 24/7 on a 6W CPU, I recently looked at the options, and the 2019 6W offering changes little in performance. Yes, memory got faster, but that's it.

My passive-cooled desktop is also running a slightly trottled down 65W CPU.

So yes, there are people who choose there hardware by TDP.

Re:ECC matters by francis-io on Sunday January 03, 2021 @12:44PM (#25623344)
When looking for a CPU for a server that sits in my living room, I went down the thought process of getting a low tdp. I don't have a quote, but I seem to remember coming to the conclusion that tdp is the max temp threshold, not the consistent power draw. If you have a computer idling I believe you won't see a difference in temp between cpus, but you will have the performance when you need it.

These days, a quiet, pwm fan with good thermal paste (and maybe some linux CPU throttling) more than achieves my needs for a "silent" pc 99% of the time.

I would love to be told my above assumptions are wrong if they are.

Re:ECC matters by mlyle on Sunday January 03, 2021 @01:11PM (#25623597)
Yah-- one should look at performance within a given power envelope. Being able to dissipate more and then either end up with the fan running or the processor throttling back somewhat is good, IMO.

The worst bit is, AMD and Intel define TDP differently-- neither is the maximum power the processor can draw-- though Intel is far more optimistic.

Re:ECC matters by koolba on Sunday January 03, 2021 @12:19PM (#25623128)
SFF?
Re:ECC matters by oconnor663 on Sunday January 03, 2021 @12:24PM (#25623179)
"small form factor" as far as I can tell
Re:ECC matters by lostlogin on Sunday January 03, 2021 @04:03PM (#25625227)
The Intel Nuc and Mac mini are good examples of this - however the Nuc doesn’t have its psu inside, it’s a brick. Great for fixing failures, horrible in general as a built in psu is so much tidier.
Re:ECC matters by srtjstjsj on Sunday January 03, 2021 @11:50PM (#25628018)
Internal PSU adds heat that is noisy or expensive to dissipate or is avoided by throttling performance.
Re:ECC matters by ClumsyPilot on Monday January 04, 2021 @01:07AM (#25628320)
If the concern is about heat and noise, the cooling system is the most important factor, oddly I don't see it even mentioned.

Get a huge cooler like Noctua d14, and you pc becomes silent. It lasts forever, requires no maintenance, a good investment.

If you are adventurous, watercooling is even better, but its a can of worms I decided I'd rather live without - possibility of leaks and cost make it harder to justify

Re:ECC matters by defanor on Sunday January 03, 2021 @12:12PM (#25623079)
I prefer to pick PSU and fans (for both CPU and chassis) that can handle it comfortably (preferably while staying silent and with some reserve) with maximum TDP in mind, and given that I don't need that many cores or high clock speed either, a powerful CPU with high TDP is undesirable because it just makes picking other parts harder. I've mentioned TDP explicitly because I wouldn't mind if it was a (possibly even high-end) Threadripper that somehow didn't produce as much heat. Although price also matters, indeed.
Re:ECC matters by bayindirh on Sunday January 03, 2021 @12:33PM (#25623251)
> I've never seen anyone shop a desktop CPU by TDP, rather than by performance and price.

That's me. When I start to plan for a new system, I select the processor first and read its thermal design guidelines (Intel used to have nice load vs. max temp graphs in their docs) and select every component around it for sustained max load.

This results in a more silent system for idle and peace of mind for loading it for extended duration.

Re:ECC matters by 411111111111111 on Sunday January 03, 2021 @12:38PM (#25623302)
That's not necessarily correct.

You can passively cool threadrippers if you underclock them enough and have good ventilation in case.

Re:ECC matters by bayindirh on Sunday January 03, 2021 @12:46PM (#25623360)
If my only interest would be ECC, I might do that but, I develop scientific software for research purposes. I need every bit of performance from my system.

In my case loading means maxing out all cores and extended period of time can be anything from five minutes to hours.

Re:ECC matters by mlyle on Sunday January 03, 2021 @12:57PM (#25623467)
The problem is-- you can't compare the TDP nor even the system cooling design guidelines between AMD and Intel.

Both are optimistic lies, but-- if you look at the documents it looks like currently AMD needs more cooling, but actually dissipates less power in most cases and definitely has higher performance/watt.

Re:ECC matters by bayindirh on Sunday January 03, 2021 @01:09PM (#25623579)
> The problem is-- you can't compare the TDP nor even the system cooling design guidelines between AMD and Intel.

Doesn't matter for me since I'm not interested in comparing them.

> Both are optimistic lies, but-- if you look at the documents it looks like currently AMD needs more cooling, but actually dissipates less power in most cases and definitely has higher performance/watt.

I'm aware of the situation, and I always inflate the numbers 10-15% to increase headroom in my systems. The code I'm running is not a most case code. A FPU heavy, "I will abuse all your cores and memory bandwidth" type, heavily optimized scientific software. I can sometimes hear that my system is swearing at me for repeatedly running for tests.

I don't like to add this paragraph but, I'm one of the administrators of one of the biggest HPC clusters in my country. I know how a system can surpass its TDP or how can CPU manufacturers skew this TDP numbers to fit in envelopes. We make these servers blow flames from their exhausts.

Re:ECC matters by ethanpil on Sunday January 03, 2021 @01:29PM (#25623759)
Built a NAS. My #1 concern for choosing CPU was TDP. This machine is on 24/7 and power use is a primary concern where I live because electricity is NOT cheap.
Re:ECC matters by mlyle on Sunday January 03, 2021 @01:38PM (#25623870)
This is a poor way to make the choice. TDP is supposed to specify the highest power you can get the processor to dissipate, not typical or idle use. And since different manufacturers specify TDP differently, you can't even compare the number.

Performance/watt metrics and idle consumption would have been a far better way to make this choice.

If you have a choice between A) something that can dissipate 65W peak for 100 units of performance, but would dissipate 4W average under your workload, and B) something that can dissipate 45W peak for 60 units of performance, but would dissipate 4.5W under your workload... I'm not sure why you'd ever pick B.

Re:ECC matters by mongol on Sunday January 03, 2021 @02:16PM (#25624225)
Is there a metric to look for to understand what power consumption is at "idle" or something close to that? That is what confuses me. I don't want to spend a lot of money on something that will be always on, and usually idling, and finding that its power usage is way higher than I thought. But perhaps there is a metric that tells that. I have not looked closely at it.

Also, even though the CPU may draw less, can still the power supply waste more, just because it is beefy? Comparing with a sports car, they have great performance, but also use more gas in ordinary traffic? Can a computer be compared with that?

Re:ECC matters by mlyle on Sunday January 03, 2021 @02:30PM (#25624380)
> Is there a metric to look for to understand what power consumption is at "idle" or something close to that? That is what confuses me. I don't want to spend a lot of money on something that will be always on, and usually idling, and finding that its power usage is way higher than I thought.

Community benchmarks, from Tom's Hardware, etc.

The vendor numbers are make believe-- you can't use them for power supply sizing or for thermal path sizing. If you look at the cited TDP numbers today-- it can be misleading-- e.g. often Intel 45W TDP parts use more power at peak than AMD 65W parts.

On modern systems, almost none of the idle consumption is the processor. The power supply's idle use and motherboard functions dominate.

> Also, even though the CPU may draw less, can still the power supply waste more, just because it is beefy?

Yes, having to select a larger power supply can result in more idle consumption, though this is more of a problem on the very low end.