Someone who doesn't need more performance cores is unlikely to invest in a Mac Pro.
There's a lot of software that won't scale to 108 cores, of course, but again I expect the amount of software that could usefully scale to 40 parallel threads but can't scale to 108 to be fairly small.
In a world where power and heat budgets don't matter at all you'd not have any efficiency cores, after all.
<math>S_\text{latency}(s) = \frac 1 {(1 - p) + \frac p s}</math>
Bad assumption. It's pretty difficult to write a multithreaded program that scales up to 32 cores. You have to carefully avoid all sources of process-wide contention. The only cases where it is easy to just keep adding cores are where the units of independent work are overwhelmingly large compared to everything else, like video compression.