Nowadays, old server processors have very poor single threaded performance compared to recent desktop grade hardware, and the much larger amount of cores fails to compensate for that in pretty much all workstation loads. Especially considering that you can get a lot of cores in desktop hardware nowadays too. The relative value of desktop hardware vs server hardware has gone up substantially in the past 5 years or so, since Intel started making server chips focused exclusively on the demands of large scale data centers and AMD started normalizing high core counts in desktop chips.
Because cheap second hand server chips are sourced from data centers, that inherently favor high core counts and only baseline single thread performance, I don't see a future where we have cheap server processors ever being a great choice for a workstation again. Quick-ish single thread server chips do exist (e.g. Epyc 72F3), but I think those are too niche to ever see them for a good deal on eBay.
I’m certainly a power user and suspect that additional cores may actually benefit me, but there are some very interesting points about clock speed from you and others.