[1] http://www.nvidia.com/object/quadro-design-and-manufacturing...
[2] http://www.nvidia.com/object/media-and-entertainment.html
How does, e.g., POWER8 compare? (And POWER9, soon?)
That said, POWER tends to be even more expensive than this.
POWER8 is not well suited for HPC workloads as their vector instructions (VMX/AltiVec) are only 128-bit wide vs Intel's latest Skylake Xeon CPUs have vector instructions (AVX512) that are 512-bit wide.
For non HPC workloads (e.g. integer arithmetic) the POWER8 CPUs were somehow competitive with Intel's CPUs when they were first released in 2015 but today AMD and Intel's CPUs are clearly faster.
From what I can tell CPU enthusiasts were not impressed by the POWER8 CPU architecture.
In the case of nVidia the quadro cards are the only ones sold as manufactured by the company and are incredibly high binned.
Lots of people on this thread are conflating a few things such as ML, but I work in an industry where we deal a lot with GPUs and its certainly a fact that flipped bits are significantly more common than many think. If you do any work that requires the output to be nonvolatile then you can run into issues.
http://ieeexplore.ieee.org/document/5493404/?arnumber=549340...
The fact that if you want a chip that powerful, there is only Intel. An example in GPUs are the NVIDIA Quaddro cards. If your frame needs more than 16GB memory to render, there is no other card available. So they sell the same chips packaged as a Quaddro at 5x the price of a Titan.