Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool
by dzdt on Tuesday February 14, 2023 @12:56PM
(#34793174)
Not directly applicable for large language models, I was doing some searching for cards with lots of double-precision calc performance. Nvidia has been leaving that out of all of the consumer versions of hardware; cheap P100's seem to be by far the highest DP FLOPS per dollar solution available right now.
[ Parent
| on HN ]
Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool
by mk_stjames on Tuesday February 14, 2023 @01:20PM
(#34793585)
I have an interest in doing lattice Boltzmann fluid dynamics simulation on GPUs, and this is something I've noticed with the P100's as well. That and memory bandwidth is super important for such calcs, along with total memory. Commercial codes I've seen aren't using any ML ops compute optimizations or tensor cores and anything like that, it's mostly just OpenCL based and thus the P100s throughput per dollar is pretty high.