Re:We improved Tensorflow Serving performance by over 70%
by bitL on Tuesday March 26, 2019 @04:34AM
(#19490081)
Inference is not that super slow on CPU, especially for network requests that already have quite a bit of latency, so plenty of companies use CPUs on the cloud for lambda/flexible loads where GPUs aren't available.
[ Parent
| on HN ]
There are no comments on this comment yet.