News for hackers. Stuff that matters.
Re:We improved Tensorflow Serving performance by over 70% by bitL on Tuesday March 26, 2019 @04:34AM (#19490081)
Inference is not that super slow on CPU, especially for network requests that already have quite a bit of latency, so plenty of companies use CPUs on the cloud for lambda/flexible loads where GPUs aren't available.

There are no comments on this comment yet.