News for hackers. Stuff that matters.
Re:We improved Tensorflow Serving performance by over 70% by solidasparagus on Tuesday March 26, 2019 @08:39AM (#19491179)
Cool work! It feels like the improvement is a little overstated due to how you're measuring - your measurements include import/setup time so you get big gains by improving imports. But in reality, you won't be creating a new client for each request and client import/setup time is unrelated to TF serving performance. TF serving performance is really about the time elapsed between request received and response returned.

There are no comments on this comment yet.