I'm assuming it's the later. Some applications require pretty high speed inference, like video.