We built GPU-accelerated NoSQL datastore. using it, this can be accelerated 100x, given you switch to binary pixel format.

Why would you use a GPU-accelerated storage when latency is the main goal?

GPU do not accelerate raw storage retrieval, but processing, like queries and map reduce.

Use APU / HPU, if PCIe latency is a problem.

I understood that they running something like convolution (I.e, each pixel calculated from surrounding pixels) - this will be fast using OpenCL model).