Assuming the compiler will generate good SSE code for the Intel CPU is a joke. If you write intrinsics for one arch, write it for both.
I'd bet money the Intel side could be made 2.5-3x faster with proper SSE intrinsics and maybe 5-6x faster with a Haswell i3 using AVX (SandyBridge doesn't have the cache bandwidth to fully utilise AVX properly).
We decided to report non-intrinsics version, because reporting the original OpenCV numbers with intrinsics as SSE optimized would be unfair to Intel. Apparently its not very well optimized.
My own guess is that if we add intrinsics for Intel to our own C code, it will boost by around 2x. We could have written a blog without reporting the Intel C optimized numbers, but that would have been unfair to Intel again.
It would be informative having the power used to process the same tasks compared.
So what was the power consumption in every reported run? What was when the i3 was underclocked?
We have applied SIMD optimizations only to ARM because thats our business. Licensing computer vision algorithms on ARM.
The blog is a by-product of that effort.
There's some evidence that the new Bay Trail Atom's should be pretty competitive against current ARM stuff.
(Then they play some what-if games by underlocking the i3 in imaginative ways and applying SIMD opts to only the ARM side)