The A5 still uses 2 Cortex A9 cores. Whatever optimizations Apple has done to it will have a minimal impact on performance. The biggest gains will still be obtained on the software side.
I agree in general, though I think Apple is going to continue adding custom DSPs to their package. And that will provide an advantage in those targeted areas that software alone will not be able to bridge.
Though the shift from A8 to A9 and single to dual core and the emphasis on GPU means the CPU speed isn't the key metric it might have once been.
(EDIT: I know that a JavaScript benchmark isn't an example of this, this is more a general comment on people comment on phone specs at the moment).
It is indeed a SMP core (1-4 CPUs), which does out of order execution and register renaming. And it outperforms the Cortex-A8 (an in-order CPU) on a per-clock basis on many workloads.
But it's not an Apple part. Everyone is shipping these things now.