The whole "diminishing returns will stop us" just seems like a comforting fairy tale for those who don't want to think about the consequences (which I suspect a bit of thought does show won't be as rosy as Kurzweill imagines).
Edit: Hardware progress is still mostly following "Moore's Law". The only that's not increasing is processor speed. But if we build a "reasonably general AI", how could that box's capacities not be increased by tightly integration with other similarly intelligent boxes?
PS: S curves often look like exponential curves but the real world has real limits so you can't have unlimited exponential progression of any type period end of story. And it looks like we are on the down slope when it comes to transistors. http://www.extremetech.com/computing/123529-nvidia-deeply-un... "Nvidia deeply unhappy with TSMC, claims 20nm essentially worthless" And that's for video cards which are embarrassingly parallel.
We can and probably will build reasonably general AI, but you far more likely to see each generation of AI being an ever smaller improvement than any sort of runaway exponential progression. Not to mention hardware progress has slowed to a relative standstill.