"The singularity" is science fiction. You can't just infinitely improve software on static hardware - hardware must be designed, manufactured and installed to accommodate improvements. Maybe you could have a powerful AI running as a distributed system across whole data centers, but now you're limited by transmission times etc. There's always a new bottleneck.

Actual AGI is nowhere near realism yet anyway.