That speed improvement is assuming that people are actually browsing around your app/site. Which might or might not be true depending on what your are building.

This is one of the reason why I really dislike most news sites or blogs using SPAs. I usually get to a page via direct link and leave immediately after reading. But every time i have to stare at a spinner or coloured progress bar until the styled plain text finally is revealed to me.