Perhaps easier to conceptualize in Europe indices. Imagine European stocks go up but so does the strength of the euro vs the dollar. You, as a US resident (ok presumably) wouldn't be realizing those stock gains on the top line numbers because when you sell the position and convert back to dollars, the worse FX rate erodes your returns.

When OP talks about dollar adjusted returns of S&P, an analogous mechanism is at work.