HFT affect and take advantage of minor price swings[2], and their arbitrage is based on this. Long-term investments are the primary driver of (hence) long-term price movements. After all, HFT, by definition, have no long term interests in issues, so they are (usually) equally weighted in either (long or short) direction, thus cancelling their long-term effects out, even in a situation where there are no long-term investors.
1. This pertains your comment regarding HFT. Activist investors, which you also mentioned, are just long-term investors with a marketing strategy (put your money into something and then go tell everyone), and in some cases a lobbying strategy (e.g., Bill Ackman's notable short of HLF), and they have no place being compared with HFT.
2. It is true that, sometimes, minor price swings can cause a crossing of a tipping point (e.g., below a prior price support level, etc.), but even in these cases the long-term price will adjust for these swings based on intrinsic value.
http://www.bloombergview.com/articles/2015-07-07/can-you-rea...
Essentially, if the "front-runners" (not really a correct term, since nothing illegal is going on) weren't doing this, then the index funds would have to pay a huge premium to buy large amounts of stock on extremely short notice. The "front-runners" are actually reducing the index fund's overhead costs (and, yes, being compensated by the market for doing it). They certainly aren't cheating the index fund investors out of anything, because their investments will track the market, regardless.
I know for sure though that there are fast-money guys who obsess daily about weighting momentum and turning points and they do well quite consistently.
Your big swings in share price are still going to be driven by HFT algo traders, activist investors, hedge funds, etc.
I do agree that companies in the S&P 500 have an oversized advantage in raising capital, but if you remove index funds from the picture, I think the mere existence of the index would have a similar effect (this could be researched historically, but I don't have the time/interest to do so). On the flip side, any stock in the S&P is going to have limited arbitrage opportunity due to the level of liquidity they get from index fund rebalancing, etc.; so algo traders looking at specific plays may want to find an asset with lower liquidity and fewer eyes watching it. As with anything in finance, there is a play available on both sides of the field and they tend to balance each other out.