The rate difference only benefits hedge funds if USDJPY also plays along. That trade has fx risk and you're making it sound like a sure thing. If USDJPY goes the wrong way, the trade loses money and the average joe whose savings account is roughly flat looks pretty smart (in relative terms).