Low unemployment doesn't cause inflation, money supply vs supply of goods and services causes inflation. Inflation doesn't necessarily hurt the wealthy, especially asset inflation. The wealthy don't generally hold a ton of currency which is most vulnerable to inflation.