Don't base a significant career move based on other peoples perception of the companies involved.

Choose the company that will offer you the best long term prospects and variety.