I also noticed it when I play AoE: 2 DE as I only play multiplayer game. I initially thought it's just because there aren't enough players so they match us with someone else much higher. However I only notice it in Quick Play where ELO is not affected instead of Ranked games.