I’m not sure if you’re aware, but Apple just last week updated the remote to address those criticisms. The new remote is compatible with old Apple TV hardware.

There are directional buttons, trackpad swipes, and a classic iPod-like fast forward and rewind touch gesture. Mute button and TV power buttons now included.