Thankfully most let you skip the UI entirely by having direct input selection IR commands. Get yourself a generic universal remote that either has these buttons, or custom ones you can program.

With this I basically never see the UI on my LG and Samsung TVs, and I certainly don't interact with it unless I need to get into settings.