For as little time I end up needing to use the actual UI i really don't see the issue. This isn't the first time someone has complained about it either.

Reminds me of the slightly facetious anecdote that UI/UX has actually already been perfected so the complaints and problems you hear are just UI/UX people making work for themselves.