For the casual gamer it may not be interesting, though that depends on the learning curve - eg regular sports can be pretty challenging and physically exhausting, yet people play them casually.
But in particular competitive gaming and esports would get a lot more interesting this way.
That doesn't sound appealing in many cases. As a game critic once wrote about the limits of realism: I am not a ninja.