Unless the volume is turned up annoyingly loud, I find the visuals to be the annoyingly loud part: The subdued hues of the painted walls, tile floors, and wood trim reflecting back to my eyes from the ambient lighting are invisible compared to the 500 nits of flourescent colors jump cutting back and forth.
Turning on CC but leaving the visual assault in place doesn't help my eyes much. I would feel less abused if they'd turn the screen off but leave the game audio over the radio.
If I'm just there to eat, one TV is no big deal to me, but the TV Wall is definitely a distraction.
But at least don't try to have the audio on. As technically nifty as some of the restaurants are that try to have per-table speakers or a streaming option are, CC is still less obtrusive to me.
But of course everyone's mileage will vary.
I wish more of these places would have CC on. Especially if multiple programs are on, you can't have the audio. There's a solution right there, built right in, just waiting.... page in the conversation about how accessibility can be useful to more than just the immediately disabled.