I think you hit the nail on the head. I prefer the look of dark mode, but because many UI elements don't support it, I stick to light mode across the board and lower brightness. There is no brightness level that is appropriate for a random mix of bright and dark mode, and trying to find one is worse than going all in on either.