Certainly you can only add luminance, but consider that the goggles themselves are tinted, and the brightness of a display an inch from your eye will likely be far higher than the light bouncing off the wall. So while you can't "render" black, you should be able to simulate the darker part of the spectrum using negative space. That's not ideal, of course, but it's something.