The inherent racism in your example notwithstanding, the two examples you chose aren't even comparable. You didn't say "a person of color" and "a white person". You said "a person of color" and a "white banker that worked at Bear Sterns". That's pure apples and oranges.
The relevant lived experience is being a banker at Bear Stearns, not the race of that banker. Also, how do I know the person of color isn't also a banker at Bear Sterns. I worked in Wall Street years ago, and yes, I had co-workers that were people of color.
No one is reducing individuals to their race or gender identity, but unless we're talking about pure science and mathematics books it is a show of ignorance to argue that lived experience has no bearing on the work of the author.
[1]http://dx.doi.org/10.1080/10511482.2013.771788