Well, one could argue that they are just smarter than other people and manage to find market opportunities. Good for them I guess. But technically since it’s mostly a zero-sum game would it be wrong to consider that they use their smarts to deprive other people of value?

Do you really need me to explain why fraud is wrong? Fraud is wrong because you're betraying someone's trust. It's bad for society because it adds friction to business dealings. When you can't trust your counterparty, you have to expend tons of money doing due diligence. This is true regardless if you're smart or not. Being the smartest person in the world isn't going to help you if you're being deceived (assuming you're not omnipresent).

*Omniscient

Though I guess it might be hard to deceive an entity that is literally everywhere.

This is also the case I make against bitcoin re: the value of trust.