The immoral part is "while millions around him suffer", not "the amount of wealth one person can have," and billionaires don't actually have all that much to do with that.