On the contrary, of you requested billionaires to NOT cause harm by using their disproportionate wealth, that'd be a sound argument. For instance, Gawker's takeover by Thiel seems to border on the illegal.
Then there's the whole concept of community. The Mormon church, for instance, raises more in charity than the net worth of many billionaires. If you truly want to help the poor, enable them to help themselves. Or, collectively raise enough for charity, like the Mormon church. Taxing the fuck out of people, and enabling a lobbied-to-death politician to spend the said tax on any whimsical thing has NEVER worked out in history.
If you want to start dragging historical examples into the discussion, the Hoover years pretty well discredited the idea that voluntarism and charity were sufficient means to deal with privation.
What you are suggesting is an ultra high tax rate on the wealthy and that's proven over and over to not work out. Italy, France and Spain for instance, have a pivoted to a socialistic society that punishingly taxes the rich to the point of driving the ambitious and successful out of the country. While these countries produced some of the most iconic companies and individuals in the early 1900s, it's no coincidence that a Google, Microsoft, etc hasn't emerged from there.
The world's richest man (adjusted for inflation), Bill Gates has donated over $18B in philanthropy. His management of money that can potentially help the needy has been far superior to any elected political figure or government organisation. Don't enable politicians with power over (your) tax money, their only aim is to get reelected - not to serve society. Enables another Bill Gates it Zuckerberg, who've both pledged 99% of their wealth to charity. Heck, enable a Peter Theil to fund the next Facebook and create billions in wealth, jobs and taxes.