1) You may never be rich enough to have any wealth to dispense. This is arrogance and ignorance.
2) You ignore the plight of those today. Money isn't the only way to be charitable. Time, energy, effort, and passion can be lent to charitable causes.
I have the same thought process as you, "oh I'll be rich one day and I'll be generous and give everything and make happiness, that'll be my contribution. But not now, I've got my own problems.". I think we all have a responsibility to do something for those less fortunate, those without opportunity, those suffering. A lot of my friends in college volunteered, and it really shamed me a bit into how little I do for anyone else.
That said, give now, whatever it is you want to give.
At this point, my biggest responsibility is to my family. 100% of my time and money goes to them, as it should. By making sure they are well provided for and educated properly, Im doing society a bigger favor than throwing a few bucks towards some charity every month.
Then again its a pretty common human trait to defer charitable spending to an unspecified point in the future, possibly after death.
It helps to think about it in the extreme cases. I could give all my income and time away today, but it would seriously hinder my ability to become rich later. I could also just give 1 dollar and 1 hour per year now and feel a little less guilty but it wouldn't really be helping anybody now would it.
Now perhaps there is some magical number that I should adhere to that will be the perfect mix of perserving my own time and money and helping others (and assuaging my guilt), but I think it'd be hard to pin down. That said, I'm taking the logical approach that one should aim toward giving the maximum amount of time and effort that one can possibly give. Without question that money and time comes towards the end of one's career.
To put it in perspective, the amount of money both Gates and Buffet are donating to charity not only dwarfs the amount that all of the HN users give, it makes it mathematically insignificant. In the end, we're all just buying indulgences.
Buffet is something of an outlier in his ability to maximise ROI - an average person's affordable gift of $200 now would arguably help people more if given now than given after a number of years of earning interest averaging marginally above the rate of inflation in a savings account. Sure, if you need that $200 to bootstrap the next Google it's an entirely different matter.
I take your point about mathematically insignificance in comparison to Buffet and Gates, but there's no shortage of worthwhile causes they aren't donating to where small donations can make a difference.