Some companies allow you to file an 83b election, which is to exercise all your stock immediately, and as it is worth exactly what you are paying for it, no taxable event, and then take ownership of it as it vests. A person might choose to do that because in the event of going public or any time when the common stock becomes liquid, you would only pay long term capital gains rather than short term gains. The downside is that if the company exits where the common stock is worthless (not an uncommon occurrence for startups) then you would lose that money you paid originally. (but you could write off that loss, $3,000 a year, against future income :-)
You don't, for example, usually get meaningful voting rights with those shares.
(And as kalkin observes, if you're leaving the company with in-the-money options.)
Whenever I have exercised an option, my taxes have included an AMT calculation based on adding in the difference in value between exercise price, and market price, of those options as additional ordinary income. When the AMT tax calculation yields a 'tax owed' number that is larger than the non-AMT version (which it always did when exercising shares to make down payments) the IRS asked for the bigger number. Meaning that even if I had not sold the shares I exercised, the IRS wanted me to pretend that I had and pay tax on that money that I was pretending to have received. In exchange for doing that, the tax basis becomes the market price at the time of exercise.
If you don't actually sell the stock (because, for example, you are waiting for escrow to close), and the stock value goes down significantly, you can reach a point that the value of the stock drops below the tax liability you incurred by exercising the stock option in the first place. In some cases the stock can become worthless. (my best score has been $120/share stock going down to $0.52 share) If you realize this is going to happen before the tax year is over you can dump the stock take the loss and it all works out in the wash (loss cancels gain). If you cross over a tax year boundary then you owe the tax anyway (even though you don't have a way to pay it) and when you sell the stock in the following tax year you get a 'loss' but you don't have any gains to offset that against and you can't just take it out of the taxes owed. You can however write it off, $3,000 per year against your ordinary income.