"Right of Substitution is fairly clear cut: can you send someone else to do the work. Employees can't do that, so if you can, you are not an employee. However, the client has to have some say in the matter. The usual formula is along the lines of "you may send a substitute subject to the approval of the client, such approval not to be unreasonably withheld"." http://www.freelancesupermarket.com/featured-articles/the-po...
As long as he delivers what you paid for (and doesn't disclose information you deemed confidential), it should be OK for you.
Is not some minor detail. You can have a certain level of confidence that your contractor won't release confidential information because they would be subject to civil (maybe criminal) legal action.
When your contractor turns around and subs out that work to someone in another country, that threat of legal action loses quite a bit of its' bite. Sure, you could maybe still prosecute/sue your direct contractor, but you still have no real control over the outsource subcontractor.
In either scenario, the purpose of the legal action isn't for you to recoup your losses -- you probably won't. The threat of legal action is what's supposed to stop these losses from happening in the first place.
If he's subcontracted his work out to someone in another time zone everyone may get in to a spot of bother if something breaks and the person who actually did the work isn't immediately available to fix it.
That pretty much kills most subcontracting of this type.
patio11 mentions that if you try and prohibit contractors from doing this sort of thing, that contractor may be deemed an "employee" rather than a "contractor".
So rather than a prohibition in the contract, make an assertive clause. Ask your lawyer to add a "Key Personnel" clause to the contract. Also ensure that you have the right to remove any specific individual.