No different from the firm rescinding the offer once the candidate has turned down all his others. Plus it's asymmetric, the firm has other staff that can somewhat do the work, the employee has no income if the job is rescinded.