Some companies let you start even though the background check hasn't completed. Meaning there's a possibility company B could let you go even a week after you started, the minute they find out about your past and it's conflicting with company policy.