As a hiring manager I never take it personally if they decline the offer before the start date. There are a few that never mention it till the starting date and at that point feel they were just hanging on for a better offer and wasted my time so personally would never hire them again in the future.