You should trust your judgement on this one, it already sounds like you’re leaning towards turning him away and just want confirmation. If he doesn’t fit your company culture why would you hire him? If he were a day to day employee, would you still hire him if he wasn’t a culture fit?