It sounds like you need an interview before the bigger interview. If the questions aren’t too in-depth, I’d say have a timed shorter talk with the candidate to weed out any you don’t think would be a good fit. Think of it as a coding exercise before coming onsite. I imagine this will save you time in the long run.