Someone who knows how to solve problems and can also code, but I feel I can get a good feel of that from the other tests we give. We also have a problem solving test with a real example we dealt with that is simple enough to understand and is another good filter.

The first coding tests proves they can at least string together a bit of code, explain it, and make minor changes to it. The problem solving test proves they can think critically and understand a new problem and offer solutions to it. Lastly, we have a debugging test where they have to fix existing code with a handful of bugs. Between these and the conversations we have have with applicants we have (so far) a very good success rate in hiring.