[1] Of course you also shouldn't sometimes use probabilities. If we have statistics saying that witnesses lie 15% of the time, is it helpful to present expert testimony to the effect of "there is a 15% probability the witness is lying?" Such evidence is not useful and also impinges on the fundamental right of the jury to judge witness credibility.
I don't have a problem with not using probability to model lack of knowledge, but you have to apply that principle consistently (and whether it is ethically desirable to use probability is an entirely different and even more difficult question than whether or not it leads to accurate beliefs). That said, I do prefer to use probability to model lack of knowledge, because what is the alternative? Ad hoc gut feeling based reasoning?