In the majority of cases where you are deploying your java code on a server you own, having a few dozen or hundred extra classes is not a big deal. Each adds maybe a few kb to the size the jar, and as for loading costs, a class is only loaded into a running JVM once.

The cases in which to worry about stuff like this is if you need to load the code on someone else's machine, like with an applet or Android.