A solution used in many countries including some definitely first-world countries (Japan, Germany, France, Sweden) is to have a mix of professional judges and lay judges. Seems that it preserves the benefits you talk about, at the same time fixing a lot of the problems we see with jury incompetence.