The field of statistical inference is about mathematically proving how good various statistical ideas are. It's possible to do better than just throw trial and error on a new idea.