Human trials do not exist solely because of the uncertainty, but it is true that a medicine with a significant effect could be accepted after heavily shortened trials. If AI hypothetically invents a cure for a serious disease that immediately works for virtually everyone that takes it, there is no way how the trials would take years. They only take years because the effects tend to be "we decreased mortality from 80% to 70%", and it takes a lot of time to confirm that.