Ultimately you have to build within your sphere of competence. If you have a well-established but inefficient manual process, it may sometimes be the case that burning it down and replacing it with a tech-driven approach might be the best way forward.

But if you are trying to solve a novel problem, and the proposed solution involves "ML will magically predict the future", you'd better have a very good idea of exactly how the problems will be solved, or else you're probably better off starting with good old-fashioned human intelligence.