Real problems in the wild are a mix of both types of problem, and intractable part and a part you can do precisely.
In an ideal world you would use the iterative methods ONLY for the parts that don't have an exact solution available. In practice once you have developed the general iterative solution, you might as well just use that for the easy parts too, as you are just burdening yourself with more development work and more scope for bugs by writing two inference implementations.
A language that allowed inference to be switched at no development cost it would be amazing
Both of those result in the potential for greater confidence in the accuracy of conclusions reached from experimental analysis.
As a secondary point, re-implementing inference code for each new model makes it almost certain that there are bugs in said code. So even without changing the model, automatically generated inference code is likely to have fewer bugs and thus give more accurate inferences than hand-written code. (assuming it runs to convergence; naturally there are lots of scenarios in which naively generated code will be slower to converge than something hand-tuned).
What does a compiler-level implementation of probabilistic analysis have to do with accuracy?