If you are using an LLM to pull data out of a PDF and throw it in a database, absolutely go wild with whatever model you want.

If you are the United States and want a chatbot to help customers sign up on the Health Insurance Marketplace, you want guardrails and guarantees, even at the expense of response quality.