Respectfully, I disagree. If I can get the answer without having to click through to another website, I'm a happy camper.
you have option to turn it off from settings
I'm concerned regardless.
If I am paying for a product and a 90% majority of its features I don't care about and only care about 10% of it working really well I'm going to feel like I'm overpaying since I only use and care about 10% of the product, but pay for 100% of it.
And if I were a paying customer I'd keep getting more and more weary if I see the focus of the product keeps being this 90% I don't care about.
A search engine should show web results based on my query. That's it. Some summaries and highlights are useful, but show them in the sidebar, and make them optional.
If I need a calculator, I have plenty to choose from, including the Wolphram Alpha site.
If I need an answer to a question, LLMs do a good job at that.
Please don't make the common mistake of making your search engine "useful". My average session on your site should last seconds, which is the time it takes me to see the results, and click on the most relevant one. If you achieve that, you're doing a great job.