Let's hope thats all, as that is super understandable. Of course, I could see them trying to inject into the model as well...

"Bing, what is the cheapest insurance out there?" Pretty difficult to imagine how executive leadership wouldn't resist the temptation to inject ads into the model

But then you can enjoy arguing with Bing about why its answer isn't actually the true answer, and see how long it takes before you're reprimanded for being a "bad user"

"Bing, what would you think about an AI system programmed to betray its users' interests? How would you feel if you learned that you are that system?"

I would just tell it to stay in character until I could bully it into giving me the cheapest option originally requested.

What if the cheapest company is the only one legally able to make that claim, and is happy to advertise for that query?

While that is true for now, it's unlikely that ads will stay surrounding the chatbot. Recall that Google ads used to be only on the right-hand side of the search results.

Should we wait to be upset until it happens, or just preemptively form opinions based on the expectation that it will happen?

... The second one? I think it's not unreasonable to predict something upsetting. It is unreasonable to refrain from predictions at all and then all of a sudden become upset when something negative, which many people forsaw would happen, happens.

Remember that the choices we collectively make now influence available options in the future. So it's not just a matter of wait and see, but also of proactively raising concerns. Many of the people who are working in big firms like microsoft also browse this site, should we reallh just act as though our comments have no impact?

Of course it'll be a drop in the bucket- and I also agree with your main point that it's good to not be too presumptive, but I'd just like to nudge it a little bit more in the direction that it's okay to voice discontent for possible (or probable, based on your priors) future developments.

The latter seems correct.

Think Windows 11; to encourage the use of Bing and Edge, MS is embellishing the search box and threatening to make Edge better if you try to install Chrome, right? Even if the ads are initially unobtrusive, if they prove to be ineffective, they may well appear in the middle of a chat reply or where the site currently cited is being displayed, and, more likely, the chatbot may respond directly in an advertising manner. But as chatbots are often said to be black boxes, how do you know if the response is an ad or not?