My PM is asking it questions about technical problems (like system design) preemptively and using it as a starting point as if its an engineer. So now instead of thinking through problems from a blank slate, I'm debating with ChatGPT. It's been just awful.

And what's worse, his prompts always have certain biases or misunderstandings in them. For instance, he always wants to use third-party services for everything because he thinks it means we do less work (often not the case). So ChatGPT tells him what he wants to hear. He's using it as an extra engineer who always agrees with him.