While I use ChatGPT myself, its ability to invent true-seeming information is insidious.

One of the early popular examples was asking ChatGPT what the downsides are of generics in TypeScript, and it cited that they're not compatible with some browsers/runtimes. It's entirely believable, but entirely wrong, and actually quite hard to confirm either way with internet searches. It's the sort of thing people would readily believe and pass around, though.

Similarly, when I was trying to concatenate video in ffmpeg, it produced convincing-seeming command lines, almost none of which worked properly, but almost all of which used actual ffmpeg command line parameters with appropriate-seeming formats and names. I wasted significant time on debugging those before realising quite how wrong ChatGPT was.