Re:AI is becoming 'yes-men on servers'
by robwwilliams on Monday March 10, 2025 @10:26PM
(#43328546)
This costs them money, but perhaps keeps VCs happy to see heavy (but vacuous) engagement.
It could be quite accidental and not pre-concieved though. Where some metric, "time spent in chats" drives certain features or parameters. Could be fully automated (i.e. continuous A/B tests) or through layers of "Excel managers".
But it stands to reason that a company like OpenAI or Anthropic has metrics in place that drive their setup towards "more engagement" and away from "factually correct".
You may think that kind of interaction is weird, but were in the thick of a loneliness epidemic, and its not a stretch to think some may actually wilfully socialise with an LLM.
As an aside...my sister works in medicine, and her boss (specialist surgeon) finishes a $450 consultation which followed him telling my sister "but deepseek says x,y,z..."