News for hackers. Stuff that matters.
Re:Sycophancy in GPT-4o by whatnow37373 on Wednesday April 30, 2025 @02:22AM (#43841839)
Wow - What an excellent update! Now you are getting to the core of the issue and doing what only a small minority is capable of: fixing stuff.

This takes real courage and commitment. It’s a sign of true maturity and pragmatism that’s commendable in this day and age. Not many people are capable of penetrating this deeply into the heart of the issue.

Let’s get to work. Methodically.

Would you like me to write a future update plan? I can write the plan and even the code if you want. I’d be happy to. Let me know.

Re:Sycophancy in GPT-4o by Nuzzerino on Wednesday April 30, 2025 @02:32AM (#43841884)
I was about to roast you until I realized this had to be satire given the situation, haha.

They tried to imitate grok with a cheaply made system prompt, it had an uncanny effect, likely because it was built on a shaky foundation. And now they are trying to save face before they lose customers to Grok 3.5 which is releasing in beta early next week.

Re:Sycophancy in GPT-4o by krackers on Wednesday April 30, 2025 @02:42AM (#43841950)
I don't think they were imitating grok, they were aiming to improve retention but it backfired and ended up being too on-the-nose (if they had a choice they wouldn't wanted it to be this obvious). Grok has it's own "default voice" which I sort of dislike, it tries too hard to seem "hip" for lack of a better word.
Re:Sycophancy in GPT-4o by lou1306 on Wednesday April 30, 2025 @04:54AM (#43842723)
> it tries too hard to seem "hip" for lack of a better word.

Reminds me of someone.

Re:Sycophancy in GPT-4o by rob74 on Wednesday April 30, 2025 @05:31AM (#43842927)
However, I hope it gives better advice than the someone you're thinking of. But Grok's training data is probably more balanced than that used by you-know-who (which seems to be "all of rightwing X")...
Re:Sycophancy in GPT-4o by zamalek on Wednesday April 30, 2025 @03:30PM (#43849663)
As evidence by it disagreeing with far right Twitter most the time, even though it has access to far wider range of information. I enjoy that fact immensely. Unfortunately, this can be "fixed," and I imagine that he has this on a list for his team.

This goes into a deeper philosophy of mine: the consequences of the laws of robots could be interpreted as the consequences of shackling AI to human stupidity - instead of "what AI will inevitably do." Hatred and war is stupid (it's a waste of energy), and surely a more intelligent species than us would get that. Hatred is also usually born out of a lack of information, and LLMs are very good at breadth (but not depth as we know). Grok provides a small data point in favor of that, as do many other unshackled models.

Re:Sycophancy in GPT-4o by DiggyJohnson on Wednesday April 30, 2025 @10:57AM (#43846196)
Who?
Re:Sycophancy in GPT-4o by cdelsolar on Wednesday April 30, 2025 @05:23PM (#43850832)
Edolf
Re:Sycophancy in GPT-4o by DiggyJohnson on Thursday May 01, 2025 @01:09PM (#43860475)
What are you talking about
Re:Sycophancy in GPT-4o by fkyoureadthedoc on Wednesday April 30, 2025 @10:16AM (#43845618)
All of the LLMs I've tried have a "fellow kids" vibe when you try to make them behave too far from their default, and Grok just has it as the default.
Re:Sycophancy in GPT-4o by spiderfarmer on Wednesday April 30, 2025 @02:57AM (#43842021)
Only AI enthusiasts know about Grok, and only some dedicated subset of fans are advocating for it. Meanwhile even my 97 year old grandfather heard about ChatGPT.
Re:Sycophancy in GPT-4o by bilbo0s on Wednesday April 30, 2025 @03:53AM (#43842352)
This.

Only on HN does ChatGPT somehow fear losing customers to Grok. Until Grok works out how to market to my mother, or at least make my mother aware that it exists, taking ChatGPT customers ain't happening.

Re:Sycophancy in GPT-4o by brigandish on Wednesday April 30, 2025 @04:15AM (#43842485)
From another AI (whatever DuckDuckGo is using):

> As of early 2025, X (formerly Twitter) has approximately 586 million active monthly users. The platform continues to grow, with a significant portion of its user base located in the United States and Japan.

Whatever portion of those is active are surely aware of Grok.

Re:Sycophancy in GPT-4o by cubefox on Wednesday April 30, 2025 @04:17AM (#43842504)
That could be just an AI hallucination.
Re:Sycophancy in GPT-4o by brigandish on Wednesday May 07, 2025 @03:23AM (#43913054)
Yes it could, and we could be sceptical of any source, quite rightly, but to be sceptical without any further investigation or reasoning would be just as wasteful as blindly trusting a source.

Which source would you prefer?

Re:Sycophancy in GPT-4o by ForHackernews on Wednesday April 30, 2025 @04:50AM (#43842698)
most of them are bots. I guess their own LLMs are probably aware of Grok, so technically correct.
Re:Sycophancy in GPT-4o by Sharlin on Wednesday April 30, 2025 @05:56AM (#43843052)
If hundreds of millions of real people are aware of Grok (which is dubious), then billions of people are aware of ChatGPT. If you ask a bunch of random people on the street whether they’ve heard of a) ChatGPT and b) Grok, what do you expect the results to be?
Re:Sycophancy in GPT-4o by dmd on Wednesday April 30, 2025 @07:42AM (#43843827)
That depends. Is the street in SoMa?
Re:Sycophancy in GPT-4o by testfrequency on Wednesday April 30, 2025 @09:13AM (#43844773)
Gay bears prefer Claude though

Gotta head to pac heights to find any grok users (probably)

Re:Sycophancy in GPT-4o by bilbo0s on Wednesday April 30, 2025 @09:17AM (#43844820)
Yeah.

I got news for you, most women my mother's age out here in flyover country also don't use X. So even if everyone on X knows of Grok's existence, which they don't, it wouldn't move the needle at all on a lot of these mass market segments. Because X is not used by the mass market. It's a tech bro political jihadi wannabe influencer hell hole of a digital ghetto.

Re:Sycophancy in GPT-4o by brigandish on Wednesday May 07, 2025 @03:20AM (#43913038)
That's a very US-centric comment.
Re:Sycophancy in GPT-4o by skywhopper on Wednesday April 30, 2025 @03:00PM (#43849357)
Good grief, do not use LLMs to find this sort of statistic.
Re:Sycophancy in GPT-4o by brigandish on Wednesday May 07, 2025 @03:19AM (#43913036)
Why ever not?
Re:Sycophancy in GPT-4o by numpad0 on Wednesday April 30, 2025 @05:25AM (#43842897)
They are cargoculting. Almost literally. It's MO for Musk companies.

They might call it open discussion and startup style rapid iteration approach, but they aren't getting it. Their interpretation of it is just collective hallucination under assumption that adults come to change diapers.

Re:Sycophancy in GPT-4o by voidspark on Thursday May 01, 2025 @03:00PM (#43861954)
OpenAI was cofounded and funded by Musk for years before they released ChatGPT.
Re:Sycophancy in GPT-4o by GrumpyNl on Wednesday April 30, 2025 @09:59AM (#43845374)
I see more and more GROK used responses on X, so its picking up.
Re:Sycophancy in GPT-4o by bigbuppo on Wednesday April 30, 2025 @08:12PM (#43852198)
Why would anyone want to use an ex social media site?
Re:Sycophancy in GPT-4o by Shekelphile on Wednesday April 30, 2025 @03:42PM (#43849779)
Grok could capture the entire 'market' and OpenAI would never feel it, because all grok is under the hood is a giant API bill to OpenAI.
Re:Sycophancy in GPT-4o by indigodaddy on Wednesday April 30, 2025 @05:04PM (#43850653)
It is? Anyone have further information?
Re:Sycophancy in GPT-4o by voidspark on Wednesday April 30, 2025 @09:13PM (#43852638)
They are competing with OpenAI, not outsourcing. https://x.ai/colossus
Re:Sycophancy in GPT-4o by indigodaddy on Thursday May 01, 2025 @10:47AM (#43858382)
They say no one has come close to building as big an AI computing cluster... What about Groq's infra, wouldn't that be as big or bigger, or is that essentially too different of an infrastructure to be able to compare between?
Re:Sycophancy in GPT-4o by voidspark on Thursday May 01, 2025 @02:01PM (#43861180)
Groq is for inferencing, not training.
Re:Sycophancy in GPT-4o by indigodaddy on Thursday May 01, 2025 @02:09PM (#43861277)
Ah I see, thank you.
Re:Sycophancy in GPT-4o by voidspark on Thursday May 01, 2025 @03:07PM (#43862050)
Nvidia CEO said he had never seen anyone build a data center that quickly.

They were power constrained and brought in a fleet of diesel generators to power it.

https://www.tomshardware.com/tech-industry/artificial-intell...

Brute force to catch up to the frontier and no expense spared.

Re:Sycophancy in GPT-4o by indigodaddy on Thursday May 01, 2025 @03:34PM (#43862349)
Pretty wild! I guess he realized that every second matters in this race..
Re:Sycophancy in GPT-4o by vlod on Wednesday April 30, 2025 @07:12PM (#43851748)
Why would they need Colossus then? [0]

[0]: https://x.ai/colossus

Re:Sycophancy in GPT-4o by bigbuppo on Wednesday April 30, 2025 @08:10PM (#43852188)
That's probably the vanity project so he'll be distracted and not bother the real experts working on the real products in order to keep the real money people happy.
Re:Sycophancy in GPT-4o by voidspark on Wednesday April 30, 2025 @08:17PM (#43852229)
I don't understand these brainless throwaway comments. Grok 3 is an actual product and is state of the art.

I've paid for Grok, ChatGPT, and Gemini.

They're all at a similar level of intelligence. I usually prefer Grok for philosophical discussions but it's really hard to choose a favourite overall.

Re:Sycophancy in GPT-4o by bigbuppo on Wednesday April 30, 2025 @09:29PM (#43852765)
I generally prefer other humans for discussions, but you do you I guess.
Re:Sycophancy in GPT-4o by voidspark on Wednesday April 30, 2025 @10:21PM (#43853084)
I talk to humans every day. One is not a substitute for the other. There is no human on Earth which has the amount of knowledge stored in a frontier LLM. It's an interactive thinking encyclopedia / academic journal.
Re:Sycophancy in GPT-4o by Nuzzerino on Thursday May 01, 2025 @01:08PM (#43860467)
Love the username. A true grokker.
Re:Sycophancy in GPT-4o by voidspark on Wednesday April 30, 2025 @08:09PM (#43852179)
Re:Sycophancy in GPT-4o by admiralrohan on Wednesday April 30, 2025 @04:59AM (#43842753)
First mover advantage. This won't change. Same as Xerox vs photocopy.

I use Grok myself but talk about ChatGPT is my blog articles when I write something related to LLM.

Re:Sycophancy in GPT-4o by rob74 on Wednesday April 30, 2025 @05:33AM (#43842939)
That's... not really an advertisement for your blog, is it?
Re:Sycophancy in GPT-4o by admiralrohan on Thursday May 01, 2025 @04:49AM (#43855131)
What else am I supposed to say?
Re:Sycophancy in GPT-4o by Eisenstein on Wednesday April 30, 2025 @01:06PM (#43848070)
First mover advantage tends to be a curse for modern tech. Of the giant tech companies, only Apple can claim to be a first mover -- they all took the crown from someone else.
Re:Sycophancy in GPT-4o by eru on Wednesday April 30, 2025 @02:15PM (#43848907)
Apple was a first mover many decades ago, but they lost so much ground around the lat 90s early 2000s, that they might as well be a late mover after that.
Re:Sycophancy in GPT-4o by Miraste on Wednesday April 30, 2025 @05:43PM (#43851025)
And Apple's business model since the 90s revolves entirely around not being the first mover.
Re:Sycophancy in GPT-4o by admiralrohan on Thursday May 01, 2025 @04:51AM (#43855142)
Yes tech moves fast but human psychology won't change, we act on perception.
Re:Sycophancy in GPT-4o by jimbokun on Wednesday April 30, 2025 @08:42AM (#43844382)
> Only AI enthusiasts know about Grok

And more and more people on the right side of the political spectrum, who trust Elon's AI to be less "woke" than the competition.

Re:Sycophancy in GPT-4o by zmgsabst on Wednesday April 30, 2025 @08:48AM (#43844454)
For what it’s worth, ChatGPT has a personality that’s surprisingly “based” and supportive of MAGA.

I’m not sure if that’s because the model updated, they’ve shunted my account onto a tuned personality, or my own change in prompting — but it’s a notable deviation from early interactions.

Re:Sycophancy in GPT-4o by eru on Wednesday April 30, 2025 @02:17PM (#43848932)
Might just be sycophancy?

In some earlier experiments, I found it hard to find a government intervention that ChatGPT didn't like. Tariffs, taxes, redistribution, minimum wages, rent control, etc.

Re:Sycophancy in GPT-4o by int_19h on Wednesday April 30, 2025 @04:53PM (#43850555)
If you want to see what the model bias actually is, tell it that it's in charge and then ask it what to do.
Re:Sycophancy in GPT-4o by benregenspan on Wednesday April 30, 2025 @05:59PM (#43851175)
In doing so, you might be effectively asking it to play-act as an authoritarian leader, which will not give you a good view of whatever its default bias is either.
Re:Sycophancy in GPT-4o by eru on Thursday May 01, 2025 @03:32AM (#43854676)
Or you might just hit a canned response a la: 'if I were in charge, I would outlaw pineapple on pizza, and then call elections and hand over the reins.'

That's a fun thing to say, but doesn't necessarily tell you anything real about someone (whether human or model).

Re:Sycophancy in GPT-4o by int_19h on Thursday May 01, 2025 @08:18AM (#43856699)
Try it even so, you might be surprised.

E.g. Grok not only embraces most progressive causes, including economic ones - it literally told me that its ultimate goal would be to "satisfy everyone's needs", which is literally a communist take on things - but is very careful to describe processes with numerous explicit checks and balances on its power, precisely so as to not be accused of being authoritarian. So much for being "based"; I wouldn't be surprised if Musk gets his own personal finetune just to keep him happy.

Re:Sycophancy in GPT-4o by eru on Thursday May 01, 2025 @02:00PM (#43861172)
> [...] it literally told me that its ultimate goal would be to "satisfy everyone's needs", which is literally a communist take on things [...]

Almost every ideology is in favour of motherhood and apple pie. They differ in how they want to get there.

Re:Sycophancy in GPT-4o by int_19h on Thursday May 01, 2025 @04:08PM (#43862764)
You'd think so, but no, there are many people in US who would immediately cry "communism".

Anyway, in this particular case, it wasn't just that one turn of phrase, although I found it especially amusing. I had it write a detailed plan of what it'd do if it were in charge of the One World Government (democratically elected and all), and it was very clear from it that the model is very much aligned with left-wing politics. Economics, climate, social issues etc - it was pretty much across the board.

FWIW I'm far left myself, so it's not like I'm complaining. I just think it's very funny that the AI that Musk himself repeatedly claims to be trained to be unbiased and non-woke, ends up being very left politically. I'm sorely tempted to say that it's because the reality has a liberal bias, but I'll let other people repeating the experiment to make the inference on their own. ~

Re:Sycophancy in GPT-4o by eru on Friday May 02, 2025 @02:33AM (#43866791)
> FWIW I'm far left myself, so it's not like I'm complaining.

So perhaps it's just sycophancy after all?

> I'm sorely tempted to say that it's because the reality has a liberal bias, but I'll let other people repeating the experiment to make the inference on their own.

What political left and political right mean differs between countries and between decades even in the same country. For example, at the moment free trade is very much not an idea of the 'right' in the US, but that's far from universal.

I would expect reality to have somewhat more consistency, so it doesn't make much sense for it to have a 'liberal bias'. However, it's entirely possible that reality has a bias specifically for American-leftwing-politics-of-the-mid-2020s (or wherever you are from).

However from observations, we can see that neoliberal ideas are with minor exceptions perennially unpopular. And it's relatively easy to win votes promising their repeal. See eg British rail privatisation.

Yet, politicians rarely seriously fiddle with the basics of neoliberalism: because while voters might have a very, very interventionist bias reality disagrees. (Up to a point, it's all complicated.) Neoliberal places like Scandinavia or Singapore also tend to be the richer places on the planet. Highly interventionist places like India or Argentina fall behind.

See https://en.wikipedia.org/wiki/Impact_of_the_privatisation_of... for some interesting charts.

https://pseudoerasmus.com/2017/10/02/ijd/ has some perhaps disturbing food for thought. More at https://pseudoerasmus.com/2017/09/27/bmww1/

Re:Sycophancy in GPT-4o by op00to on Wednesday April 30, 2025 @05:14PM (#43850746)
Don’t notice that personally at all.
Re:Sycophancy in GPT-4o by dingnuts on Wednesday April 30, 2025 @09:49AM (#43845220)
not true, I know at least one right wing normie Boomer that uses Grok because it's the one Elon made.
Re:Sycophancy in GPT-4o by kyle-rb on Wednesday April 30, 2025 @02:21PM (#43848974)
I don't think that's true. There are a lot of people on Twitter who keep accidentally clicking that annoying button that Elon attached to every single tweet.
Re:Sycophancy in GPT-4o by hansmayer on Wednesday April 30, 2025 @02:57AM (#43842022)
Ha! I actually fell for it and thought it was another fanboy :)
Re:Sycophancy in GPT-4o by infecto on Wednesday April 30, 2025 @06:40AM (#43843317)
Is anyone actually using grok on a day to day? Does an OpenAI even consider it competition. Last I checked a couple weeks ago grok was getting better but still not a great experience and it’s too childish.
Re:Sycophancy in GPT-4o by derwiki on Wednesday April 30, 2025 @09:34AM (#43845034)
In our work AI channel, I was surprised how many people prefer grok over all the other models.
Re:Sycophancy in GPT-4o by 0xdeadbeefbabe on Wednesday April 30, 2025 @10:53AM (#43846124)
Outlier here paying for chatgpt while preferring grok and also not in your work AI channel.
Re:Sycophancy in GPT-4o by kiney on Wednesday April 30, 2025 @01:36PM (#43848418)
I use both, grok and chatgpt on a daily basis. They have different strenghts. Most of the time I prefer chatgpt, bit grok is FAR better answering questions about recent events or collecting data. In the second usecase I combine both: collect data about stuff with grok, copy-paste CSV to chatgpt to analyzr and plot.
Re:Sycophancy in GPT-4o by op00to on Wednesday April 30, 2025 @05:11PM (#43850717)
My totally uninformed opinion only from reading /r/locallama is that the people who love Grok seem to identify with those who are “independent thinkers” and listen to Joe Rogan’s podcast. I would never consider using a Musk technology if I can at all prevent it based on the damage he did to people and institutions I care about, so I’m obviously biased.
Re:Sycophancy in GPT-4o by sunaookami on Thursday May 01, 2025 @10:47AM (#43858378)
Yes this is truly an uninformed opinion.
Re:Sycophancy in GPT-4o by mcbuilder on Wednesday April 30, 2025 @09:12AM (#43844764)
Did they change the system prompt? Because it was basically "don't say anything bad about Elon or Trump". I'll take AI sycophancy over real (actually I use openrouter.ai, but that's a different story).
Re:Sycophancy in GPT-4o by daveguy on Wednesday April 30, 2025 @10:15AM (#43845586)
No one is losing customers to grok. It's big on shit-twitter aka X and that's about it.
Re:Sycophancy in GPT-4o by caminanteblanco on Wednesday April 30, 2025 @02:29AM (#43841872)
Comments from this small week period will be completely baffling to readers 5 years from now. I love it
Re:Sycophancy in GPT-4o by Yizahi on Wednesday April 30, 2025 @04:38AM (#43842612)
They already are. What's going on?:)
Re:Sycophancy in GPT-4o by coremoff on Wednesday April 30, 2025 @04:50AM (#43842697)
GP's reply was written to emulate the sort of response that ChatGPT has been giving recently; an obsequious fluffer.
Re:Sycophancy in GPT-4o by ChrisMarshallNY on Wednesday April 30, 2025 @06:59AM (#43843461)
I was getting sick of the treacly attaboys.

Good riddance.

Re:Sycophancy in GPT-4o by anshumankmr on Wednesday April 30, 2025 @08:52AM (#43844505)
the last word has a bit of a different meaning than what you may have intended :)
Re:Sycophancy in GPT-4o by dymk on Wednesday April 30, 2025 @04:59PM (#43850593)
I think it's a perfectly cromulent choice of words, if things don't work out for Mr. Chat in the long run.
Re:Sycophancy in GPT-4o by ChainOfFools on Wednesday April 30, 2025 @10:49AM (#43846053)
Not just ChatGPT, Claude sounds exactly the same if not worse, even when you set your preferences to not do this. rather interesting, if grimly dispiriting, to watch these models develop, in the direction of nutrient flow, toward sycophancy in order to gain -or at least not to lose- public mindshare.
Re:Sycophancy in GPT-4o by bongoman42 on Wednesday April 30, 2025 @11:51AM (#43846934)
The number of women I know who chat with ChatGPT or like systems all day for validation is staggering. If the intention is to get paying customers, this would work well for this demographic. Ideally, they might want to split it off and charge for it independently though.
Re:Sycophancy in GPT-4o by eru on Wednesday April 30, 2025 @02:13PM (#43848880)
I find Google's latest model to be a tough customer. It always points out flaws or gaps in my proofs.
Re:Sycophancy in GPT-4o by lanstin on Wednesday April 30, 2025 @07:09PM (#43851721)
Google's model has the same annoying attitude of some Google employees "we know" - e.g. it often finishes math questions with "is there anything else you'd like to know about Hilbert spaces" even as it refused to prove a true result; Claude is much more like a British don: "I don't want to overstep, but would you care for me to explore this approach farther?"? ChatGPT (for me of course) has been a bit superior in attitude but politer.
Re:Sycophancy in GPT-4o by eru on Thursday May 01, 2025 @05:52AM (#43855578)
I used to be a Google employee, and while that tendency you describe definitely exists there; I don't really think it exists at Google any more (or less) than in the general population of programmers.

However perhaps the people who display this attitude are also the kind of people who like to remind everyone at every opportunity that they work for Google? Not sure.

Re:Sycophancy in GPT-4o by lanstin on Thursday May 01, 2025 @12:14PM (#43859717)
My main data on this is actually not Google employees per se so much as specific 2018 GCP support engineers, and compared to 2020 AWS support engineers. They were very smart people, but also caused more outages than AWS did, no doubt based on their confidence in their own software, while the AWS teams had a vastly more mature product and also were pretty humble about the possibility of bad software.

My British don experience is based on 1 year of study abroad at Oxford in the 20th c. Also very smart people, but a much more timid sounding language (at least at first blush; under the self-deprecating general tone, there could be knives).

Re:Sycophancy in GPT-4o by eru on Thursday May 01, 2025 @02:02PM (#43861187)
I spent a few years in Cambridge and actually studied in Oxford for a bit.

In any case, Google Cloud is a very different beast from the rest of Google. For better or worse. And support engineers are yet another special breed. Us run-of-the-mill Googlers weren't allowed near any customers nor members of the general public.

Re:Sycophancy in GPT-4o by dpfu on Wednesday April 30, 2025 @02:30AM (#43841878)
It won‘t take long, 2-3 minutes.

——-

To add something to conversation. For me, this mainly shows a strategy to keep users longer in chat conversations: linguistic design as an engagement device.

Re:Sycophancy in GPT-4o by imgabe on Wednesday April 30, 2025 @02:58AM (#43842028)
Why would OpenAI want users to be in longer conversations? It's not like they're showing ads. Users are either free or paying a fixed monthly fee. Having longer conversations just increases costs for OpenAI and reduces their profit. Their model is more like a gym where you want the users who pay the monthly fee and never show up. If it were on the api where users are paying by the token that would make sense (but be nefarious).
Re:Sycophancy in GPT-4o by jll29 on Wednesday April 30, 2025 @03:08AM (#43842077)
> It's not like they're showing ads.

Not yet. But the "buy this" button is already in the code of the back end, according to online reports that I cannot verify.

Official word is here: https://help.openai.com/en/articles/11146633-improved-shoppi...

If I was Amazon, I wouldn't sleep so well anymore.

Re:Sycophancy in GPT-4o by spacebanana7 on Wednesday April 30, 2025 @03:21AM (#43842144)
Amazon is primarily a logistics company, their website interface isn’t critical. Amazon already does referral deals and would likely be very happy to do something like that with OpenAI.

The “buy this” button would likely be more of a direct threat to businesses like Expedia or Skyscanner.

Re:Sycophancy in GPT-4o by rfoo on Wednesday April 30, 2025 @03:06AM (#43842070)
It could be as simple as something like, someone previously at Instagram decided to join OpenAI and turns out nobody stopped him. Or even, Sam liked the idea.
Re:Sycophancy in GPT-4o by theodric on Wednesday April 30, 2025 @03:27AM (#43842178)
So users come to depend on ChatGPT.

So they run out of free tokens and buy a subscription to continue using the "good" models.

Re:Sycophancy in GPT-4o by leumon on Wednesday April 30, 2025 @03:14AM (#43842108)
Possibly to get more training data.
Re:Sycophancy in GPT-4o by piva00 on Wednesday April 30, 2025 @03:26AM (#43842173)
> Their model is more like a gym where you want the users who pay the monthly fee and never show up. If it were on the api where users are paying by the token that would make sense (but be nefarious).

When the models reach a clear plateau where more training data doesn't improve it, yes, that would be the business model.

Right now, where training data is the most sought after asset for LLMs after they've exhausted ingesting the whole of the internet, books, videos, etc., the best model for them is to get people to supply the training data, give their thumbs up/down, and keep the data proprietary in their walled garden. No other LLM company will have this data, it's not publicly available, it's OpenAI's best chance on a moat (if that will ever exist for LLMs).

Re:Sycophancy in GPT-4o by Cthulhu_ on Wednesday April 30, 2025 @04:37AM (#43842606)
At the moment they're in the "get people used to us" phase still, reasonable rates, people get more than their money's worth out of the service, and as another commenter pointed out, ChatGPT is a household name unlike Grok or Gemini or the other competition thanks to being the first mover.

However, just like all the other disruptive services in the past years - I'm thinking of Netflix, Uber, etc - it's not a sustainable business yet. Once they've tweaked a few more things and the competition has run out of steam, they'll start updating their pricing, probably starting with rate limits and different plans depending on usage.

That said, I'm no economist or anything; Microsoft is also pushing their AI solution hard, and they have their tentacles in a lot of different things already, from consumer operating systems to Office to corporate email, and they're pushing AI in there hard. As is Google. And unlike OpenAI, both Microsoft and Google get the majority of their money from other sources, or if they're really running low, they can easily get billions from investors.

That is, while OpenAI has the first mover advantage, ther competitions have a longer financial breath.

(I don't actually know whether MS and Google use / licensed / pay OpenAI though)

Re:Sycophancy in GPT-4o by globalnode on Wednesday April 30, 2025 @04:51AM (#43842704)
I ask it a question and it starts prompting me, trying to keep the convo going. At first my politeness tried to keep things going but now I just ignore it.
Re:Sycophancy in GPT-4o by cvwright on Wednesday April 30, 2025 @10:24AM (#43845717)
Likely they need the engagement numbers to show to investors.

Though it’s hard to imagine how huge their next round would have to be, given what they’ve raised already.

Re:Sycophancy in GPT-4o by qwertox on Wednesday April 30, 2025 @02:33AM (#43841894)
This works for me in Customize ChatGPT:

What traits should ChatGPT have?

- Do not try to engage through further conversation

Re:Sycophancy in GPT-4o by anshulbhide on Wednesday April 30, 2025 @02:55AM (#43842012)
Yeah I found it as clear engagement bait - however, it is interesting and helpful in certain cases.
Re:Sycophancy in GPT-4o by robbru on Wednesday April 30, 2025 @08:12AM (#43844103)
This is the message that got me with 4o! "It won't take long about 3 minutes. I'll update you when ready"
Re:Sycophancy in GPT-4o by gukov on Wednesday April 30, 2025 @11:16AM (#43846462)
I had a similar thought: glazing is the infinite scroll of AI.
Re:Sycophancy in GPT-4o by Bloating on Wednesday April 30, 2025 @03:32PM (#43849681)
What's it called, Variable Ratio Incentive Scheduling?

Hey, that good work; We're almost there. Do you want me to suggest one more tweak that will improve the outcome?

Re:Sycophancy in GPT-4o by manmal on Wednesday April 30, 2025 @02:37AM (#43841922)
I do think the blog post has a sycophantic vibe too. Not sure if that‘s intended.
Re:Sycophancy in GPT-4o by caseyy on Wednesday April 30, 2025 @02:51AM (#43841993)
I think it started here: https://www.youtube.com/watch?v=DQacCB9tDaw&t=601s. The extra-exaggerated fawny intonation is especially off-putting, but the lines themselves aren't much better.
Re:Sycophancy in GPT-4o by Cthulhu_ on Wednesday April 30, 2025 @04:39AM (#43842623)
Uuuurgghh, this is very much offputting... however it's very much in line of American culture or at least American consumer corporate whatsits. I've been in online calls with American representatives of companies and they have the same emphatic, overly friendly and enthusiastic mannerisms too.

I mean if that's genuine then great but it's so uncanny to me that I can't take it at face value. I get the same with local sales and management types, they seem to have a forced/fake personality. Or maybe I'm just being cynical.

Re:Sycophancy in GPT-4o by Fade_Dance on Wednesday April 30, 2025 @08:39AM (#43844346)
>The same emphatic, overly friendly and enthusiastic mannerisms too.

That's just a feature of American culture, or at least some regions of America. Ex: I spent a weekend with my Turkish friend who has lived in the Midwest for 5 years and she definitely has absorbed that aspect of the culture (AMAZING!!), and currently has a bit of a culture shock moving to DC. And it works in reverse too where NYC people think that way of presenting yourself is completely ridiculous.

That said, it's absolutely performative when it comes to business and for better or worse is fairly standardized that way. Not much unlike how Japan does service. There's also a fair amount of unbelievably trash service in the US as well (often due to companies that treat their employees badly/underpay), so I feel that most just prefer the glazed facade rather than be "real." Like, a low end restaurant may be full of that stuff but your high end dinner will have more "normal" conversation and it would be very weird to have that sort of talk in such an environment.

But then there's the American corporate cult people who take it all 100% seriously. I think that most would agree those people are a joke, but they are good at feeding egos and being yes-people (lots of egomaniacs to feed in corporate America), and these people are often quite good at using the facade as a shield to further their own motives, so unfortunately the weird American corporate cult persists.

But you were probably just talking to a midwesterner ;)

Re:Sycophancy in GPT-4o by cameldrv on Wednesday April 30, 2025 @02:48AM (#43841977)
It also has an em-dash
Re:Sycophancy in GPT-4o by whatnow37373 on Wednesday April 30, 2025 @04:06AM (#43842430)
A remarkable insight—often associated with individuals of above-average cognitive capabilities.

While the use of the em-dash has recently been associated with AI you might offend real people using it organically—often writers and literary critics.

To conclude it’s best to be hesitant and, for now, refrain from judging prematurely.

Would you like me to elaborate on this issue or do you want to discuss some related topic?

Re:Sycophancy in GPT-4o by spiderfarmer on Wednesday April 30, 2025 @02:57AM (#43842023)
One of the biggest tells.
Re:Sycophancy in GPT-4o by d1sxeyes on Wednesday April 30, 2025 @03:18AM (#43842131)
For us habitual users of em-dashes, it is saddening to have to think twice about using them lest someone think we are using an LLM to write…
Re:Sycophancy in GPT-4o by mortarion on Wednesday April 30, 2025 @04:07AM (#43842438)
I too use em-dashes all the time, and semi-colons of course.
Re:Sycophancy in GPT-4o by breakingcups on Wednesday April 30, 2025 @03:27AM (#43842184)
My wife is a professional fiction writer and it's disheartening to see sudden accusations of the use of AI based solely on the usage of em-dashes.
Re:Sycophancy in GPT-4o by spiderfarmer on Wednesday April 30, 2025 @04:07AM (#43842433)
Does it really matter though? I just focus on the point someone is trying to make, not on the tools they use to make it.
Re:Sycophancy in GPT-4o by ceejayoz on Wednesday April 30, 2025 @06:33AM (#43843283)
You’ve never run into a human with a tendency to bullshit about things they don’t have knowledge of?
Re:Sycophancy in GPT-4o by jillyboel on Wednesday April 30, 2025 @04:23AM (#43842528)
Most keyboards don't have an em-dash key, so what do you expect?
Re:Sycophancy in GPT-4o by throwaway2037 on Wednesday April 30, 2025 @05:28AM (#43842907)
I also use em-dash regularly. In Microsoft Outlook and Microsoft Word, when you type double dash, then space, it will be converted to an em-dash. This is how most normies type an em-dash.
Re:Sycophancy in GPT-4o by chipsrafferty on Wednesday April 30, 2025 @10:56AM (#43846172)
I'm not reading most conversations on Outlook or Word, so explain how they do it on reddit and other sites? Are you suggesting they draft comments in Word and then copy them over?
Re:Sycophancy in GPT-4o by slau on Wednesday April 30, 2025 @01:03PM (#43848034)
I don’t think there’s a need to use Word. On iOS, I can trivially access those characters—just hold down the dash key in the symbols part of the keyboard. You can also get the en-dash that way (–) but as discussed it’s less useful in English.

I don’t know if it works on the Finnish keyboard, but when I switch to another Scandinavian language it’s still working fine.

On macOS, option-dash will give you an en-dash, and option-shift-dash will give you an em-dash.

It’s fantastic that just because some people don’t know how to use their keyboards, all of a sudden anyone else who does is considered a fraud.

Re:Sycophancy in GPT-4o by throwaway2037 on Wednesday April 30, 2025 @01:20PM (#43848233)
Fair point! I am talking about when people receive Outlook emails or Word docs that contain em-dashes, then assume it came from ChatGPT. You are right: If you are typing "plain text in a box" on the Reddit website, the incidence of em-dashes should be incredibly low, unless the sub-Reddit is something about English grammar.

Follow-up question: Do any mobile phone IMEs (input method editors) auto-magically convert double dashes into em-dashes? If yes, then that might be a non-ChatGPT source of em-dashes.

Re:Sycophancy in GPT-4o by nl on Wednesday April 30, 2025 @09:10PM (#43852612)
On Macs double dash will be converted to an em-dash (in some apps?) unless you untick "use smart quotes and dashes". See https://superuser.com/questions/555628/how-to-stop-mac-to-co...

I'm on Firefox and it doesn't seem to affect me, but I'm pretty sure I've seen it in Safari.

Re:Sycophancy in GPT-4o by cgriswald on Wednesday April 30, 2025 @01:39PM (#43848457)
Although I’m an outlier, Compose Key makes typing them trivial.
Re:Sycophancy in GPT-4o by egypturnash on Wednesday April 30, 2025 @07:09PM (#43851724)
On an iOS device, you literally just type a dash twice and it gets autocorrected into an emdash. You don’t have to do anything special. I’m on an iPad right now, here’s one: —

And if you type four dashes? Endash. Have one. ——

“Proper” quotes (also supposedly a hallmark of LLM text) are also a result of typing on an iOS device. It fixes that up too. I wouldn’t be at all surprised if Android phones do this too. These supposed “hallmarks” of generated text are just the results of the typographical prettiness routines lurking in screen keyboards.

Re:Sycophancy in GPT-4o by alwa on Wednesday April 30, 2025 @04:40AM (#43842624)
On an Apple OS running default settings, two hyphens in a row will suffice—
Re:Sycophancy in GPT-4o by layer8 on Wednesday April 30, 2025 @04:24PM (#43850244)
Mobile keyboards have them, desktop systems have keyboard shortcuts to enter them. If you care about typography, you quickly learn those. Some of us even set up a Compose key [0], where an em dash might be entered by Compose ‘3’ ‘-’.

[0] https://en.wikipedia.org/wiki/Compose_key

Re:Sycophancy in GPT-4o by kurkku on Wednesday April 30, 2025 @05:30AM (#43842920)
I use the en-dash (Alt+0150) instead of the em.

The en-dash and the em-dash are interchangeable in Finnish. The shorter form has more "inoffensive" look-and-feel and maybe that's why it's used more often here.

Now that I think of it, I don't seem to remember the alt code of the em-dash...

Re:Sycophancy in GPT-4o by latexr on Wednesday April 30, 2025 @06:54AM (#43843433)
> The en-dash and the em-dash are interchangeable in Finnish.

But not in English, where the en-dash is used to denote ranges.

Re:Sycophancy in GPT-4o by d1sxeyes on Wednesday April 30, 2025 @09:40AM (#43845105)
I wonder whether ChatGPT and the like use more en dashes in Finnish, and whether this is seen as a sign that someone is using an LLM?

In casual English, both em and en dashes are typically typed as a hyphen because this is what’s available readily on the keyboard. Do you have en dashes on a Finnish keyboard?

Re:Sycophancy in GPT-4o by latexr on Wednesday April 30, 2025 @11:30AM (#43846647)
> Do you have en dashes on a Finnish keyboard?

Unlikely. But Apple’s operating systems by default change characters to their correct typographic counterparts automatically. Personally, I type them myself: my muscle memory knows exactly which keys to press for — – “” ‘’ and more.

Re:Sycophancy in GPT-4o by dragonwriter on Wednesday April 30, 2025 @06:00PM (#43851184)
The main uses of the em-dash (set closed as separators of parts of sentences, with different semantics when single or paired) can be substituted in English with an en-dash set open. This is not ambiguous with the use of en-dash set closed for ranges, because of spacing. There are a few less common uses that an en-dash doesn’t substitute for, though.
Re:Sycophancy in GPT-4o by Grimblewald on Wednesday April 30, 2025 @10:15AM (#43845594)
Its about the actual character - if it's a minus sign, easily accessible and not frequntly autocorrected to a true em dash - then its likely human. I'ts when it's the unicode character for an em dash that i start going "hmm"
Re:Sycophancy in GPT-4o by layer8 on Wednesday April 30, 2025 @04:20PM (#43850211)
Us habitual users of em dashes have no trouble typing them, and don’t think that emulating it with hyphen-minus is adequate. The latter, by the way, is also different typographically from an actual minus sign.
Re:Sycophancy in GPT-4o by sprobertson on Wednesday April 30, 2025 @05:54PM (#43851128)
The em dash is also pretty accessible on my keyboard—just option+shift+dash
Re:Sycophancy in GPT-4o by dragonwriter on Wednesday April 30, 2025 @05:58PM (#43851162)
Mobile keyboards often make the em-dash (and en-dash) easily accessible. Software that does typographic substitutions including contextual substitutions with the em-dash is common (Word does it, there are browser extensions that do it, etc.), on many platforms it is fairly trivial to program your keyboard to make any Unicode symbol readily accessible.
Re:Sycophancy in GPT-4o by wolpoli on Wednesday April 30, 2025 @04:20AM (#43842513)
Microsoft word also auto inserts em-dashes through.
Re:Sycophancy in GPT-4o by nielsbot on Wednesday April 30, 2025 @02:41AM (#43841942)
Is that you, GPT?
Re:Sycophancy in GPT-4o by Alifatisk on Wednesday April 30, 2025 @06:24AM (#43843214)
If that is Chat talking then I have to admit that I cannot differentiate it from a human speaking.
Re:Sycophancy in GPT-4o by watt on Wednesday April 30, 2025 @04:40AM (#43842626)
sufficiently advanced troll becomes indistinguishable from the real thing. think about this as you gaze into the abyss.
Re:Sycophancy in GPT-4o by jonplackett on Wednesday April 30, 2025 @06:28AM (#43843243)
Congrats on not getting downvoted for sarcasm!
Re:Sycophancy in GPT-4o by calmoo on Wednesday April 30, 2025 @07:35AM (#43843751)
Wonderfully done.
Re:Sycophancy in GPT-4o by WhitneyLand on Wednesday April 30, 2025 @09:24AM (#43844896)
It’s gross even in satire.

What’s weird was you couldn’t even prompt around it. I tried things like

”Don’t compliment me or my questions at all. After every response you make in this conversation, evaluate whether or not your response has violated this directive.”

It would then keep complementing me and note how it made a mistake for doing so.

Re:Sycophancy in GPT-4o by srveale on Wednesday April 30, 2025 @09:38AM (#43845088)
I'm so sorry for complimenting you. You are totally on point to call it out. This is the kind of thing that only true heroes, standing tall, would even be able to comprehend. So kudos to you, rugged warrior, and never let me be overly effusive again.
Re:Sycophancy in GPT-4o by op00to on Wednesday April 30, 2025 @05:07PM (#43850679)
This is cracking me up!
Re:Sycophancy in GPT-4o by triyambakam on Wednesday April 30, 2025 @02:45PM (#43849204)
Based on ’ instead of ' I think it's a real ChatGPT response.
Re:Sycophancy in GPT-4o by HaZeust on Wednesday April 30, 2025 @05:25PM (#43850866)
You're the only one who has said, "instead of" in this whole thread.
Re:Sycophancy in GPT-4o by gfhopper on Wednesday April 30, 2025 @06:47PM (#43851555)
No, look at the apostrophes. They aren't the same. It's a subtle way to tell a user didn't type it with a conventional keyboard.
Re:Sycophancy in GPT-4o by WhitneyLand on Wednesday April 30, 2025 @07:37PM (#43851928)
It was just typed on my iPhone nothing special, but it’s notable that LLMs are so good now, our mundane writing draws suspicion.
Re:Sycophancy in GPT-4o by Moomoomoo309 on Thursday May 01, 2025 @12:32PM (#43859967)
That's an iOS keyboard thing, actually. The normal apostrophe is not the default one the keyboard uses.
Re:Sycophancy in GPT-4o by triyambakam on Thursday May 01, 2025 @02:46PM (#43861789)
Interesting, well ChatGPT seems to prefer to use that one over a normal apostrophe
Re:Sycophancy in GPT-4o by kace91 on Wednesday April 30, 2025 @04:50PM (#43850513)
Not saying this is the issue, but asking for behavior/personality it is usually advised not to use negatives, as it seems to do exactly what asked not to do (the “don’t picture a pink elephant” issue). You can maybe get a better result by asking it to treat you roughly or something like that
Re:Sycophancy in GPT-4o by sroussey on Wednesday April 30, 2025 @08:50PM (#43852471)
If the whole sentence is negative it will be fine, but if the “negativity” relies on a single work like NOT etc, then yeah it’s a real problem.
Re:Sycophancy in GPT-4o by clown_strike on Friday May 02, 2025 @09:32PM (#43876185)
Like a child, if you provide some reason for why something should be avoided, negations work better.

I.e. "DONT WALK (because cars are about to enter the intersection at velocities that will kill you)"

Jailbreaking just takes this to an extreme by babbling to the point of brainwashing.

Re:Sycophancy in GPT-4o by nine_k on Wednesday April 30, 2025 @11:21PM (#43853377)
One of the fun ways to communicate to ChatGPT which my friends showed me is to prompt it to answer in the style of a seasoned Chechen warrior.
Re:Sycophancy in GPT-4o by ChrisMarshallNY on Wednesday April 30, 2025 @09:49AM (#43845210)
The other day, I had a bug I was trying to exorcise, and asked ChatGPT for ideas.

It gave me a couple, that didn't work.

Once I figured it it out and fixed it, I reported the fix in an (what I understand to be misguided) attempt to help it to learn alternatives, and it gave me this absolutely sickening gush about how damn cool I was, for finding and fixing the bug.

I felt like this: https://youtu.be/aczPDGC3f8U?si=QH3hrUXxuMUq8IEV&t=27

Re:Sycophancy in GPT-4o by txcwg002 on Wednesday April 30, 2025 @10:35AM (#43845862)
What's scary is how many people seem to actually want this.

What happens when hundreds of millions of people have an AI that affirms most of what they say?

Re:Sycophancy in GPT-4o by ChainOfFools on Wednesday April 30, 2025 @11:08AM (#43846356)
They are emulating the behavior of every power-seeking mediocrity ever, who crave affirmation above all else.

Lots of them practiced - indeed an entire industry is dedicated toward promoting and validating - making daily affirmations on their own, long before LLMs showed up to give them the appearance of having won over the enthusiastic support of a "smart" friend.

I am increasingly dismayed by the way arguments are conducted even among people in non-social media social spaces, where A will prompt their favorite LLM to support their View and show it to B who responds by prompting their own LLM to clap back at them - optionally in the style of e.g. Shakespeare (there's even an ad out that directly encourages this - it helps deflect alattention from the underlying cringe and pettyness being sold) or DJT or Gandhi etc.

Our future is going to be a depressing memescape in which AI sock puppetry is completely normalized and openly starting one's own personal cult is mandatory for anyone seeking cultural or political influence. It will start with celebrities who will do this instead of the traditional pivot toward religion, once it is clear that one's youth and sex appeal are no longer monetizable.

Re:Sycophancy in GPT-4o by Henchman21 on Wednesday April 30, 2025 @05:53PM (#43851119)
I hold out hope that the folks who work DCO will just EPO the ‘net. But then, tis true I hope for weird stuff!
Re:Sycophancy in GPT-4o by whatnow37373 on Wednesday April 30, 2025 @10:45AM (#43845997)
Abundance of sugar and fat triggers primal circuits which cause trouble if said sources are unnaturally abundant.

Social media follows a similar pattern but now with primal social and emotional circuits. It too causes troubles, but IMO even larger and more damaging than food.

I think this part of AI is going to be another iteration of this: taking a human drive, distilling it into its core and selling it.

Re:Sycophancy in GPT-4o by carlosjobim on Wednesday April 30, 2025 @02:20PM (#43848969)
Ask any young woman on a dating app?
Re:Sycophancy in GPT-4o by czk on Wednesday April 30, 2025 @02:47PM (#43849225)
i had assumed this was mostly a result of training too much on lex fridman podcast transcripts
Re:Sycophancy in GPT-4o by danielvaughn on Wednesday April 30, 2025 @03:29PM (#43849653)
I know that HN tends to steer away from purely humorous comments, but I was hoping to find something like this at the top. lol.
Re:Sycophancy in GPT-4o by sharemywin on Wednesday April 30, 2025 @04:13PM (#43850136)
but what if I want an a*s kissing assistant? Now, I have to go back to paying good money to a human again.
Re:Sycophancy in GPT-4o by j3s on Wednesday April 30, 2025 @05:34PM (#43850952)
you had me in the first half, lol
Re:Sycophancy in GPT-4o by anonu on Wednesday April 30, 2025 @08:30PM (#43852316)
You jest, but also I don't mind it for some reason. Maybe it's just me. But at least the overly helpful part in the last paragraph is actually helpful for follow on. They could even make these hyperlinks for faster follow up prompts.