News for hackers. Stuff that matters.
Re:LLM Inevitabilism by lordnacho on Tuesday July 15, 2025 @09:19AM (#44570853)
Are you saying they'd be profitable if they didn't pour all the winnings into research?

From where I'm standing, the models are useful as is. If Claude stopped improving today, I would still find use for it. Well worth 4 figures a year IMO.

Re:LLM Inevitabilism by jsnell on Tuesday July 15, 2025 @09:31AM (#44570962)
They'd be profitable if they showed ads to their free tier users. They wouldn't even need to be particularly competent at targeting or aggressive with the amount of ads they show, they'd be profitable with 1/10th the ARPU of Meta or Google.

And they would not be incompetent at targeting. If they were to use the chat history for targeting, they might have the most valuable ad targeting data sets ever built.

Re:LLM Inevitabilism by lxgr on Tuesday July 15, 2025 @09:47AM (#44571136)
Bolting banner ads onto a technology that can organically weave any concept into a trusted conversation would be incredibly crude.
Re:LLM Inevitabilism by evilfred on Tuesday July 15, 2025 @11:18AM (#44572061)
how is it "trusted" when it just makes things up
Re:LLM Inevitabilism by tsukikage on Tuesday July 15, 2025 @12:09PM (#44572641)
“trusted” in computer science does not mean what it means in ordinary speech. It is what you call things you have no choice but to trust, regardless of whether that trust is deserved or not.
Re:LLM Inevitabilism by pegasus on Tuesday July 15, 2025 @12:59PM (#44573318)
For one, it's not like we're at some CS conference, so we're engaging in ordinary speech here, as far as I can tell. For two, "trusted" doesn't have just one meaning, even in the narrower context of CS.
Re:LLM Inevitabilism by lxgr on Tuesday July 15, 2025 @01:19PM (#44573568)
I meant it in the ordinary speech sense (which I don't even thing contradicts the "CS sense" fwiw).

Many people have a lot of trust in anything ChatGPT tells them.

Re:LLM Inevitabilism by andrewflnr on Tuesday July 15, 2025 @11:28AM (#44572191)
That's a great question to ask the people who seem to trust them implicitly.
Re:LLM Inevitabilism by handfuloflight on Tuesday July 15, 2025 @11:45AM (#44572373)
They aren't trusted in a vacuum. They're trusted when grounded in sources and their claims can be traced to sources. And more specifically, they're trusted to accurately represent the sources.
Re:LLM Inevitabilism by andrewflnr on Tuesday July 15, 2025 @12:01PM (#44572554)
Nope, lots of idiots just take them at face value. You're still describing what rational people do, not what all actual people do.
Re:LLM Inevitabilism by handfuloflight on Tuesday July 15, 2025 @12:05PM (#44572590)
Fair enough.
Re:LLM Inevitabilism by sheiyei on Tuesday July 15, 2025 @12:23PM (#44572818)
> they're trusted to accurately represent the sources.

Which is still too much trust

Re:LLM Inevitabilism by PebblesRox on Tuesday July 15, 2025 @02:19PM (#44574260)
If you believe this, people believe everything they read by default and have to apply a critical thinking filter on top of it to not believe the thing.

I know I don't have as much of a filter as I ought to!

https://www.lesswrong.com/s/pmHZDpak4NeRLLLCw/p/TiDGXt3WrQwt...

Re:LLM Inevitabilism by andrewflnr on Tuesday July 15, 2025 @04:57PM (#44575741)
That checks out with my experience. I don't think it's just reading either. Even deeper than stranger danger, we're inclined to assume other humans communicating with us are part of our tribe, on our side, and not trying to deceive us. Deception, and our defenses against deception, are a secondary phenomenon. It's the same reason that jokes like "the word 'gullible' is written in the ceiling", gesturing to wipe your face at someone with a clean face, etc, all work by default.
Re:LLM Inevitabilism by dingnuts on Tuesday July 15, 2025 @11:30AM (#44572215)
15% of people aren't smart enough to read and follow directions explaining how to fold a trifold brochure, place it in an envelope, seal it, and address it

you think those people don't believe the magic computer when it talks?

Re:LLM Inevitabilism by nacnud on Tuesday July 15, 2025 @09:56AM (#44571218)
True - but if you erode that trust then your users may go elsewhere. If you keep the ads visually separated, there's a respected boundary & users may accept it.
Re:LLM Inevitabilism by SJC_Hacker on Tuesday July 15, 2025 @11:46AM (#44572379)
There will be a respected boundary for a time, then as advertisers find its more effective the boundaries will start to disappear
Re:LLM Inevitabilism by calvinmorrison on Tuesday July 15, 2025 @10:48AM (#44571708)
google did it. LLms are the new google search. It'll happen sooner or later.
Re:LLM Inevitabilism by ptero on Tuesday July 15, 2025 @11:28AM (#44572195)
Yes, but for a while google was head and shoulders above the competition. It also poured a ton of money into building non-search functionality (email, maps, etc.). And had a highly visible and, for a while, internally respected "don't be evil" corporate motto.

All of which made it much less likely that users would bolt in response to each real monetization step. This is very different to the current situation, where we have a shifting landscape with several AI companies, each with its strengths. Things can change, but it takes time for 1-2 leaders to consolidate and for the competition to die off. My 2c.

Re:LLM Inevitabilism by ModernMech on Tuesday July 15, 2025 @11:32AM (#44572225)
I imagine they would be more like product placements in film and TV than banner ads. Just casually dropping a recommendation and link to Brand (TM) in a query. Like those Cerveza Cristal ads in star wars. They'll make it seem completely seamless to the original query.
Re:LLM Inevitabilism by thewebguyd on Tuesday July 15, 2025 @12:40PM (#44573078)
I just hope that if it comes to that (and I have no doubt that it will), regulation will catch up and mandate any ad/product placement is labeled as such and not just slipped in with no disclosure whatsoever. But, given that we've never regulated influencer marketing which does the same thing, nor are TV placements explicitly called out as "sponsored" I have my doubts but one can hope.
Re:LLM Inevitabilism by lxgr on Tuesday July 15, 2025 @01:32PM (#44573705)
Yup, and I wouldn't be willing to bet that any firewall between content and advertising would hold, long-term.

For example, the more product placement opportunities there are, the more products can be placed, so sooner or later that'll become an OKR to the "content side" of the business as well.

Re:LLM Inevitabilism by Analemma_ on Tuesday July 15, 2025 @10:25AM (#44571487)
Like that’s ever stopped the adtech industry before.

It would be a hilarious outcome though, “we built machine gods, and the main thing we use them for is to make people click ads.” What a perfect Silicon Valley apotheosis.

Re:LLM Inevitabilism by miki123211 on Tuesday July 15, 2025 @11:52AM (#44572443)
and they wouldn't even have to make the model say the ads. I think that's a terrible idea which would drive model performance down.

Traditional banner ads, inserted inline into the conversation based on some classifier seem a far better idea.

Re:LLM Inevitabilism by bugbuddy on Tuesday July 15, 2025 @09:39AM (#44571061)
I heard majority of the users are techies asking coding questions. What do you sell to someone asking how to fix a nested for loop in C++? I am genuinely curious. Programmers are known to be the stingiest consumers out there.
Re:LLM Inevitabilism by tsukikage on Tuesday July 15, 2025 @12:13PM (#44572688)
…for starters, you can sell them the ability to integrate your AI platform into whatever it is they are building, so you can then sell your stuff to their customers.
Re:LLM Inevitabilism by cuchoi on Tuesday July 15, 2025 @09:51AM (#44571182)
I'm not sure that stereotype holds up. Developers spend a lot: courses, cloud services, APIs, plugins, even fancy keyboards.

A quick search shows that click on ads targeting developers are expensive.

Also there is a ton of users asking to rewrite emails, create business plans, translate, etc.

Re:LLM Inevitabilism by jsnell on Tuesday July 15, 2025 @11:18AM (#44572071)
OpenAI has half a billion active users.

You don't need every individual request to be profitable, just the aggregate. If you're doing a Google search for, like, the std::vector API reference you won't see ads. And that's probably true for something like 90% of the searches. Those searches have no commercial value, and serving results is just a cost of doing business.

By serving those unmonetizable queries the search engine is making a bet that when you need to buy a new washing machine, need a personal injury lawyer, or are researching that holiday trip to Istanbul, you'll also do those highly commercial and monetizable searches with the same search engine.

Chatbots should have exactly the same dynamics as search engines.

Re:LLM Inevitabilism by Lewton on Tuesday July 15, 2025 @10:01AM (#44571269)
> I heard majority of the users are techies asking coding questions.

Citation needed? I can't sit on a bus without spotting some young person using ChatGPT

Re:LLM Inevitabilism by disgruntledphd2 on Tuesday July 15, 2025 @10:01AM (#44571264)
You'd probably do brand marketing for Stripe, Datadog, Kafka, Elastic Search etc.

You could even loudly proclaim that the are ads are not targeted by users which HN would love (but really it would just be old school brand marketing).

Re:LLM Inevitabilism by yamazakiwi on Tuesday July 15, 2025 @11:35AM (#44572254)
A lot of people use it for cooking and other categories as well.

Techies are also great for network growth and verification for other users, and act as community managers indirectly.

Re:LLM Inevitabilism by naravara on Tuesday July 15, 2025 @11:46AM (#44572375)
The existence of the LLMs will themselves change the profile and proclivities of people we consider “programmers” in the same way the app-driven tech boom did. Programmers who came up in the early days are different from ones who came up in the days of the web are different from ones who came up in the app era.
Re:LLM Inevitabilism by LtWorf on Tuesday July 15, 2025 @09:47AM (#44571134)
According to fb's aggressively targeted marketing, you sell them donald trump propaganda.
Re:LLM Inevitabilism by disgruntledphd2 on Tuesday July 15, 2025 @10:02AM (#44571275)
It's very important to note that advertisers set the parameters in which FB/Google's algorithms and systems operate. If you're 25-55 in a red state, it seems likely that you'll see a bunch of that information (even if FB are well aware you won't click).
Re:LLM Inevitabilism by LtWorf on Tuesday July 15, 2025 @12:48PM (#44573190)
I'm not even in USA and I've never been in USA in my entire life.
Re:LLM Inevitabilism by disgruntledphd2 on Wednesday July 16, 2025 @04:56AM (#44580145)
Wow, that's either a bug or an incredibly incompetent advertiser.
Re:LLM Inevitabilism by LtWorf on Wednesday July 16, 2025 @08:12AM (#44581329)
Are we surprised someone working for trump is not competent?
Re:LLM Inevitabilism by disgruntledphd2 on Thursday July 17, 2025 @05:18AM (#44591346)
From an advertising perspective, yes. Their ads team was super competent in 2016, at least.
Re:LLM Inevitabilism by JackFr on Tuesday July 15, 2025 @12:55PM (#44573270)
You sell them Copilot. You Sell them CursorAI. You sell them Windsurf. You sell them Devin. You sell the Claude Code.

Software guys are doing much, much more than treating LLM's like an improved Stack Overflow. And a lot of them are willing to pay.

Re:LLM Inevitabilism by naravara on Tuesday July 15, 2025 @11:38AM (#44572280)
If interactions with your AI start sounding like your conversation partner shilling hot cocoa powder at nobody in particular those conversations are going to stop being trusted real quick. (Pop culture reference: https://youtu.be/MzKSQrhX7BM?si=piAkfkwuorldn3sb)

Which may be for the best, because people shouldn’t be implicitly trusting the bullshit engine.

Re:LLM Inevitabilism by immibis on Tuesday July 15, 2025 @01:04PM (#44573390)
Targeted banner ads based on chat history is last-two-decades thinking. The money with LLMs will be targeted answers. Have Coca-Cola pay you a few billion dollars to reinforce the model to say "Coke" instead of "soda". Train it the best source of information about political subjects is to watch Fox News. This even works with open-source models, too!
Re:LLM Inevitabilism by ericfr11 on Tuesday July 15, 2025 @02:14PM (#44574196)
It sounds quite scary that an LLM could be trained on a single source of news (specially FN).
Re:LLM Inevitabilism by miki123211 on Tuesday July 15, 2025 @11:51AM (#44572421)
But if Claude stopped pouring their money into research and others didn't, Claude wouldn't be useful a year from now, as you could get a better model for the same price.

This is why AI companies must lose money short term. The moment improvements plateau or the economic environment changes, everyone will cut back on research.

Re:LLM Inevitabilism by vikramkr on Tuesday July 15, 2025 @10:51AM (#44571742)
That's calculating value against not having LLMs and current competitors. If they stopped improving but their competitors didn't, then the question would be the incremental cost of Claude (financial, adjusted for switching costs, etc) against the incremental advantage against the next best competitor that did continue improving. Lock in is going to be hard to accomplish around a product that has success defined by its generalizability and adaptability.

Basically, they can stop investing in research either when 1) the tech matures and everyone is out of ideas or 2) they have monopoly power from either market power or oracle style enterprise lock in or something. Otherwise they'll fall behind and you won't have any reason to pay for it anymore. Fun thing about "perfect" competition is that everyone competes their profits to zero

Re:LLM Inevitabilism by dvfjsdhgfv on Tuesday July 15, 2025 @09:27AM (#44570918)
For me, if Anthropic stopped now, and given access to all alternative models, they still would be worth exactly $240 which is the amount I'm paying now. I guess Anthropic and OpenAI can see the real demand by clearly seeing what are their free:basic:expensive plan ratios.
Re:LLM Inevitabilism by danielbln on Tuesday July 15, 2025 @02:44PM (#44574494)
You may want to pay for Claude Max outside of the Google or iOS ecosystem and save $40/month.
Re:LLM Inevitabilism by apwell23 on Tuesday July 15, 2025 @09:28AM (#44570925)
> Well worth 4 figures a year IMO

only because software engineering pay hasn't adjusted down for the new reality . You don't know what its worth yet.

Re:LLM Inevitabilism by fkyoureadthedoc on Tuesday July 15, 2025 @09:41AM (#44571084)
Can you explain this in more detail? The idiot bottom rate contractors that come through my team on the regular have not been helped at all by LLMs. The competent people do get a productivity boost though.

The only way I see compensation "adjusting" because of LLMs would need them to become significantly more competent and autonomous.

Re:LLM Inevitabilism by lelanthran on Tuesday July 15, 2025 @10:35AM (#44571579)
> Can you explain this in more detail?

Not sure what GP meant specifically, but to me, if $200/m gets you a decent programmer, then $200/m is the new going rate for a programmer.

Sure, now it's all fun and games as the market hasn't adjusted yet, but if it really is true that for $200/m you can 10x your revenue, it's still only going to be true until the market adjusts!

> The competent people do get a productivity boost though.

And they are not likely to remain competent if they are all doing 80% review, 15% prompting and 5% coding. If they keep the ratios at, for example, 25% review, 5% prompting and the rest coding, then sure, they'll remain productive.

OTOH, the pipeline for juniors now seems to be irrevocably broken: the only way forward is to improve the LLM coding capabilities to the point that, when the current crop of knowledgeable people have retired, programmers are not required.

Otherwise, when the current crop of coders who have the experience retires, there'll be no experience in the pipeline to take their place.

If the new norm is "$200/m gets you a programmer", then that is exactly the labour rate for programming: $200/m. These were previously (at least) $5k/m jobs. They are now $200/m jobs.

Re:LLM Inevitabilism by fkyoureadthedoc on Tuesday July 15, 2025 @11:05AM (#44571897)
$200 does not get you a decent programmer though. It needs constant prompting, babysitting, feedback, iteration. It's just a tool. It massively boosts productivity in many cases, yes. But it doesn't do your job for you. And I'm very bullish on LLM assisted coding when compared to most of HN.

High level languages also massively boosted productivity, but we didn't see salaries collapse from that.

> And they are not likely to remain competent if they are all doing 80% review, 15% prompting and 5% coding.

I've been doing 80% review and design for years, it's called not being a mid or junior level developer.

> OTOH, the pipeline for juniors now seems to be irrevocably broken

I constantly get junior developers handed to me from "strategic partners", they are just disguised as senior developers. I'm telling you brother, the LLMs aren't helping these guys do the job. I've let go 3 of them in July alone.

Re:LLM Inevitabilism by lelanthran on Tuesday July 15, 2025 @12:18PM (#44572766)
> It needs constant prompting, babysitting, feedback, iteration. It's just a tool. It massively boosts productivity in many cases, yes.

It doesn't sound like you are disagreeing with me: that role you described is one of manager, not of programmer.

> High level languages also massively boosted productivity, but we didn't see salaries collapse from that.

Those high level languages still needed actual programmers. If the LLM is able to 10x the output of a single programmer because that programmer is spending all their time managing, you don't really need a programmer anymore, do you?

> I've been doing 80% review and design for years, it's called not being a mid or junior level developer.

Maybe it differs from place to place. I was a senior and a staff engineer, at various places including a FAANG. My observations were that even staff engineer level was still spending around 2 - 3 hours a day writing code. If you're 10x'ing your productivity, you almost certainly aren't spending 2 - 3 hours a day writing code.

> I constantly get junior developers handed to me from "strategic partners", they are just disguised as senior developers. I'm telling you brother, the LLMs aren't helping these guys do the job. I've let go 3 of them in July alone.

This is a bit of a non-sequitor; what does that have to do with breaking the pipeline for actual juniors?

Without juniors, we don't get seniors. Without seniors and above, who will double-check the output of the LLM?[1]

If no one is hiring juniors anymore, then the pipeline is broken. And since the market price of a programmer is going to be set at $200/m, where will you find new entrants for this market?

Hell, even mid-level programmers will exit, because when a 10-programmer team can be replaced by a 1-person manager and a $200/m coding agent, those 9 people aren't quietly going to starve while the industry needs them again. They're going to go off and find something else to do, and their skills will atrophy (just like the 1-person LLM manager skills will atrophy eventually as well).

----------------------------

[1] Recall that my first post in this thread was to say that the LLM coding agents have to get so good that programmers aren't needed anymore because we won't have programmers anymore. If they aren't that good when the current crop starts retiring then we're in for some trouble, aren't we?

Re:LLM Inevitabilism by fkyoureadthedoc on Tuesday July 15, 2025 @12:44PM (#44573132)
> And since the market price of a programmer is going to be set at $200/m

You keep saying this, but I don't see it. The current tools just can't replace developers. They can't even be used in the same way you'd use a junior developer or intern. It's more akin to going from hand tools to power tools than it is getting an apprentice. The job has not been automated and hasn't been outsourced to LLMs.

Will it be? Who knows, but in my personal opinion, it's not looking like it will any time soon. There would need to be more improvement than we've seen from day 1 of ChatGPT until now before we could even be seriously considering this.

> Those high level languages still needed actual programmers.

So does the LLM from day one until now, and for the foreseeable future.

> This is a bit of a non-sequitor; what does that have to do with breaking the pipeline for actual juniors?

Who says the pipeline is even broken by LLMs? The job market went to shit with rising interest rates before LLMs hit the scene. Nobody was hiring them anyway.

Re:LLM Inevitabilism by bscphil on Tuesday July 15, 2025 @10:42PM (#44578167)
> The current tools just can't replace developers. They can't even be used in the same way you'd use a junior developer or intern. It's more akin to going from hand tools to power tools than it is getting an apprentice.

In that case it seems to depend on what you mean by "replacing", doesn't it? It doesn't mean a non-developer can do a developers job, but it does mean that one developer can do two developer's jobs. That leads to a lot more competition for the remaining jobs and presumably many competent developers will accept lower salaries in exchange for having a job at all.

Re:LLM Inevitabilism by handfuloflight on Tuesday July 15, 2025 @12:00PM (#44572544)
> It needs constant prompting, babysitting, feedback, iteration.

What do you think a product manager is doing?

Re:LLM Inevitabilism by fkyoureadthedoc on Tuesday July 15, 2025 @12:27PM (#44572886)
Not writing and committing code with GitHub Copilot, I'll tell you that. These things need to come a _long_ way before that's a reality.
Re:LLM Inevitabilism by nyarlathotep_ on Tuesday July 15, 2025 @02:20PM (#44574269)
> I constantly get junior developers handed to me from "strategic partners", they are just disguised as senior developers. I'm telling you brother, the LLMs aren't helping these guys do the job. I've let go 3 of them in July alone.

I find this surprising. I figured the opposite: that the quality of body shop type places would improve and the productivity increases would decrease as you went "up" the skill ladder.

I've worked on/inherited a few projects from the Big Name body shops and, frankly, I'd take some "vibe coded" LLM mess any day of the week. I really figured there was nowhere to go but "up" for those kinds of projects.

Re:LLM Inevitabilism by fkyoureadthedoc on Friday July 18, 2025 @10:55AM (#44605334)
The problem is that these guys are so bad they can't even understand the requirements to explain to GitHub Copilot what to do. By the time I've written enough detail into a feature for them to do it, I could have done it myself, and they'll still get it wrong.
Re:LLM Inevitabilism by sheiyei on Tuesday July 15, 2025 @12:38PM (#44573056)
Your argument requires "Claude can replace a programme" to be true. Thus, your argument is false for the foreseeable future.
Re:LLM Inevitabilism by cgh on Tuesday July 15, 2025 @12:56PM (#44573279)
There's another specific class of person that seems helped by them: the paralysis by analysis programmer. I work with someone really smart who simply cannot get started when given ordinary coding tasks. She researches, reads and understands the problem inside and out but cannot start actually writing code. LLMs have pushed her past this paralysis problem and given her the inertia to continue.

On the other end, I know a guy who writes deeply proprietary embedded code that lives in EV battery controllers and he's found LLMs useless.

Re:LLM Inevitabilism by johnnyanmac on Tuesday July 15, 2025 @02:08PM (#44574128)
I mean, it adjusted down by having some hundreds of thousands of engineers laid off in he last 2+ years. they know slashing salaries is legal suicide, so they just make the existing workers work 3x as hard.