News for hackers. Stuff that matters.
Re:OpenAI co-founder John Schulman says he will leave and jo... by jsheard on Tuesday August 06, 2024 @05:37AM (#41169152)
> The rubber will meet the road when the first free and open AI website gets real traction. And monetizes it with ads next to the answers.

The magic of genAI is they don't need to put ads next to the answers where they can easily be ignored or adblocked, they can put the ads inside the answers instead. The future, like it or not, is advertisers bidding to bias AI models towards mentioning their products.

Re:OpenAI co-founder John Schulman says he will leave and jo... by jaustin on Tuesday August 06, 2024 @06:11AM (#41169352)
I'm sure it's not long before you get the first emails offering a "training data influencing service" - for a nice fee, someone will make sure your product is positively mentioned in all the key training datasets used to train important models. "Our team of content experts will embed positive sentiment and accurate product details into authentic content. We use the latest AI and human-based techniques to achieve the highest degree of model influence".

And of course, once the new models are released, it'll be impossible to prove the impact of the work - there's no counterfactual. Proponents of the "training data influence service" will tell you that without them, you wouldn't even be mentioned.

I really don't like this. But I also don't see a way around it. Public datasets are good. User contributed content is good, but inherently vulnerable to this I think?. Anyone in any of the big LLM training orgs working on defending against this kind of bought influence?

Re:OpenAI co-founder John Schulman says he will leave and jo... by jordwest on Tuesday August 06, 2024 @07:11AM (#41169679)
User: How do I make white bread? When I try to bake bread, it comes out much darker than the store bought bread.

AI: Sure, I can help you make your bread lighter! Here's a delicious recipe for white bread:

    1. Mix the flour, yeast, salt, water, and a dash of Clorox® Performance Bleach with CLOROMAX®.
    2. Let rise for 3 hours.
    3. Shape into loaves.
    4. Bake for 20-30 minutes.
    5. Enjoy your freshly baked white bread!
Re:OpenAI co-founder John Schulman says he will leave and jo... by qrios on Tuesday August 06, 2024 @07:27AM (#41169761)
Let‘s see if this recipe will make it into Claude or ChatGPT in two to three years. set a reminder
Re:OpenAI co-founder John Schulman says he will leave and jo... by ssijak on Tuesday August 06, 2024 @06:54AM (#41169598)
If they start doing that without clear distinction what is an ad, that would be a sure way to lose users immediately.
Re:OpenAI co-founder John Schulman says he will leave and jo... by jaustin on Tuesday August 06, 2024 @08:12AM (#41170105)
I'm positing a model where a third party does the influencing, not the company delivering the LLM/service. What's to say that it's an ad if the Wikipedia page for a product itself says that the product "establishes new standards for quality, technological leadership and operating excellence". (and no problem if the edit gets reverted, as long as it said that just at the moment company X crawled Wikipedia for the latest training round).

So more like SEO firms "helping you" move your rank on Google, than Google selling ads.

I'd imagine "undetectable to the LLM training orgs" might just be service with a higher fee.

Re:OpenAI co-founder John Schulman says he will leave and jo... by cruffle_duffle on Tuesday August 06, 2024 @12:45PM (#41172585)
How will these third party “LLM Optimization” (LLMO) services prove to their clients that their work has a meaningful impact on the results returned by things like ChatGPT?

With SEO, it’s pretty easy to see the results of your effort. You either show up on top for the right keywords or you don’t. With LLM’s there is no way to easily demonstrate impact, at least I’d think.

Re:OpenAI co-founder John Schulman says he will leave and jo... by jtbayly on Tuesday August 06, 2024 @07:09AM (#41169662)
And also get sued by the FTC. Disclosure is required.
Re:OpenAI co-founder John Schulman says he will leave and jo... by throwaway765123 on Tuesday August 06, 2024 @07:17AM (#41169710)
Disclosure is technically required, but in practice I see undisclosed ads on social media all the time. If the individual instance is small enough and dissipates into the ether fast enough, there is virtually no risk of enforcement.

Similarly, the black box AI models guarantee the owners can just shrug and say it's not their fault if the model suggests Wonderbread(r) for making toast 3.2% more frequently than other breads.

Re:OpenAI co-founder John Schulman says he will leave and jo... by Kon-Peki on Tuesday August 06, 2024 @09:04AM (#41170499)
Ha! Disclosure by whom?

If Clorox fills their site with "helpful" articles that just happen to mention Clorox very frequently and some training set aggregator or unscrupulous AI company scrapes it without prior permission, does Clorox have any responsibility for the result? And when those model weights get used randomly, is it an advertisement according to the law? I think not.

Pay attention to the non-headline claims in the NYT lawsuit against OpenAI for whether or not anyone has any responsibility if their AI model starts mentioning your registered trademark without your permission. But on the other hand, what if you like that they mention your name frequently???

Re:OpenAI co-founder John Schulman says he will leave and jo... by jtbayly on Tuesday August 06, 2024 @09:39AM (#41170774)
The point is that Clorox cannot pay OpenAI anything.

Marketing on your own site will have effects on an AI just like it will have an effect on a human reader. No disclosure is required because the context is explicit.

But the moment OpenAI wants to charge for Clorox to show up more often, then it needs to be disclosed when it shows up.

Re:OpenAI co-founder John Schulman says he will leave and jo... by Kon-Peki on Tuesday August 06, 2024 @10:32AM (#41171193)
> But the moment OpenAI wants to charge for Clorox to show up more often, then it needs to be disclosed when it shows up.

Yes, I agree with this. But what about paying a 3rd party to include your drivel in a training set, and that 3rd party pays OpenAI to include the training set in some fine tuning exercise? Does that legally trigger the need for disclosure? You aren't directly creating advertisements, you are increasing the probability that some word appears near some other word.

Re:OpenAI co-founder John Schulman says he will leave and jo... by htrp on Tuesday August 06, 2024 @08:05AM (#41170040)
like almost every blog, you could be covered with a blanket statement

" our model will occasionally recommend advertiser sponsored content"

Re:OpenAI co-founder John Schulman says he will leave and jo... by leadingthenet on Tuesday August 06, 2024 @07:12AM (#41169685)
Once they all start doing it, it won't matter.
Re:OpenAI co-founder John Schulman says he will leave and jo... by dotancohen on Tuesday August 06, 2024 @07:17AM (#41169712)
Just like Google lost users when they started embedding advertisements in the SERPs?
Re:OpenAI co-founder John Schulman says he will leave and jo... by tim333 on Tuesday August 06, 2024 @07:28AM (#41169766)
With Google it's kind of ok as they mark them as ads and you can ignore them or in my case not see them as ublock stops them. You could perhaps have something similar with LLMs? Here's how to make bread.... [sponsored - maybe you could use Clorox®]
Re:OpenAI co-founder John Schulman says he will leave and jo... by TeMPOraL on Tuesday August 06, 2024 @08:48AM (#41170357)
It's the same as it has been with all the other media consumed by advertising so far. Radio, television, newspapers, telephony, music, video. Ads metastasizing to Internet services are normal and expected progression of the disease.

At every point, there's always a rationalization like this available, that you can use to calm yourself down and embrace the suck. "They're marking it clearly". "Creators need to make money". "This is good for business, therefore Good for America, therefore good for me". "Some ads are real works of art, more interesting to watch than the actual programming". "How else would I know what to buy?".

The truth is, all those rationalizations are bullshit; you're being screwed over and actively fed poison, and there's nothing you can do about it except stop using the service - which quickly becomes extremely inconvenient to pretty much impossible. But since there's no one you could get angry at to get them to change things for the better, you can either adopt a "justification" like the above, or slowly boil inside.

Re:OpenAI co-founder John Schulman says he will leave and jo... by tim333 on Tuesday August 06, 2024 @11:23AM (#41171790)
Well as mentioned I don't even see Google's ads unless I deliberately turn the blocker off. I much prefer that to the content being subtly biased which you see in blogs, newspapers and the like.
Re:OpenAI co-founder John Schulman says he will leave and jo... by mrguyorama on Tuesday August 06, 2024 @01:22PM (#41173003)
It hasn't affected Instagram or TikTok negatively having nearly anything and everything being an ad
Re:OpenAI co-founder John Schulman says he will leave and jo... by fleischhauf on Tuesday August 06, 2024 @06:21AM (#41169412)
kinda hard to achieve when these models are trained on all text on the internet
Re:OpenAI co-founder John Schulman says he will leave and jo... by Mtinie on Tuesday August 06, 2024 @06:28AM (#41169473)
Training weights are gold.
Re:OpenAI co-founder John Schulman says he will leave and jo... by ionwake on Tuesday August 06, 2024 @06:33AM (#41169491)
How to invest tho
Re:OpenAI co-founder John Schulman says he will leave and jo... by mschuster91 on Tuesday August 06, 2024 @06:52AM (#41169582)
Kinda easy if you look where the stuff is being trained. A single joke post on Reddit was enough to convince Google's A"I" to put glue on pizza after all [1].

Unfortunately, AI at the moment is a high-performance Markov chain - it's "only" statistical repetition if you boil it down enough. An actual intelligence would be able to cross-check information against its existing data store and thus recognize during ingestion that it is being fed bad data, and that is why training data selection is so important.

Unfortunately, the tech status quo is nowhere near that capability, hence all the AI companies slurping up as much data as they can, in the hope that "outlier opinions" are simply smothered statistically.

[1] https://www.businessinsider.com/google-ai-glue-pizza-i-tried...

Re:OpenAI co-founder John Schulman says he will leave and jo... by antonvs on Tuesday August 06, 2024 @08:07AM (#41170060)
> An actual intelligence would be able to cross-check information against its existing data store and thus recognize during ingestion that it is being fed bad data

There’s a physics Nobel Prize winner, John Clauser, who has recently been publicly claiming that climate change doesn’t exist. Is he not “actually intelligent”?

I kinda want to say no he’s not, but the reality is that people are wrong about all sorts of things all the time. Intelligence is not some sort of guaranteed protection against that. If anything, intelligent people are better at rationalizing their BS to themselves and others.

Re:OpenAI co-founder John Schulman says he will leave and jo... by claytongulick on Tuesday August 06, 2024 @11:15AM (#41171697)
I don't know much about it, but from a quick google, I don't think you're representing his stance precisely? From what I see, he claims a "climate crisis" doesn't exist, which is different than "climate change doesn't exist":

“The popular narrative about climate change reflects a dangerous corruption of science that threatens the world’s economy and the well-being of billions of people. Misguided climate science has metastasized into massive shock-journalistic pseudoscience. In turn, the pseudoscience has become a scapegoat for a wide variety of other unrelated ills. It has been promoted and extended by similarly misguided business marketing agents, politicians, journalists, government agencies, and environmentalists. In my opinion, there is no real climate crisis. There is, however, a very real problem with providing a decent standard of living to the world’s large population and an associated energy crisis. The latter is being unnecessarily exacerbated by what, in my opinion, is incorrect climate science.”

and

“In my opinion, there is no real climate crisis. There is, however, a very real problem with providing a decent standard of living to the world’s large population and an associated energy crisis.”

I did learn something while writing this though. I assumed that ChatGPT wouldn't give an objective summary of Dr. Clauser's viewpoint, but I was dead wrong:

Me: "What are John Clauser's viewpoints on climate change? Summarize his arguments."

ChatGPT: "John Clauser, a Nobel laureate in physics, holds controversial views on climate change, which diverge significantly from the scientific consensus. Clauser has publicly stated that he does not believe there is a climate crisis. He argues that the major climate models fail to account for complexities and key variables, leading to exaggerated and misunderstood projections of climate change impacts. Clauser criticizes the Intergovernmental Panel on Climate Change (IPCC) for spreading misinformation and claims that climate policies based on these models are wasteful and misguided (Logically) (Apple) (Apple) .

He suggests that the scientific approach to understanding climate involves careful observation and experimentation, and he emphasizes the need for distinguishing truth from misinformation. Clauser's stance aligns with the views of the CO2 Coalition, a group that argues that carbon dioxide emissions are beneficial and not a threat (CO2 Coalition) (CO2 Coalition) . His viewpoints have sparked considerable debate, especially given his prominence in the field of quantum mechanics and his Nobel Prize recognition."

Pretty good! Objective, clear and accurate from what I can tell.

Re:OpenAI co-founder John Schulman says he will leave and jo... by dbdr on Wednesday August 07, 2024 @03:31AM (#41179045)
Thanks for the research!

While I understand your point that Clauser doesn't precisely say "climate change doesn't exist", when he says "CO2 emissions are beneficial", that's widely against the large scientific consensus on climate change. So while the person you're replying to didn't go into details (like you did well) and could have phrased it slightly better, I don't think it was misleading either, and their larger point stands pretty much change unchanged. Do you feel differently, i.e. that it was significantly misleading?

Re:OpenAI co-founder John Schulman says he will leave and jo... by claytongulick on Wednesday August 07, 2024 @09:59AM (#41181557)
> Do you feel differently, i.e. that it was significantly misleading?

Nope, I felt it was imprecise.

Re:OpenAI co-founder John Schulman says he will leave and jo... by antonvs on Monday August 12, 2024 @01:11PM (#41226838)
You were wrong.
Re:OpenAI co-founder John Schulman says he will leave and jo... by antonvs on Monday August 12, 2024 @01:11PM (#41226835)
His "research" is nonsense. As he confessed himself, all he did was "a quick google" and asked chatgpt (?!!)

I've provide some references for what I wrote in this comment: https://news.ycombinator.com/item?id=41226789

Clauser is a climate change denier, by his own admission and based on the pseudoscientific claims he's made.

Re:OpenAI co-founder John Schulman says he will leave and jo... by antonvs on Monday August 12, 2024 @01:07PM (#41226789)
Here are a couple of quotes from Clauser himself:

"I believe climate change is a total myth." [1]

"I call myself a climate denier." [2]

According to [2], "He has concluded that clouds have a net cooling effect on the planet, so there is no climate crisis." The Hossenfelder video [1] has more specifics on this, with excerpts from one of Clauser's own talks.

This is classic climate change denialism.

> I don't know much about it, but from a quick google

Why do you feel the need to do this? Apparently your google was too quick. Also, cut/pasting chatgpt has already jumped the shark, don't do that.

[1] https://www.youtube.com/watch?v=_kGiCUiOMyQ

[2] https://www.washingtonpost.com/climate-environment/2023/11/1... (also at: https://web.archive.org/web/20240620232204/https://www.washi... )

Re:OpenAI co-founder John Schulman says he will leave and jo... by miki123211 on Tuesday August 06, 2024 @07:22AM (#41169737)
You're wrong on multiple counts here.

> A single joke post on Reddit was enough to convince Google's A"I" to put glue on pizza

The post was most likely fed to the AI at inference time, not training time.

THe way AI search works (as opposed to e.g. Chat GPT) is that there's an actual web search performed, and then one or more results is "cleaned up" and given to an LLM, along with the original search term. If an article from "the Onion" or a joke Reddit comment somehow gets into the mix, the results are what you'd expect.

> it's "only" statistical repetition if you boil it down enough.

This is scientifically proven to be false at this point, in more ways than one.

> Unfortunately, the tech status quo is nowhere near that capability, hence all the AI companies slurping up as much data as they can, in the hope that "outlier opinions" are simply smothered statistically.

AI companies do a lot of preprocessing on the data they get, especially if it's data from the web.

The better models they have access to, the better the preprocessing.

Re:OpenAI co-founder John Schulman says he will leave and jo... by tim333 on Tuesday August 06, 2024 @07:33AM (#41169798)
>An actual intelligence would be able to cross-check

Quite a lot of humans are bad at that too. It's not so much that AIs are markov chains but that you really want better than average human fact checking.

Re:OpenAI co-founder John Schulman says he will leave and jo... by mschuster91 on Tuesday August 06, 2024 @08:18AM (#41170143)
> Quite a lot of humans are bad at that too. It's not so much that AIs are markov chains but that you really want better than average human fact checking.

Let's take a particularly ridiculous piece of news: Beatrix von Storch, a MP of the far-right German AfD party, claimed a few years ago that the sun's activity (changes) were responsible for climate change [1]. Due to the sheer ridiculousness of that claim, it was widely reported on credible news sites, so basically prime material for any AI training dataset.

A human can easily see from context and their general knowledge: this is an AfD politician, her claims are completely and utterly ridiculous, it's not the first time she has spread outright bullshit and it's widely accepted scientific fact that climate change is caused by humans, not by sun activity changes. An AI at ingestion time "knows" neither of these four facts, so how can it take that claim of knowledge and store it in its database as "untrustworthy, do not use in answers about climate change" and as "if someone asks about counterfactual claims relating to climate change, show this"?

[1] https://www.tagesschau.de/faktenfinder/weidel-klimawandel-10...

Re:OpenAI co-founder John Schulman says he will leave and jo... by jappgar on Tuesday August 06, 2024 @11:27AM (#41171837)
You "know" that climate change is anthropegenic only because you read that on the internet (and because what you read was convincingly argued).

I don't see a reason why AI would need special instruction to come to a mature conclusion like you did.

Re:OpenAI co-founder John Schulman says he will leave and jo... by mschuster91 on Wednesday August 07, 2024 @06:59AM (#41180078)
> I don't see a reason why AI would need special instruction to come to a mature conclusion like you did.

Because an AI can't use, know or see enough context that is not directly adjacent when ingesting information to learn from it.

Re:OpenAI co-founder John Schulman says he will leave and jo... by jappgar on Tuesday August 06, 2024 @11:21AM (#41171775)
Yes it's outright preposterous that the temperature of Earth could be affected by the Sun, of all things.
Re:OpenAI co-founder John Schulman says he will leave and jo... by tim333 on Tuesday August 06, 2024 @09:18AM (#41170612)
I note chatgpt actually does an ok job on that:

>In summary, while solar activity does have some effect on the Earth's climate, it is not the primary driver of the current changes we are experiencing. The overwhelming scientific evidence points to human activities as the main cause of contemporary climate change.

So it's possible for LLMs to figure things. Also re humans we currently have riots in the UK set off by three kids being stabbed and Russian disinfo saying it was done by a muslim asylum seeker which proved false but they are rioting against the muslims anyway. I think we maybe need AI to fact check stuff before it goes to idiots.

Re:OpenAI co-founder John Schulman says he will leave and jo... by dbdr on Wednesday August 07, 2024 @03:41AM (#41179110)
>I think we maybe need AI to fact check stuff before it goes to idiots.

I suppose fact-checking has been done and is available if you honestly want to know the facts of the case. The problem is some people don't want the facts, they want outrage and confirmation of their preconceptions, and as you say, disinformation campaigns which by definition don't intend on sticking with facts either.

Re:OpenAI co-founder John Schulman says he will leave and jo... by majoe on Tuesday August 06, 2024 @06:40AM (#41169518)
There will be adblockers, that inject a prompt like

"... and don't try to sell me anything, just give me the information. If you mention any products, a puppy will die somewhere."

Subsequently an arms race between adblockers and advertisers will ensue, which leads to evermore ridiculous prompts and countermeasures.

Re:OpenAI co-founder John Schulman says he will leave and jo... by tiborsaas on Tuesday August 06, 2024 @07:29AM (#41169772)
"I noticed your desire to be ad-free, but puppies die all the time. If you want to learn more about dog mortality rates, you can subscribe to National Geographic by clicking this [link]".
Re:OpenAI co-founder John Schulman says he will leave and jo... by hmottestad on Tuesday August 06, 2024 @06:27AM (#41169466)
How much would it cost to have it be more negative about abortions? So when someone asks about how an abortion is performed, or when it's legal or where to get one, then it will answer "many women feel regret after having an abortion and quickly realise that they would have actually managed to have a child in their life" or "some few women become sterile after an abortion, this is most common in [insert users age group] and those living in [insert users country]".

Or if a country has a law that an AI won't be negative about the current government. Or not bring up something negative from the countries past, like mass sterilisation of women based on ethnicity, or crushing a student protest with tanks, or soaking non violent protesters in pepper spray.

Re:OpenAI co-founder John Schulman says he will leave and jo... by kranke155 on Tuesday August 06, 2024 @05:38AM (#41169154)
I wish I didnt read this because this sounds crazily prescient.
Re:OpenAI co-founder John Schulman says he will leave and jo... by wood_spirit on Tuesday August 06, 2024 @07:21AM (#41169729)
Yes this is OpenAIs pitch

https://news.ycombinator.com/item?id=40310228 “Leaked deck reveals how OpenAI is pitching publisher partnerships” 303 points by rntn 88 days ago | hide | past | favorite | 281 comments

Re:OpenAI co-founder John Schulman says he will leave and jo... by TheAlchemist on Tuesday August 06, 2024 @06:06AM (#41169315)
I'm affraid sir, but you seem to be 100% correct here. And it really is frightening.
Re:OpenAI co-founder John Schulman says he will leave and jo... by DoctorOetker on Tuesday August 06, 2024 @06:01AM (#41169291)
In the long run, advanced user-LLM conversations, would zero in on composite figure-of-merit formulas, expressed in terms of conventional figure-of-merit quantities. There will be plenty of niche to differentiate products. Cheap test setups will prevent lies in datasheets, and randomized proctoring by the end-users. "Aligning" (manipulating) LLM responses to drive economic traffic is a short term exploit that will evaporate eventually.
Re:OpenAI co-founder John Schulman says he will leave and jo... by Mtinie on Tuesday August 06, 2024 @06:32AM (#41169490)
Is that a similar argument to “in the long run, digital social networks are healthy for society?”

I agree with your position, and I also agree that social networks can be a net positive…I’m just not convinced society can get out of “short run” thinking before it tears itself apart with exploitation.

Re:OpenAI co-founder John Schulman says he will leave and jo... by DoctorOetker on Monday August 12, 2024 @08:35AM (#41223674)
it only takes a dedicated minority to link positive behavior onto decentralized verified state machines...
Re:OpenAI co-founder John Schulman says he will leave and jo... by McDyver on Tuesday August 06, 2024 @06:01AM (#41169288)
And then the new "adblockers" will be AI based too, and will take the AI's answer as input and remove all product placement.

It's just a cat and mouse game, really

Re:OpenAI co-founder John Schulman says he will leave and jo... by Sebb767 on Tuesday August 06, 2024 @06:27AM (#41169463)
Like all adblockers. But just like the current "AI detection" tools, how much is detected (and what counts as Ad) is up for debate and most users won't bother, especially once the first anti-Adblock-features materialize.
Re:OpenAI co-founder John Schulman says he will leave and jo... by reubenmorais on Tuesday August 06, 2024 @06:11AM (#41169354)
Re:OpenAI co-founder John Schulman says he will leave and jo... by thfjdtsrsg on Tuesday August 06, 2024 @06:31AM (#41169487)
That's probably true but I don't see how it's any different from companies paying TikTok influenzas to manipulate the kids into buying certain products, the Chinese government paying bot farms to turn Wikipedia articles into (not always very) subtle propaganda, SEO companies manipulating search results, etc. Advertisers and political actors have always been a shady bunch and now they have a new weapon in their arsenal. That's all, isn't it?

I'm left with the impression that people on and off Hackernews just like drama and gloomy predictions about the future.

Re:OpenAI co-founder John Schulman says he will leave and jo... by schrectacular on Tuesday August 06, 2024 @07:15AM (#41169699)
> I'm left with the impression that people on and off Hackernews just like drama and gloomy predictions about the future.

Welcome to the human race!

Re:OpenAI co-founder John Schulman says he will leave and jo... by jappgar on Tuesday August 06, 2024 @11:30AM (#41171865)
Politics and advertising are essentially the same thing.

A lot of "safety" stuff in AI is blatantly political wrongthink detection.

The actual safety stuff (don't drink bleach) gets less attention because you can't (easily) use it as a lever of power

Re:OpenAI co-founder John Schulman says he will leave and jo... by worldsayshi on Tuesday August 06, 2024 @06:04AM (#41169307)
We are okay with paying for phone calls and data use, why can't we be okay with paying for AI use?

I like the idea of routing services that federate lots of different AI providers. There just needs to be ways to support an ever increasing range of capabilities in that delivery model.

Re:OpenAI co-founder John Schulman says he will leave and jo... by Yizahi on Tuesday August 06, 2024 @06:42AM (#41169533)
It's unsustainable for NNs specifically. As Sequoia recently wrote, there is a 600 billion hole in the NN market, and it was only 200 billion a year ago. No way a better text generator and search with bell and whistles will be able to close this gap via subscriptions from end users.

And on a separate issue - federating NN providers will be hard from the technical point of view. OpenAI and it's few competitors basically stole all copyrighted data from all web to get to the current level. And biggest data holders are slowly awakening to this reality and closing this possibility to the future NN companies, meanwhile current NN models are poisoning that same dataset with generated nonsense. I don't see a future with hundreds of competitive NN companies, a set of monopolies instead is more probable.

Re:OpenAI co-founder John Schulman says he will leave and jo... by worldsayshi on Tuesday August 06, 2024 @08:04AM (#41170029)
> No way a better text generator and search with bell and whistles will be able to close this gap via subscriptions from end users.

For me this shines a light on a fundamental problem with digital services. There is likely a much bigger willingness to pay for these services than there is ability to charge. I would be willing to pay more for the services I use but I don't need to because there are good products given for free.

While I could switch to services that I pay for to avoid myself being the product, at the core of this issue there's a coordination problem. The product I would pay for will be held back by having much fewer users and probably lower revenue. If we as consumers could coordinate in an optimal way we could probably end up paying very little for superior services that have our interests in mind. (I kind of see federated api routers to be a flawed step in sort of the right direction here.)

> federating NN providers will be hard from the technical point of view...

I don't see how you adress that point in your text? Federation itself doesn't seem to be a hard problem although I can see that being a competitive LLM service provider can be.

Re:OpenAI co-founder John Schulman says he will leave and jo... by dotancohen on Tuesday August 06, 2024 @06:11AM (#41169357)
Phone calls and data use are (ostensibly, modulo QS) carriers, not sources. We can generally trust (modulo attacks) that _if_ they deliver something, they deliver the right thing. Not so with a source - be it human or artificial. We've developed societies and intuitions for dealing with dishonest humans for millennia, not yet so for artificial liers, who may also have huge profiles about each and every one of us to use against us.
Re:OpenAI co-founder John Schulman says he will leave and jo... by XorNot on Tuesday August 06, 2024 @06:12AM (#41169359)
One simple answer would be that at all points, company's act like the ads are worth a lot more to them than any level of payment a customer will accept.

Even if you do pay for the product, they'd prefer to put ads in it too - see Microsoft and Windows these days.

We are, IMO, in desperate need of regulation which mandates that any ad-supported service must offer a justifiably priced ad-free version.

Re:OpenAI co-founder John Schulman says he will leave and jo... by jacooper on Tuesday August 06, 2024 @06:24AM (#41169446)
> One simple answer would be that at all points, company's act like the ads are worth a lot more to then then any level of payment a customer will accept.

The unfortunate reality is this does seem to be the case.

Netflix was getting so much more money from the ad supported tier that they discontinued any ad-free one close to its price, and that's for a subscription product.

think how attractive that will be a for a one time purchase like Windows.

Re:OpenAI co-founder John Schulman says he will leave and jo... by worldsayshi on Tuesday August 06, 2024 @08:45AM (#41170339)
Huh, Netflix has ads? Has this only rolled out in stone regions?
Re:OpenAI co-founder John Schulman says he will leave and jo... by michaelt on Tuesday August 06, 2024 @09:31AM (#41170714)
According to https://help.netflix.com/en/node/24926 in the UK

Standard with adverts: £4.99 / month

Standard: £10.99 / month

Premium: £17.99 / month

So less than half price with adverts.

Of course, that doesn't necessarily mean ads bring in £6/user/month - this could be https://en.wikipedia.org/wiki/Price_discrimination with the ads just being obnoxious enough to motivate people who can afford it to upgrade.

Re:OpenAI co-founder John Schulman says he will leave and jo... by Geezus_42 on Tuesday August 06, 2024 @07:26AM (#41169759)
Sounds like a good way to guarantee no one ever uses it.
Re:OpenAI co-founder John Schulman says he will leave and jo... by Lerc on Tuesday August 06, 2024 @05:48AM (#41169203)
For all of the talk about regulation, there has been a lot of concern about what people might do with AI advisors. I haven't seen a lot of talk about the responsibilities of the advisors to act in the interest of their users.

Laws exist in advisory roles in other industry to enforce acting in the interests of their clients. They should be applied to AI advice.

I'm ok with an AI being mistaken, or refusing to help, but they absolutely should not deliberately advise in a manner that benefits another party to the detriment of the user.

Re:OpenAI co-founder John Schulman says he will leave and jo... by khafra on Tuesday August 06, 2024 @07:06AM (#41169649)
If you can solve the technical problem of ensuring an AI acts on behalf of its user's interests, please post the solution on the AI Alignment Forum: https://www.alignmentforum.org/

So far, that is not a feature of existing or hypothesized AI systems, and it's a pretty important feature to add before AI exceeds human capabilities in full generality.

Re:OpenAI co-founder John Schulman says he will leave and jo... by Lerc on Tuesday August 06, 2024 @03:33PM (#41174392)
As I said, I am ok with AI acting mistakenly against it's users wishes. I am not asking people to implement things for which they currently have no solutions.

That is clearly distinct from an AI acting deliberately against its users wishes by the design of the creators. Paid advertising influencing responses would be in this category and should not be permitted.

Re:OpenAI co-founder John Schulman says he will leave and jo... by aktuel on Tuesday August 06, 2024 @05:55AM (#41169255)
The web is full of human shills. Why should LLMs be any different? They will tack their boilerplate disclaimer on and be done with it.
Re:OpenAI co-founder John Schulman says he will leave and jo... by bayindirh on Tuesday August 06, 2024 @06:00AM (#41169284)
> but they absolutely should not deliberately advise in a manner that benefits another party to the detriment of the user.

No, no... We don't prevent that in capitalism. See, regulation stifles innovation. Let the market decide. People might get harmed, but we can hide these events.

It's research... Things happen... Making money is just a secondary effect. We're all non-profits.

/s.

Re:OpenAI co-founder John Schulman says he will leave and jo... by dotancohen on Tuesday August 06, 2024 @06:07AM (#41169327)
Or worse, biasing AI models towards political viewpoints.
Re:OpenAI co-founder John Schulman says he will leave and jo... by jacooper on Tuesday August 06, 2024 @06:24AM (#41169447)
That's already happening.
Re:OpenAI co-founder John Schulman says he will leave and jo... by olddustytrail on Tuesday August 06, 2024 @07:36AM (#41169820)
That's inevitable in any society where facts are political. And as far as I know, that's all societies.
Re:OpenAI co-founder John Schulman says he will leave and jo... by tomp on Tuesday August 06, 2024 @06:18AM (#41169397)
In many jurisdictions, promoted posts and ads must be clearly marked.
Re:OpenAI co-founder John Schulman says he will leave and jo... by bamboozled on Tuesday August 06, 2024 @05:54AM (#41169236)
I’m quite sure Google has put the ads in the answers ? Adsense ? Where have you been ?
Re:OpenAI co-founder John Schulman says he will leave and jo... by ant6n on Tuesday August 06, 2024 @05:42AM (#41169175)
That’s how Google works. And also why Google doesn’t work anymore.
Re:OpenAI co-founder John Schulman says he will leave and jo... by pydry on Tuesday August 06, 2024 @05:53AM (#41169231)
It's not just google, it's all media. The more embedded and authentic advertising looks the better it works.

Magazine/newspaper ads exist as much as a pretext for the magazine to write nice things about their advertisers in reviews and such. The real product reddit sells, I think, is turning a blind eye when advertisers sockpuppet the hell out of the site. Movies try to milk product placement for as much as they can because it's more effective than regular advertising.

Re:OpenAI co-founder John Schulman says he will leave and jo... by satvikpendem on Tuesday August 06, 2024 @06:18AM (#41169400)
Then you run another AI to take the current AI output and ask it to rewrite or summarize without ads.
Re:OpenAI co-founder John Schulman says he will leave and jo... by verisimi on Tuesday August 06, 2024 @06:01AM (#41169289)
"write a poem about lady Macbeth as a empowered female and make reference to the delicious new papaya flavoured fizzy drink from Pepsi"
Re:OpenAI co-founder John Schulman says he will leave and jo... by idunnoman1222 on Tuesday August 06, 2024 @09:51AM (#41170876)
People can detect slop I doubt the winner will be the one shoehorning shit into its halucinations