News for hackers. Stuff that matters.
Re:OpenAI safety leader quits, warning AI company's culture ... by hnlmorg on Sunday October 04, 2026 @04:09AM (#49951742)
Because greed.

The examples for the dangers of AI is always comparisons with tools designed to destroy (which is understandable). But the problem with AI is it has the potential to create wealth for investors.

Thus those who have the opportunity to change course also have a conflict of interest in making that decision.

Re:OpenAI safety leader quits, warning AI company's culture ... by BlipBlopBlap on Sunday October 04, 2026 @05:28AM (#49952135)
There's also a zero sum, race dynamic between geopolitical rivals. The US will not permit China to win anything if they can prevent it. The destruction of humanity is only a possibility and China will continue to develop it anyway if the US slows down.

So the choice is: negotiate an unverifiable treaty (I.e. there's no way to verify compliance), or keep going as you are and try your best to not cause the destruction of humanity without slowing down.

Re:OpenAI safety leader quits, warning AI company's culture ... by hnlmorg on Sunday October 04, 2026 @05:35AM (#49952175)
I don’t think OpenAI, Anthropic, nor Google are building their tech because they want to beat the Chinese. They’re building it because they want to hold the monopoly in the west (ie make lots of money).

The China argument is just a convenient scapegoat to convince the public that this isn’t just about greed.

Re:OpenAI safety leader quits, warning AI company's culture ... by BlipBlopBlap on Sunday October 04, 2026 @05:55AM (#49952323)
Do you think Chinese models wouldn't dominate the western market if they were 1-2 years ahead in development? It doesn't have to be military conflict for it to be factored into the zero sum power balance.
Re:OpenAI safety leader quits, warning AI company's culture ... by hnlmorg on Sunday October 04, 2026 @06:07AM (#49952419)
You might be right, but it’s impossible to know which way cause and effect are here.

For example, we don’t know if the pace of Chinese development of AI would have equal to what it is now if US companies weren’t racing against each other already.

I do fully believe that Chinese industry is lead by a desire to out pace the west. But I’m not convinced the same is true for the most American private entities. I think the reward model is different between businesses in America and businesses in China. I think the ambitions of CEOs is different. And I’m really not convinced that the CEOs of America are nearly as patriotic as they like to promote themselves to Trump and other political parties.

Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @02:59PM (#49956774)
We could still play a geopolitical race without ceding monopolistic control to the frontier labs. We could require training and inference hardware be provided on an equal access basis. A broader ecosystem may drive more innovation that a concentrated ecosystem.
Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @02:56PM (#49956732)
Greed can be counter balanced by liability. It can also be limited by removing market access. For much of American history you couldn’t get a corporate charter for multiple states, you were only allowed to operate within one state. Imagine if Sam Altman was only allowed to serve inference to customers in California and legally prohibited from setting up other companies and running inference in New York, someone else would then set up a competing business in New York. Market access is a choice and people are so used to liberalized commerce that they forget the restrictions that are available and existed in the past.
Re:OpenAI safety leader quits, warning AI company's culture ... by hnlmorg on Sunday October 04, 2026 @03:46PM (#49957158)
Corporate liability is only as good as the consequences and history has proven its far more profitable to knowingly do harm and then pay the fine, than it is to not be evil in the first place.

And that’s assuming the company even gets fined. More often than not, cases don’t even get that far.

Re:OpenAI safety leader quits, warning AI company's culture ... by digitaltrees on Sunday October 04, 2026 @05:08PM (#49957893)
I am not suggesting corporate liability. I am suggesting removing corporate liability protections and returning to partnership liability for executives and even equity holders. The law provides for piercing the corporate veil already which allows courts to disregard the liability protection offered by a corporation and impose liability on the individuals.