Well let's come back to reality. ChatGPT is in fact vastly different from Google summarizing a search. Maybe that's all you use it for but there's people building virtual girlfriend platforms, an API that an alarming amount of businesses are integrating into their standard workflows, and the damn thing can literally talk. It can talk to you. Google search summarizing gives a snippet about a search. You can't have a conversation with it, you cant ask it advice about your girlfriend, it won't talk to you like a trusted advisor when you ask it a question about your degree or job. It can fucking talk. That is the difference. Remember when it first came out and all these people were convinced that it was alive and sentient and could feel pain and would shortly take over the world? Please remind me when that happened for Google search.

Safety is about setting up the infrastructure to control uranium sources before the first bomb gets built. It's not about right now, it's about the phase change that happens the moment we take that step. Don't you want to have infrastructure to prevent possible societal strife if possible?

Of course gpt has value, bombs have value, enron had value, the housing market has value. If i could retort i'd say the term 'value' is much too vague to contribute to a discussion about this. The value it has is the danger, they're the same thing. If i suddenly quadruple the money supply in every country in the world, do you think that would improve the lives of the majority of humans? Or is it possible that would be looked back on a a catastrophic event that obliterated societies and killed innumerable people. Hard to say huh? Maybe it wouldn't, maybe it would, who can actually know? Wouldn't it be better for us to have some kind of system to maybe handle that before it leads to potential destruction. If instead, i announce that at some point in the future this event might occur. Does that change your calculus? How do you feel about global climate destabilization? How do you feel about the prospect of another world war?