As a summary, generating content isn't new and just increases your moderation load. AI is not something "special". It's just software, at the end.
I don't need to do this discussion, this is basic introductory education and consent in University courses about AI and especially about system engineering verification and certification, which is required for most customers on a large scale and mission critical purposes.
Then why are you on HN, replying to exactly that discussion?
We are not teenagers, I may be wrong, I would be okay with it.
> Here we are specifically talking about probabilistic generative model, which are inherently unsuited for mission critical purposes, as they are engineered right now
In what qualitative way does that differ from any kind of data generation?
You need gun control with bows and arrows, and you still need gun control with machine guns.
That's what I'm saying.
Casually dismissing it with "well it's just extra moderation load" is a mistake, I think.
I still humbly think that it'd still be a cat and mouse game on every side imaginable.
You may argue that this leaves individuals vulnerable (people not being able to discern actual people from chat bots, which was the given example), but in the end, people learn to adapt. They get their own AI assistant to do the job or they keep doing what they did before: Just don't trust anonymous people online. They can be murderers, molesters, terrorists or worse, bots :)
Not particularly the best comparison, we are talking here about applications and services which we sell and we have to make sure that we have the confidence that we can trust our own systems and the customer can rely on our word and engineering skills. Right now we are still in the primordial soup of AI. As long as we do not have proper methods to verify and certify our models, they are dangerous and unpredictable.