> AI labs have not worked well with affected communities at all and often downright exploited them

The first reviews of OAI's dump on math are coming out. Quasi-Riemann Hypothesis Proof looks to be valid. The irony is that is uses and approach that the people who work in that area have disregarded for the most part. As well as mining some other parts of maths corpus. There really isnt "innovation" there.

For as much as OAI is guilty of leveraging work in progress, the complaints about some of the other work(s) are looking spurious (and I'm being very kind using that word).

It's not terrifying because it's unknown. It's terrifying because a tiny number of obscenely rich psychopaths are trying to take sole control of it so they can enshrine themselves as living gods and make 99% of humans so obsolete that they die sick and cold in the streets. That's their overt goal, and almost all evidence we have from history and current politics suggests that they will be wildly successful at this. None of this is for you, it's all for them. All of it. That's why it's terrifying.