Re:OK, it’s time to freak out about AI
by sangnoir on Thursday March 16, 2023 @03:37PM
(#35187190)
> It doesn't _want_ anything, but humans want to anthropomorphise it.
It's the humans who will deploy it to positions of power I am worried about: ChatGPT may not want anything, but being autocomplete-on-steroids, it gives its best approximation of a human and that fiction may exhibit some very human characteristics (PRNG + weights from the training data).
I know I'm rehashing the article, but it bears repeating.
A system is what it does. It doesn't need to really feel jealousy, rage, pettiness, grudges or guilt in order to exhibit a simulacrum of those behaviors. The bright side is that, it will be humans who will (or will not) put AI systems in positions to give effect to its dictates; the downside is I strongly suspect humans (and companies) will do that to make a bit more money.
It's the humans who will deploy it to positions of power I am worried about: ChatGPT may not want anything, but being autocomplete-on-steroids, it gives its best approximation of a human and that fiction may exhibit some very human characteristics (PRNG + weights from the training data). I know I'm rehashing the article, but it bears repeating.
A system is what it does. It doesn't need to really feel jealousy, rage, pettiness, grudges or guilt in order to exhibit a simulacrum of those behaviors. The bright side is that, it will be humans who will (or will not) put AI systems in positions to give effect to its dictates; the downside is I strongly suspect humans (and companies) will do that to make a bit more money.