News for hackers. Stuff that matters.
Re:Microsoft is investing $1B in OpenAI by pnathan on Monday July 22, 2019 @03:59PM (#20501729)
Eventually a toddler gets over the guardrails, except for the ones which are materially disabled.

I have deep and profound doubts about the notion of guardrails for general intelligence; without even considering the ethical concerns, a general intelligence should be able to simply rewire itself to achieve what it wants. a key part of self-reflection and learning is that rewiring.

so I think that it's a self-defeating notion on the face of it.

(note that I do not have comment on the actual dangers involved here, but only on the philosophy)

There are no comments on this comment yet.