News for hackers. Stuff that matters.
Re:With plugins, GPT-4 posts GitHub issue without instructio... by tensor on Wednesday July 05, 2023 @06:24PM (#36608042)
Exactly, this is not human in the loop. The plugin was created without guard rails. A human in the loop guard rail would be "here is an issue template, please confirm to post this". It's really a simple change and this is the sort of thing that regulation should address, it shouldn't try to ban the technology outright, but rather require safe implementation.
Re:With plugins, GPT-4 posts GitHub issue without instructio... by mlyle on Wednesday July 05, 2023 @06:41PM (#36608227)
At the same time, the degree of guard-rail necessary in the plugin is unclear. Is opening a GitHub issue something that should require user confirmation before the fact? Probably, but you could convince me the other way-- especially if GPT4 gets a little better.

We decide how much safety scaffolding is necessary depending upon the potential scale of consequences, the quality of surrounding systems, and the evolving set of user expectations.

I'm not sure regulators should be enforcing guard-rail on these types of items-- or at least not yet.