News for hackers. Stuff that matters.
Re:FDA slams EpiPen maker by TeMPOraL on Friday September 08, 2017 @02:53AM (#15198329)
First of all, for any non-trivial real-world problem (like e.g. doing a simplest of tasks while respecting human moral values), we do not, generally, agree on the variable (function, actually) being optimized. Nor can we even define it with sufficient amount of precision. This is the core of what's known as "Friendly AI" problem (also known as "AI control problem").

Secondly, optimization algorithms "have no hidden agenta and are predictable" only insofar as you're able to comprehend their implementation. Which, for anything more trivial than blinking an LED, you're most likely not. This is the core of what's known as "programs have bugs" problem in software engineering, and also of the "bugs are exploitable" and "programs can have hidden backdoors" problems in software security engineering.

There are no comments on this comment yet.