News for hackers. Stuff that matters.
Re:AI Nationalism by canjobear on Thursday June 14, 2018 @02:16PM (#17313985)
I'm always a bit confused when people call neural networks "universal function approximators" as if that makes them trivial or weak.

Suppose we have a really strong universal function approximator---stronger than current neural networks, whose generalization properties are not really that great in the grand scheme of things as of 2018. Tell it to approximate the action policy that maximizes some overly-simplistic geopolitical objective function, like GDP or territory controlled at time t+1. It doesn't seem at all obvious that this thing could not take over the world or at least cause significant havoc if given sufficient resources.

Re:AI Nationalism by YeGoblynQueenne on Thursday June 14, 2018 @03:10PM (#17314474)
But what are "sufficient resources" in this case? How do you train a universal function approximator, even a good one, in, say "increasing GDP"? Where do you get the examples for that?

The problem is that with such a vague objective as "maximise GDP" or "maximise controlled territory" you need to train a model that is extremely broad in scope - because the objective might be narrow, but the steps to realise it are extremely varied. In practice, you're trying to approximate a function that is outputting the state of the entire world at each time step. Good luck with achieving that in practice.

Edit: The bit about collecting examples is not a trivial problem. Note that the successes of deep learning so far are in domains where not only the objective is well defined ("choose one of n categorical labels") but also the data associated with the objectives is easy to collect and has an obvious relation to the outputs. Say, if you want to train an image classifier to recognise images of dogs- obviously you need to collect images of dogs. This is not the case in "increase GDP" type objectives, where it is not even clear what exactly influences a country's GDP. In principle, you could feed the entire world as examples to the model, but in practice, that's just unfeasible.

Re:AI Nationalism by ShabbosGoy on Thursday June 14, 2018 @04:35PM (#17315129)
> But what are "sufficient resources" in this case? How do you train a universal function approximator, even a good one, in, say "increasing GDP"? Where do you get the examples for that?

You could specify a simpler goal like “increase economic output”, and an example might be something like optimizing the Cobb-Douglas production function. Even that very narrow goal in the context of say, manufacturing Teslas, would give me pause. Look up “instrumental convergence” to see why the above is a bad idea.

Re:AI Nationalism by YeGoblynQueenne on Thursday June 14, 2018 @05:29PM (#17315540)
When I say "examples" I mean training examples- a dataset to train (and validate) on.

From what I can see on wikipedia, the parameters of Cobb-Douglas are the value of goods produced, labour, capital, "total factor productivity" (as I understand it, everything other than labour and capital that might contribute to productivity) and a couple of constants. For an AI to maximise the output of the function you'd have to somehow make it possible for it to manipulate those parameters- to hire or fire personel, to spend or acquire capital and to somehow manage all those unknown factors that might be contributing to the output.

The question is: how do you do that? You can certainly collect, or even auto-generate examples of the inputs and outputs of the functions, since we're just talking numerical parameters, and find a maximum of the function. But for an AI to actually improve the productivity of a business, it would have to do a lot more than that. It would need the ability to manipulate those parameters directly in the real world. Otherwise, all it would do is calculate a number. Which is not that very threatening.

Re:AI Nationalism by eli_gottlieb on Thursday June 14, 2018 @04:30PM (#17315092)
>some overly-simplistic geopolitical objective function, like GDP or territory controlled at time t+1.

The hard part here is writing down that objective function. Remember, an AI/ML/cogsci algorithm is locked inside a black box, that being the hardware it runs on. Any objective function for RL must be expressed as a function (preferably a smoothly differentiable one, for gradient descent) of the sense-data available to the agent and the agent's hypothesis class about the world. Naive RL tends to optimize the function by, where at all possible, systematically decorrelating the agent's sense-data and reinforcement signal from the distal causes we intend them to represent.

Re:AI Nationalism by SiempreViernes on Thursday June 14, 2018 @04:47PM (#17315236)
You mean write down a good objective function, making terrible ones are trivial. And the hard part is figuring out if the objective function you've spent six months refining actually gives sensible scores or if you just encoded all the mean of your data in that one hand tuned constant with six digits.
Re:AI Nationalism by AndrewKemendo on Thursday June 14, 2018 @10:41PM (#17317133)
In my opinion, it's an impossible and undesirable task.

So for example, write down the objective function for current General Intelligence: Humans. It's impossible, and has been the work of the field of Philosophy/Economics since we started seriously thinking about it.

Re:AI Nationalism by eli_gottlieb on Friday June 15, 2018 @07:57AM (#17319079)
Ehhhh we're pretty close on that one, actually. https://www.nature.com/articles/s41562-017-0069
Re:AI Nationalism by AndrewKemendo on Friday June 15, 2018 @01:06PM (#17321433)
Did you link the right article?

Nothing in that article discusses interpersonal neurological response systems or anything relating to how mores and boundaries are created.

Seems like you're linking to something which may be on the track to narrow down consciousnesses which is a separate question - and one I also question the benefit of caring about.

Re:AI Nationalism by eli_gottlieb on Friday June 15, 2018 @04:05PM (#17323084)
>Nothing in that article discusses interpersonal neurological response systems or anything relating to how mores and boundaries are created.

Well, we weren't discussing social reasoning and behavior, so I linked an article talking about the systems governing the brain's "objective function".

Re:AI Nationalism by AndrewKemendo on Friday June 15, 2018 @04:59PM (#17323513)
In fact I was, but I wasn't explicit enough, so that's my fault.

My original statement should have been: "We can't model Humanity's Collective Objective Function" - which is what would be behind what we are interested in: Stable functioning muti-agent systems. I think EY took a crack at this a long time ago and rightly abandoned the concept (see: CEV).

Even with that clarification I disagree with the premise that we can model an "objective function" for an individual strictly in-vivo. Modelling an individual agent's reasoning/function system doesn't account for the environmental context it exists inside of, gives input into and responds to. So even if it was possible to understand the mechanism for intra-personal decision criteria, and I don't think it probably is, I don't think it's generalizable without having the context of inputs.

Assuming that we could do this, I don't think you can extrapolate intentionality directly from individual to collective groups - which for an AGI is what is existentially important as it needs to be collectively general to solve the existential problem.

I also don't think this is desirable as a framework for AGI - as humans, despite our intelligent status, are quite unstable and sub-optimal in groups.

Re:AI Nationalism by eli_gottlieb on Sunday June 17, 2018 @02:48PM (#17333673)
>My original statement should have been: "We can't model Humanity's Collective Objective Function" - which is what would be behind what we are interested in: Stable functioning muti-agent systems. I think EY took a crack at this a long time ago and rightly abandoned the concept (see: CEV).

If no such thing exists, then it was the wrong thing to investigate, so stop being interested in it.

>Even with that clarification I disagree with the premise that we can model an "objective function" for an individual strictly in-vivo. Modelling an individual agent's reasoning/function system doesn't account for the environmental context it exists inside of, gives input into and responds to. So even if it was possible to understand the mechanism for intra-personal decision criteria, and I don't think it probably is, I don't think it's generalizable without having the context of inputs.

That's just an inverse reasoning/theory-of-mind problem, one that normal theory-of-mind models and actual human brains solve every day.

>Assuming that we could do this, I don't think you can extrapolate intentionality directly from individual to collective groups - which for an AGI is what is existentially important as it needs to be collectively general to solve the existential problem.

What's this about "collectively general" and "the existential problem"? You seem to have gone off the deep end into philosophy salad.

>I also don't think this is desirable as a framework for AGI - as humans, despite our intelligent status, are quite unstable and sub-optimal in groups.

Considering you don't seem to know much about how humans work and what causes us to work well or badly in various situations, this statement comes off as almost racist.

Re:AI Nationalism by dang on Thursday June 21, 2018 @01:41PM (#17367426)
> you don't seem to know much about how humans work [...] comes off as almost racist

You broke the HN guidelines pretty badly here, first by getting personal, and second by not doing this: "Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize." The result was a whole litany of complaints elsewhere, which were understandable if off topic (https://news.ycombinator.com/item?id=17359858).

You unfortunately have a long history of breaking the site guidelines. Would you please reread them and fix this? It's really not ok, and even though I appreciate your substantive comments, their value doesn't obviously exceed the damage you've caused with harshness, swipes, and uncharitable responses over the years.

https://news.ycombinator.com/newsguidelines.html

Re:AI Nationalism by AndrewKemendo on Sunday June 17, 2018 @03:07PM (#17333773)
Clearly you have a chip on your shoulder so it's not worth having any further discussion.
Re:AI Nationalism by eli_gottlieb on Monday June 18, 2018 @04:05PM (#17341253)
Well, clear communication is important. The more important something is, the more clarity is necessary.
Re:AI Nationalism by schoen on Thursday June 14, 2018 @02:21PM (#17314038)
At least, a lot of things that have conventionally been understood as very hard for AI (like catching a ball or playing Go) can be viewed as function approximations!
Re:AI Nationalism by stochastic_monk on Thursday June 14, 2018 @08:30PM (#17316531)
Mixtures of Gaussians are also universal function approximators. It more makes clear that it’s in a class of functions that could each do many of the things neural networks do.