News for hackers. Stuff that matters.
Re:AI by elwell on Wednesday February 19, 2014 @05:20PM (#7266752)
Critically speaking, this article doesn't add anything. I don't know why I read it. Can anyone explain why they upvoted?
Re:AI by hcarvalhoalves on Wednesday February 19, 2014 @07:01PM (#7267644)
Because the title on HN is "AI", which makes it a small click target [1], prone to accidental upvotes.

[1] http://en.wikipedia.org/wiki/Fitts's_law

Re:AI by lbenes on Wednesday February 19, 2014 @10:11PM (#7268570)
Yes, that's exactly how this article gained my upvote. For misclicks and link-bait, I would love to see HN add the ability to retract votes from articles. I have many "saved stories" that I'd love to remove from my list.
Re:AI by sandieman on Wednesday February 19, 2014 @11:13PM (#7268823)
IMO this is much more interesting than a multi-billion dollar exit of a simple chat application
Re:AI by hcarvalhoalves on Wednesday February 19, 2014 @10:23PM (#7268627)
280 votes and counting. I'm betting this will stay on the first page for a long time.
Re:AI by aragot on Wednesday February 19, 2014 @07:53PM (#7267964)
I just did that. iPad here, click target is below 44px.
Re:AI by cpeterso on Wednesday February 19, 2014 @08:38PM (#7268196)
This happens to me all the time on my phone. HN should make bigger voting arrows (or at least on mobile devices).
Re:AI by 3rd3 on Thursday February 20, 2014 @02:21PM (#7272944)
There is actually a neat web app for mobile devices: http://hn.premii.com
Re:AI by 3rd3 on Thursday February 20, 2014 @08:26AM (#7270598)
Isn’t Fitt’s law about how long it takes to aim for an element of a certain size at a certain distance? I think this has nothing to do with Fitt’s law.
Re:AI by hcarvalhoalves on Thursday February 20, 2014 @10:33AM (#7271235)
It has everything to do with accuracy. Smaller targets take more time to aim; that implies your accuracy depends on how close to the optimal speed you aim.
Re:AI by 3rd3 on Thursday February 20, 2014 @02:14PM (#7272907)
I still don’t see what this time-distance-size relation has to say about this case. Do you mean that one could infer since arrow and title are equal in size and close together it requires minimal time to point from the one to the other? It seems like breaking a butterfly on a wheel referring to Fitt’s law here. Sorry for nit-picking, maybe I’m missing something.
Re:AI by hcarvalhoalves on Saturday February 22, 2014 @12:56PM (#7282847)
1) People aim fast. 2) The target "AI" is small. 3) They miss, and click the arrow instead.

It's not that complicated.

Re:AI by 3rd3 on Monday February 24, 2014 @08:32AM (#7290613)
You don’t need Fitt’s law for what you’re saying. It’s obvious that small objects are difficult to aim for. This is the main thing I dislike about HCI/UX: More often than not people have to unnecessarily refer to laws or norms to sell their observations.

The only non-obvious insights Fitt’s law bring are that objects twice as big and twice as far away take the same time to aim for, and that as objects become smaller or distance increases the time only grows logarithmically. Everything else is just squeezed into its definition to make it sound well-founded.

Re:AI by rdl on Wednesday February 19, 2014 @05:47PM (#7267053)
For me, "There are certainly some reasons to be optimistic. Andrew Ng, who worked or works on Google’s AI, has said that he believes learning comes from a single algorithm - the part of your brain that processes input from your ears is also capable of learning to process input from your eyes. If we can just figure out this one general-purpose algorithm, programs may be able to learn general-purpose things." is what was most interesting to me. The idea that there's a fairly simple algorithm to learning, applied in the brain, which produces at least the basic learning capability, and possibly consciousness.
Re:AI by nl on Wednesday February 19, 2014 @06:31PM (#7267433)
Re:AI by electrograv on Wednesday February 19, 2014 @06:59PM (#7267629)
"Deep Learning" is not itself a candidate for anything, because it's not any single algorithm, but a category of approaches.

Deep Learning generally refers to machine learning algorithms that deal with stacking multiple layers of simpler functions to enable more complicated functions, and optimizing all the parameters to best fit your training set and generalize to new samples (the hard part). Though it usually refers to neural networks, I dont think there's any reason it doesn't also apply to other layered approaches as long as there's a relatively unified learning algorithm applied across the whole system.

There are clearly many different deep learning algorithms, even if you just count the permutations of tricks you can choose from to improve layered NN generalization. Though to be fair I think very good progress is being made towards developing "better" algorithms in the sense that new ones (e.g. RBM pretraining + dropout) usual perform better than than older algorithms, no matter what data you use it on (now network architecture is another matter entirely).

Re:AI by nl on Wednesday February 19, 2014 @09:28PM (#7268409)
I actually linked to convolutional neural networks on the Deep Learning page as the algorithm.

But I do agree with your point.

Re:AI by eli_gottlieb on Thursday February 20, 2014 @05:52AM (#7270106)
One of the most interestingly general things about Deep Learning is that unsupervised learning approaches can be used at the bottom of the "stack" to learn more useful high-level features from the input data. This ends up making your higher-level learners more helpful for "Real Stuff".
Re:AI by queensnake on Thursday February 20, 2014 @04:49AM (#7269913)
Yeah but will it satisfy us, if we can't see it making analogies, can't see its semantics; identify with it? This same lack of breakdown into pieces we understand will make it hard to tweak and advance NNs beyond 'good categorizers'.
Re:AI by mannykannot on Friday February 21, 2014 @12:28PM (#7278072)
"Andrew Ng, who worked or works on Google’s AI, has said that he believes learning comes from a single algorithm."

As algorithms can be combined, the existence of any set of algorithms satisfying this goal would automatically imply the existence of a single algorithm incorporating all of them.

If a sufficiently-detailed physical simulation of a human's brain satisfied this goal, then that would be one such algorithm.

Re:AI by stinos on Thursday February 20, 2014 @05:23AM (#7270021)
It's an intersting thought indeed, but I wonder if any neuroscientists would back it up.
Re:AI by elwell on Wednesday February 19, 2014 @05:53PM (#7267123)
Fair enough, but can we imagine a better algorithm?
Re:AI by rdl on Wednesday February 19, 2014 @05:56PM (#7267148)
I've always assumed any real machine intelligence would be scalable to the point where even if it started at a millionth the functionality of a human, it would end up far surpassing humanity.
Re:AI by derefr on Wednesday February 19, 2014 @07:17PM (#7267747)
Why do you believe this?

We don't see animals self-improving to become humans (in the "consciously deciding what revisions to make to their mental architecture at each step" sense), so why would you expect electronic animal-level minds to be able to do the same to become electronic human-level minds, or beyond?

Personally, I doubt even electronic human-equivalent minds would be capable of self-improvement. After all, we are not smart enough to build AIs better than us (yet), so why should electronic minds only as smart as we are be capable of that, either?

A possible answer to that, I suppose, would be that the electronic mind would have far more input/training data fed to it per second than biological minds receive, and far more time to "work on" that sense data to derive patterns between each decision-step.

Re:AI by rdl on Wednesday February 19, 2014 @07:22PM (#7267786)
Because (naively) I'd assume it's some kind of software running on computers, and one can generally improve performance of that by buying more hardware or using better technology (or shorter lived components, or better cooling, or whatever).

If humans created an AI to solve some kind of open-ended problem, where "more AI" made the solution better, there would be every incentive to spend the money on more or better hardware for it. It's not clear that a shark would gain much by being 100x smarter, particularly if the metabolic cost were high; for a lot of human problems, spending 100x more on hardware/power/etc. for a 10% better solution would be quite desirable.

Re:AI by henrygrew on Thursday February 20, 2014 @05:14AM (#7269995)
What about the advantage gained by time, i think a major drawback to human improvement is the effect of death.Given enough time and accumulated experience, self improvement is possible.A machine cannot succumb to death.
Re:AI by aragot on Wednesday February 19, 2014 @08:10PM (#7268067)
I personnaly don't think the brain could be as intelligent if it were only a part of it, like if had 3 senses instead of 5 for example: The emulation of a sense by the others might be necessary to bootstrap the system. So we might just be on the wrong path when we try to teach a small machine to learn.

And maybe, once you have a fully functional brain, that it constantly derives out of bounds. Like sudden overheating, which is litterally the step #1 of a depression in a human. So we might not be able to scale an AI beyond the size of one brain. Apart from clusters obviously, but then you need to sustain civilizations of brains, and civs do collapse every dozen generations.

We might not be materially able to find enough energy to power all of those trials and errors.

Re:AI by aliakbarkhan on Thursday February 20, 2014 @02:43AM (#7269462)
The amount of rampant bulshitting here by obviously unqualified people is amazing. If you don't even know that humans do not, in fact, have five senses, I'm not sure I can take your post seriously even as unqualified speculation.
Re:AI by aragot on Thursday February 20, 2014 @03:09AM (#7269578)
The whole thread including the OP is full of speculation by unqualified people, because AI is the ultimate fantasy for all of us here.

So common sense is a perfectly satisfying qualification to post in this particular thread. Concerning the 5 senses, I refer to common wisdom because it speaks to everyone. Those who know better are probably smart enough to translate "5 senses" into an accurate scientific wording.

Re:AI by membrain on Thursday February 20, 2014 @06:16AM (#7270187)
can we please put this right on top of the whole page and close this thread? too many ai-fanboys in here, who got their knowledge about ai from hollywood movies and video games..
Re:AI by chongli on Wednesday February 19, 2014 @07:41PM (#7267886)
I think we need a better machine first. The current model of one or a handful of CPU cores with very tiny caches talking to memory over a narrow, high latency bus doesn't seem very efficient for building and querying massive (multi-petabyte), highly associative (thousands of associations) data structures.
Re:AI by aragot on Wednesday February 19, 2014 @08:00PM (#7268004)
There are 100,000,000 neurons in the brain. It's not that many. A Core 2 Duo has 169m [1]. A neuron is connected to about 10.000 others. And how many computers do we have in the world? It even sounds like we scientifics are sluggish at inventing AI ;)

[1] http://en.wikipedia.org/wiki/Transistor_count

Re:AI by tim333 on Wednesday February 19, 2014 @08:49PM (#7268238)
Of course a Core 2 Duo has 169m transistors rather than neurons. Interestingly you can do a rough calculation of how much processing power would be needed to do the equivalent of a human brain and it's quite a lot. Hans Moravec calculates it a about 100 million million instructions a second ( http://www.transhumanist.com/volume1/moravec.htm ) based on the processing power required to fuctionally equal the human retina which is reasonably understood. A core 2 duo does something more like 2.7 thousand million instructions per second and so you'd need about 35,000 of them for brain equivalence. So you're talking in 2014 terms of a a top end supercomputer rather than a macbook.
Re:AI by chongli on Wednesday February 19, 2014 @11:14PM (#7268825)
>There are 100,000,000 neurons in the brain.

You're off by 3 orders of magnitude. Try 200 Billion[0].

[0] http://en.wikipedia.org/wiki/Human_brain#Structure

Re:AI by membrain on Thursday February 20, 2014 @05:50AM (#7270099)
this hypothesis is around since at least the 70s (Vernon Mountcastle' paper on cortical similarities), recently (2004) hawkins also published a book in which he promoted the same idea, on which he is currently working with his AGI company numenta.

to be honest, it sounds really great and it could even be the case that there is a very general underlying principle to cortical information processing and pattern recognition. But one should be careful not to mix solid scientific hypotheses with mainstream media hysteria and people who try to grab attention with their simplifications, claiming today that entropy maximization is the underlying principle and changing to sparse coding tomorrow. We are not that far and what we need is solid research instead of over-the-head assumptions and claims "to have solved the riddle" (in that respect, it might not be that far off alchemy :P)

Re:AI by dcre on Wednesday February 19, 2014 @07:51PM (#7267950)
I've felt this way about every Sam Altman piece that's been posted in the past week (and possibly every one I've ever read). And I feel guilty because PG speaks so highly of him. And then I feel guilty for feeling guilty.
Re:AI by sama on Wednesday February 19, 2014 @08:51PM (#7268247)
don't feel guilty. I'm blogging to practice writing. It surprises me at least as much as you when articles like this do well on HN and makes me feel embarrassed I didn't make them better (there are some posts I work really hard on and hope people like, but this was not one of them)
Re:AI by applecore on Wednesday February 19, 2014 @11:12PM (#7268819)
If you're interested, you should read On Intelligence[1] by Jeff Hawkins (inventor of the Palm Pilot). In it, Hawkins presents a compelling theory of how the human brain works and how we can finally build intelligent machines. In fact, Andrew Ng's Deep Learning research is built on Hawkin's "one algorithm" hypothesis.

[1]: http://www.amazon.com/On-Intelligence-Jeff-Hawkins/dp/080507...

Re:AI by ilaksh on Thursday February 20, 2014 @11:28PM (#7275449)
I think you are an excellent blogger and glad that you are posting to HN.

That said, I hope that you will think more critically and clearly before publishing vague, fuzzy, uninformed, and unlogical thoughts (not illogical, but unlogical) like the following:

>The biggest question for me is not about artificial intelligence, but instead about artificial consciousness, or creativity, or desire, or whatever you want to call it. I am quite confident that we’ll be able to make computer programs that perform specific complex tasks very well. But how do we make a computer program that decides what it wants to do? How do we make a computer decide to care on its own about learning to drive a car? Or write a novel?

Consciousness, creativity, and desire are all quite distinct things. It is very important for people who are attempting to approach the coming reality of artificial intelligence to be able to distinguish between different things like that.

There have been computer programs that decide what they want to do for decades. Perhaps you were thinking of a specific human-like type of decision process, but if so, you must say so and reason that way. Otherwise you are just conveying some fuzzy thoughts. And the problem is that you are doing so in the context of real scientific undertakings with results directly applicable to your thoughts.

A computer deciding what to care about or learn or what behavior to engage in "on its own" is related to the previous topic you mention, and in and of itself, does not require artificial general intelligence.

How do we make a computer program write a novel? I think that is a good question and an effective answer to it I believe _might_ be in the category of 'real' artificial general intelligence. However, I think that it will probably soon be possible to create 'narrow' AIs that can generate novels without being generally intelligent. http://www.nytimes.com/2011/09/11/business/computer-generate...

Re:AI by tzm on Wednesday February 19, 2014 @08:55PM (#7268267)
I like your candor.
Re:AI by sushirain on Thursday February 20, 2014 @01:43AM (#7269292)
Artificial general intelligence is not coming in the next, say, 30 years. And I am a big fan. A quick analogy: note that we can't even build an ant. It will take decades after that accomplishment to build a human level intelligence.
Re:AI by mindcrime on Wednesday February 19, 2014 @05:37PM (#7266948)
I upvoted because HN does not have a separate 'save' feature like Reddit, and upvoting is a quick and easy way to tag it as "read this eventually".

So I reflexively upvote anything that looks even vaguely interesting.

In this case, I did read the article, and would probably have upvoted it anyway. Why? Because it stands to serve as the seed of an interesting discussion.

Personally, I don't give a fuck if the article itself "adds anything" or not. Who cares about that? It's irrelevant. If the topic itself and/or the content of TFA are interesting enough that it gets a bunch of interesting HN readers talking and commenting and linking and sharing stuff, then it's a worthwhile article in my book. Not everything has to be an earth-shattering scientific breakthrough, that's published in a peer-reviewed journal, blah, blah, blah.

Re:AI by gus_massa on Wednesday February 19, 2014 @07:07PM (#7267681)
I saved 59 stories in the last 7 days. I don't expect to be able to find any of them in the future (in more than 1 month). The only realistic way to find old stories is to use the search feature, if you can remember a few keywords.
Re:AI by mindcrime on Wednesday February 19, 2014 @08:35PM (#7268178)
No doubt, once they get past a certain age, they become basically useless bookmarks (probably like most bookmarks). But I find that my pattern is usually to vaguely recall something from sometime in the past 3-6 weeks or so, and that often times if I go to my "saved stories" and just start scrolling back through them, I find the one I'm looking for.
Re:AI by charlesju on Wednesday February 19, 2014 @06:34PM (#7267448)
Super pertinent and more in depth article on this subject:

http://www.theatlantic.com/magazine/archive/2013/11/the-man-...

Re:AI by tylermauthe on Wednesday February 19, 2014 @05:31PM (#7266888)
It's nice to hear smart people talk about important topics in a down-to-earth fashion. This is why I upvoted.
Re:AI by membrain on Thursday February 20, 2014 @06:23AM (#7270208)
smart - nope. pretentious guesswork and attention whoring is what is going on here
Re:AI by tylermauthe on Thursday February 20, 2014 @07:00PM (#7274542)
There are many types of smart, good sir.
Re:AI by Zikes on Wednesday February 19, 2014 @05:27PM (#7266839)
It's certainly not something to be published in a scientific journal, but it's a nice subject to bring up and spark discussion on now and then.
Re:AI by awkward on Thursday February 20, 2014 @08:50AM (#7270680)
Cynically, it's a partner at a VC firm saying that AI is a space to watch.

Less cynically, after about 40 years of AI winter, any possible sighting of a sprout is news.

Re:AI by 3rd3 on Wednesday February 19, 2014 @05:33PM (#7266909)
Because it has an exceptionally short link title.
Re:AI by dennisgorelik on Wednesday February 19, 2014 @06:17PM (#7267340)
... and samaltman.com domain
Re:AI by Void_ on Wednesday February 19, 2014 @06:18PM (#7267356)
It's well written. And I like the idea that maybe there is one algorithm. That'd be cool.
Re:AI by mappum on Wednesday February 19, 2014 @05:33PM (#7266906)
What it adds is the simple point, "be optimistic about strong AI in the near future".
Re:AI by Buttons840 on Wednesday February 19, 2014 @05:46PM (#7267047)
So an article that lacks all substance besides "be optimistic about AI" is front page material on HN?
Re:AI by elwell on Wednesday February 19, 2014 @05:29PM (#7266859)
Maybe the second sentence is being taken as a prophecy.