News for hackers. Stuff that matters.
Re:The Unreasonable Effectiveness of Recurrent Neural Networks by tzs on Thursday May 21, 2015 @11:06PM (#9586428)
> Could we expect a child to learn to speak if they only heard recordings of existing speech with otherwise no human interaction/feedback - correcting them or offering customized and contextual new bits of information?

I once asked a similar question on some online forum [1] where many linguists hung out. My question was if an English-only speaking household left a general interest Spanish language TV station on most of the time when they weren't actively using the TV to watch something, so that their child received a very large exposure to Spanish language programming (news, sports, soap operas, sitcoms, movies, etc) from birth onward, would the child naturally learn Spanish?

I don't recall for sure what the linguists who responded said, but I think they all said the child would not learn Spanish from this.

[1] I have no recollection of where this was.

Re:The Unreasonable Effectiveness of Recurrent Neural Networks by spdionis on Friday May 22, 2015 @04:50AM (#9587179)
When I was little (5-7 years old) I had quite a few anime videos and magazines in italian sent to me by my parents who were abroad. Where I lived no one knew a single word of italian. I often watched and rewatched those videos and read those magazines without any other external input. I can tell you that doing that I easily learned the language. When I was 8 years old I also left for Italy and in two weeks of time I already started speaking fluently, albeit with a few mistakes.

If the child will actually watch the Spanish TV he will learn the language.

EDIT: Even now I often learn new japanese words (and remember them) just by watching animes. The difference is that now I have english subtitles but back then I had no subtitles, only the images to help me understand the meaning.

Re:The Unreasonable Effectiveness of Recurrent Neural Networks by digikata on Friday May 22, 2015 @11:39AM (#9588951)
But this is a little different, in the AI we want the ability to form syntactically correct sentences, but also some intelligence behind the sentences too. You as a human had another foundation of intelligence to lean on, your native language, and an understanding of the world outside of learning the Italian language. If you had no other human interaction, would you have learned any language? That's the more the situation of these AI algorithms.
Re:The Unreasonable Effectiveness of Recurrent Neural Networks by spdionis on Friday May 22, 2015 @12:36PM (#9589379)
I was only arguing that the child could actually learn Spanish, nothing more.

Not knowing basically anything about AI state of the art what stops us from feeding a RNN image data and text data and make it correlate them automatically by context? Just like a child learns words by hearing them many times in similar contexts so could a RNN.

I imagine the biggest problem is gathering and structuring the data. We humans receive lots of data and have lots of time to process it in our lives compared. And by lots I mean difference of a few orders of magnitude. It's amazing what this thing learns in just a few hours of processing.

Re:The Unreasonable Effectiveness of Recurrent Neural Networks by digikata on Friday May 22, 2015 @01:11PM (#9589662)
I agree the RNN performance is really amazing!
Re:The Unreasonable Effectiveness of Recurrent Neural Networks by geomark on Thursday May 21, 2015 @11:49PM (#9586501)
I've seen something like this in action with young kids who are given a tablet and stumble upon cartoons they like on YouTube, but in a different language. After they watch a few cartoons, YouTube's recommender system keeps offering them more cartoons in that language. And it isn't long before they start spouting words and phrases in that language.
Re:The Unreasonable Effectiveness of Recurrent Neural Networks by dzhiurgis on Friday May 22, 2015 @12:00AM (#9586521)
In Baltic states, majority of TV content either comes in native German or is US shows translated to Russian.

I've picked up quite a bit of Russian by watching Discovery channel this way.