News for hackers. Stuff that matters.
Re:Grid-Cell Like Deep Layers in Navigation AI by baylearn on Saturday May 12, 2018 @03:28AM (#17052933)
This DeepMind work has been gathering a lot of hype, but it is very similar to this work by Cueva and Wei:

Published on Arxiv on March 31: https://arxiv.org/abs/1803.07770

Published at ICLR 2018, a well-known machine learning conference: https://openreview.net/forum?id=B17JTOe0-

It is rather disheartening that they didn't acknowledge the -- seems like a deliberate oversight.

The Cueva and Wei paper is well written, explains concepts clearly, without the hype, and published in an open access venue.

Re:Grid-Cell Like Deep Layers in Navigation AI by autopoiesis on Saturday May 12, 2018 @03:31AM (#17052936)
Yes, this DeepMind paper has been associated with an extraordinary amount of hype! This must be the third or fourth time it has been posted here, when most of the extensive grid cell literature has never been posted once; including theoretical work that explains the emergence of such cells, or that uses grids for navigation. And I don't think this is the first time that a DeepMind paper has been selective in its literature review, either...
Re:Grid-Cell Like Deep Layers in Navigation AI by SubiculumCode on Saturday May 12, 2018 @05:14AM (#17053179)
Was the arxiv paper ever peer reviewed?
Re:Grid-Cell Like Deep Layers in Navigation AI by baylearn on Saturday May 12, 2018 @06:40AM (#17053415)
Yes, refer to the openreview link to my earlier comment on this thread.
Re:Grid-Cell Like Deep Layers in Navigation AI by brolover on Saturday May 12, 2018 @05:37AM (#17053243)
I've noticed that DeepMind completely ignores imitation learning area of research. I never saw them citing any of the fundamental papers, despite a bunch of their reinforcement learning ideas explicitly match those ideas that are now 8+ years old.
Re:Grid-Cell Like Deep Layers in Navigation AI by yokaze on Saturday May 12, 2018 @03:39AM (#17052954)
Well, the paper was received from Nature on 05 July 2017, so it isn't surprising that they didn't cite the work from Cueva and Wei published 21 Mar 2018.
Re:Grid-Cell Like Deep Layers in Navigation AI by apl on Saturday May 12, 2018 @05:01AM (#17053138)
That's not quite how the process works. These papers go through multiple (> 2) revisions. At any iteration, there's ample opportunity for updating references. This applies double given how long the Cueva/Wei work has been available (preprint & CCN'17 (?) contribution).
Re:Grid-Cell Like Deep Layers in Navigation AI by naturalgradient on Saturday May 12, 2018 @03:56AM (#17052978)
If you are making that argument, you should refer to the ICLR deadline, which is well earlier, but still after July 2017.
Re:Grid-Cell Like Deep Layers in Navigation AI by musicaldope on Saturday May 12, 2018 @11:41AM (#17054550)
Additional context for the overlap with previous work on grid cells in neuroscience:

https://twitter.com/gershbrain/status/994678940043284480

Re:Grid-Cell Like Deep Layers in Navigation AI by justicezyx on Saturday May 12, 2018 @04:08PM (#17055767)
Thanks for point out this!

I'd rather read the similar work from ICLR than nature, which I do not have access...