Show HN: AI QLearning Robot Simulation in JavaScript and WebGL

Re:Show HN: AI QLearning Robot Simulation in JavaScript and ... by hmate9 on Wednesday February 25, 2015 @07:44AM (#9106432)

Looks very nice, I have one question:

How does R2D2 "see" the blocks? Is it by pixels or is the game hard-coded in this sense?

[ Parent | on HN ]

Re:Show HN: AI QLearning Robot Simulation in JavaScript and ... by javierluraschi on Wednesday February 25, 2015 @10:09AM (#9107035)

Currently, it sees a board of 3x3 states, as in:

_ _ G

G B B

_ _ G

A next step would be to use real computer vision over a 3D camera in the environment aligned to R2D@ and a deep neural network to interpret pixels instead of states. DeepMind has a paper describing this approach: http://arxiv.org/pdf/1312.5602.pdf

[ Parent | on HN ]

Re:Show HN: AI QLearning Robot Simulation in JavaScript and ... by belltyler on Wednesday February 25, 2015 @08:26AM (#9106566)

It seems like board is kept as a grid and merely represented with three.js; look into the page's source and you'll see a GameBoard object as well as its logic.

[ Parent | on HN ]