News for hackers. Stuff that matters.
Re:Pix2code: Generating Code from a GUI Screenshot by aub3bhat on Thursday May 25, 2017 @10:13PM (#14421615)
By generating the "code" are you merely inferring / representing UI layout as some kind of a tree. E.g. each button/panel/textbox gets detected, and an "RNN/LSTM" generate a tree structure using attention.
Re:Pix2code: Generating Code from a GUI Screenshot by avg_dev on Thursday May 25, 2017 @11:13PM (#14421756)
"merely" is not the word I would use.
Re:Pix2code: Generating Code from a GUI Screenshot by tanilama on Thursday May 25, 2017 @11:53PM (#14421880)
If you somewhat familiar with DL literature, you will see this paper, while having a very interesting angle, the underlying architecture is a standard, enc-dec network, with encoder being CNN and decoding being LSTM. Such application, has been studied before:

https://arxiv.org/pdf/1609.04938.pdf

The above paper shows nice result that turns image to latex expression, and image to html.