News for hackers. Stuff that matters.
Re:Google’s new voice recognition system works instantly and... by JulianSlzr on Tuesday March 12, 2019 @10:53PM (#19375265)
We explored self-attention + CTC in our ICASSP 2019 paper (https://arxiv.org/abs/1901.10055). Our implementation uses internal infra, so we're a ways from releasing code :(

Hoping paper details suffice and help with the parameter search, and happy to respond to questions over e-mail. Would love to see an open-source implementation with local or directed attention built out!

Re:Google’s new voice recognition system works instantly and... by p1esk on Wednesday March 13, 2019 @03:05AM (#19376379)
Very interesting! Perhaps I should revise my original comment to “everyone is moving to transformers lately” :)