liviosoares
Re:Deep learning job postings have collapsed in the past six months
on Monday August 31, 2020 @09:52AM (#24331429)
Just to clarify one of your points regarding Google's involvement: XLnet, and the underlying TransformerXL technology, did have Google researchers involved:
* https://ai.googleblog.com/2019/01/transformer-xl-unleashing-...
* https://arxiv.org/pdf/1901.02860.pdf
* https://arxiv.org/pdf/1906.08237.pdf
My understanding is that a CMU student interned at Google and developed most of the pieces of TransformerXL, which formed the basis of XLNet. The student and the Google researcher further collaborated with CMU researchers to finalize the work.
(For the record, I think the remainder of your points do not match my understanding of NLP, which I do research in, but I just really wanted to clarify the XLNet story a bit).
Re:An Upgrade to SyntaxNet, New Models and a Parsing Competition
on Thursday March 16, 2017 @03:21PM (#13888211)
dang, sorry if this seemed misleading. In my humble opinion, the blog title does not do full justice to the new release, primarily since it carries a new framework within SyntaxNet:
https://github.com/tensorflow/models/blob/master/syntaxnet/g...
This new DRAGNN framework is what I thought the folks here would want to know. Perhaps I should have linked to the github page, rather than the blog announcement.