Re:MuseNet
by lucidrains on Thursday April 25, 2019 @04:05PM
(#19751995)
I've tried it as well and got good syntactic results. For more sensical programs, I think we will need more layers & attn heads. Perhaps someone will fork gpt-2 and add the sparse transformer to it.
[ Parent
| on HN ]
There are no comments on this comment yet.