News for hackers. Stuff that matters.
Re:MuseNet by lucidrains on Thursday April 25, 2019 @04:05PM (#19751995)
I've tried it as well and got good syntactic results. For more sensical programs, I think we will need more layers & attn heads. Perhaps someone will fork gpt-2 and add the sparse transformer to it.

There are no comments on this comment yet.