News for hackers. Stuff that matters.

A comment on CoLT5: Faster Long-Range Transformers With Conditional Computation.

Re:CoLT5: Faster Long-Range Transformers With Conditional Co... by varunkmohan on Monday March 20, 2023 @11:19PM (#35242168)
This looks very cool and is a massive improvement. If only OpenAI would also publish what they are doing to make 32K work.
[ Parent | on HN ]

There are no comments on this comment yet.