News for hackers. Stuff that matters.

A comment on Scaling Transformer to 1M tokens and beyond with RMT. Parent comment

Re:Scaling Transformer to 1M tokens and beyond with RMT by macleginn on Monday April 24, 2023 @03:27AM (#35684635)
The original architecture used in this model was accepted at last year's NeurIPS: https://proceedings.neurips.cc/paper_files/paper/2022/file/4...

That paper is written very differently.

[ Parent | on HN ]

There are no comments on this comment yet.