News for hackers. Stuff that matters.

A comment on Code for Scaling Transformer to 1M tokens and beyond with RMT (arxiv.org).

Re:Code for Scaling Transformer to 1M tokens and beyond with... by mysterybox on Monday April 24, 2023 @03:23AM (#35684602)
I found this interesting link in paper, so this can be used as ready code for RMT Transformer

https://github.com/booydar/t5-experiments/tree/scaling-repor...

[ Parent | on HN ]

There are no comments on this comment yet.