Code for Scaling Transformer to 1M tokens and beyond with RMT (arxiv.org) Posted by mysterybox on Monday April 24, 2023 @03:23AM from the github.com dept. https://github.com/booydar/t5-experiments/tree/scaling-report/rmt_utils ( 3 comments | on HN )
https://github.com/booydar/t5-experiments/tree/scaling-repor...
https://github.com/booydar/t5-experiments/blob/scaling-repor...
https://github.com/booydar/t5-experiments/tree/scaling-repor...