The Pile: An 800GB Dataset of Diverse Text for Language Modeling [pdf] Posted by nixtaken on Monday January 11, 2021 @12:29PM from the pile.eleuther.ai dept. https://pile.eleuther.ai/paper.pdf ( 1 comment | on HN )