News for hackers. Stuff that matters.

A comment on The Pile: An 800GB Dataset of Diverse Text for Language Modeling.

Re:The Pile: An 800GB Dataset of Diverse Text for Language M... by mrfusion on Saturday January 02, 2021 @09:27PM (#25618769)
Why not throw Wikipedia into this collection?
[ Parent | on HN ]
Re:The Pile: An 800GB Dataset of Diverse Text for Language M... by ValueNull on Saturday January 02, 2021 @09:49PM (#25618885)
Hopefully not the Scots version
[ Parent | on HN ]
Re:The Pile: An 800GB Dataset of Diverse Text for Language M... by stellaathena on Sunday January 03, 2021 @01:50PM (#25623985)
... is it in the collection?
[ Parent | on HN ]