News for hackers. Stuff that matters.

A comment on The Pile: An 800GB Dataset of Diverse Text for Language Modeling. Parent comment

Re:The Pile: An 800GB Dataset of Diverse Text for Language M... by stellaathena on Saturday January 02, 2021 @10:14PM (#25619028)
If I Google “bibliotik download” the first page of results has a link to download. Calling that “not easy to obtain” is absurd.

And yes, your last sentence is correct. That’s exactly the position being taken.

[ Parent | on HN ]
Re:The Pile: An 800GB Dataset of Diverse Text for Language M... by 6gvONxR4sf7o on Monday January 04, 2021 @12:24PM (#25634627)
> If I Google “bibliotik download” the first page of results has a link to download. Calling that “not easy to obtain” is absurd.

You're right. Then why do you exclude so much else that meets the same criteria?

If I Google “[insert dataset here] download” the first page of results has a link to download. Calling that “not easy to obtain” is absurd.

In your definitions, you exclude vast swaths of things meeting that criteria in a seemingly arbitrary manner, which is why it's weird.

[ Parent | on HN ]