News for hackers. Stuff that matters.
Re:A Multimodal Dataset with One Trillion Tokens by jszymborski on Wednesday July 24, 2024 @04:57PM (#41062002)
Salesforce has long been involved in publishing quality NLP papers, especially during Stephen Merity's tenure.

Smerity's papers are some of my favourite. Check out

https://ar5iv.labs.arxiv.org/html/1708.02182

And my all-time favourite

https://ar5iv.labs.arxiv.org/html/1911.11423

Re:A Multimodal Dataset with One Trillion Tokens by nighthawk454 on Wednesday July 24, 2024 @09:17PM (#41063882)
Hey thanks for those Smerity links, hadn't run across his work yet, second one in particular looks great
Re:A Multimodal Dataset with One Trillion Tokens by jszymborski on Thursday July 25, 2024 @12:34AM (#41064740)
Glad you liked it.

How could you go wrong with a paper that starts with

> Language has been a thorn in humanity’s side since we evolved a complex enough audio and graphics processing unit to grunt, let alone write cryptocurrency whitepapers or opinion columns.