News for hackers. Stuff that matters.
Re:A Multimodal Dataset with One Trillion Tokens by j7ake on Wednesday July 24, 2024 @04:45PM (#41061875)
Wow did not expect sales force to be behind this.

It’s basically free advertising for technical people to join sales force.

Re:A Multimodal Dataset with One Trillion Tokens by jszymborski on Wednesday July 24, 2024 @04:57PM (#41062002)
Salesforce has long been involved in publishing quality NLP papers, especially during Stephen Merity's tenure.

Smerity's papers are some of my favourite. Check out

https://ar5iv.labs.arxiv.org/html/1708.02182

And my all-time favourite

https://ar5iv.labs.arxiv.org/html/1911.11423

Re:A Multimodal Dataset with One Trillion Tokens by nighthawk454 on Wednesday July 24, 2024 @09:17PM (#41063882)
Hey thanks for those Smerity links, hadn't run across his work yet, second one in particular looks great
Re:A Multimodal Dataset with One Trillion Tokens by jszymborski on Thursday July 25, 2024 @12:34AM (#41064740)
Glad you liked it.

How could you go wrong with a paper that starts with

> Language has been a thorn in humanity’s side since we evolved a complex enough audio and graphics processing unit to grunt, let alone write cryptocurrency whitepapers or opinion columns.

Re:A Multimodal Dataset with One Trillion Tokens by 0xDEADFED5 on Wednesday July 24, 2024 @08:01PM (#41063501)
Salesforce produced one of the best Llama-3(8B) finetunes, IMO: SFR-Iterative-DPO-LLaMA-3-8B-R

Hopefully they do something with Llama-3.1

Re:A Multimodal Dataset with One Trillion Tokens by gotaran on Wednesday July 24, 2024 @10:16PM (#41064184)
I’m skeptical of the caliber of talent at Salesforce given the unusable state of their core product.
Re:A Multimodal Dataset with One Trillion Tokens by paxys on Wednesday July 24, 2024 @10:27PM (#41064219)
The people building CRM software aren't also the ones doing AI research. The two have nothing to do with each other.
Re:A Multimodal Dataset with One Trillion Tokens by gotaran on Wednesday July 24, 2024 @10:55PM (#41064340)
The ones doing AI research would be working at more prestigious institutions.
Re:A Multimodal Dataset with One Trillion Tokens by ericjmorey on Wednesday July 24, 2024 @11:13PM (#41064411)
Why make such a ridiculous assumption?
Re:A Multimodal Dataset with One Trillion Tokens by hluska on Thursday July 25, 2024 @01:32AM (#41065025)
Do you have a point or are you just insulting people out of some twisted definition of fun?
Re:A Multimodal Dataset with One Trillion Tokens by inkyoto on Thursday July 25, 2024 @01:57AM (#41065153)
Salesforce have been on a shopping spree for quite a few years now. They have purchased MuleSoft (an integration platform) and Slack amongst the others.

Salesforce is anything but a CRM software company nowadays.