Re:A Multimodal Dataset with One Trillion Tokens
by punnerud on Wednesday July 24, 2024 @04:34PM
(#41061735)
More info on the Salesforce blog:
https://blog.salesforceairesearch.com/mint-1t/
[ Parent
| on HN ]
Re:A Multimodal Dataset with One Trillion Tokens
by j7ake on Wednesday July 24, 2024 @04:45PM
(#41061875)
Wow did not expect sales force to be behind this.
It’s basically free advertising for technical people to join sales force.
Re:A Multimodal Dataset with One Trillion Tokens
by jszymborski on Wednesday July 24, 2024 @04:57PM
(#41062002)
Salesforce has long been involved in publishing quality NLP papers, especially during Stephen Merity's tenure.
Smerity's papers are some of my favourite. Check out
https://ar5iv.labs.arxiv.org/html/1708.02182
And my all-time favourite
Re:A Multimodal Dataset with One Trillion Tokens
by nighthawk454 on Wednesday July 24, 2024 @09:17PM
(#41063882)
Hey thanks for those Smerity links, hadn't run across his work yet, second one in particular looks great
Re:A Multimodal Dataset with One Trillion Tokens
by jszymborski on Thursday July 25, 2024 @12:34AM
(#41064740)
Glad you liked it.
How could you go wrong with a paper that starts with
> Language has been a thorn in humanity’s side since we evolved a complex enough audio and graphics processing unit to grunt, let alone write cryptocurrency whitepapers or opinion columns.
Re:A Multimodal Dataset with One Trillion Tokens
by 0xDEADFED5 on Wednesday July 24, 2024 @08:01PM
(#41063501)
Salesforce produced one of the best Llama-3(8B) finetunes, IMO: SFR-Iterative-DPO-LLaMA-3-8B-R
Hopefully they do something with Llama-3.1
Re:A Multimodal Dataset with One Trillion Tokens
by gotaran on Wednesday July 24, 2024 @10:16PM
(#41064184)
I’m skeptical of the caliber of talent at Salesforce given the unusable state of their core product.
Re:A Multimodal Dataset with One Trillion Tokens
by paxys on Wednesday July 24, 2024 @10:27PM
(#41064219)
The people building CRM software aren't also the ones doing AI research. The two have nothing to do with each other.
Re:A Multimodal Dataset with One Trillion Tokens
by gotaran on Wednesday July 24, 2024 @10:55PM
(#41064340)
The ones doing AI research would be working at more prestigious institutions.
Re:A Multimodal Dataset with One Trillion Tokens
by ericjmorey on Wednesday July 24, 2024 @11:13PM
(#41064411)
Why make such a ridiculous assumption?
Re:A Multimodal Dataset with One Trillion Tokens
by hluska on Thursday July 25, 2024 @01:32AM
(#41065025)
Do you have a point or are you just insulting people out of some twisted definition of fun?
Re:A Multimodal Dataset with One Trillion Tokens
by inkyoto on Thursday July 25, 2024 @01:57AM
(#41065153)
Salesforce have been on a shopping spree for quite a few years now. They have purchased MuleSoft (an integration platform) and Slack amongst the others.
Salesforce is anything but a CRM software company nowadays.