News for hackers. Stuff that matters.
Re:Infrastructure set-up & open-source scripts to train a 70... by chx on Friday June 28, 2024 @06:20AM (#40819253)
> If even a single one of the over 12,000 connections was a little flaky, it could slow down the entire training run

It's an unusual enough sentence to be remarkable and I was like "I read this exact same sentence before". Indeed, this and most of the writeup appeared on Twitter, LinkedIn, Reddit it seems word-by-word. Is this just spam ?

https://x.com/imbue_ai/status/1805629547473518695

https://reddit.com/r/learnmachinelearning/comments/1dobgbs/t...

https://www.linkedin.com/posts/mattboulos_training-a-70b-mod...

Re:Infrastructure set-up & open-source scripts to train a 70... by neilv on Friday June 28, 2024 @07:42AM (#40819658)
I'd rather some company copy&paste the same text multiple places, if they alternative was that those places would get obfuscation of the same information to appear novel each time (so I'd have to read all of them to realize they're all just the same info).
Re:Infrastructure set-up & open-source scripts to train a 70... by leothetechguy on Friday June 28, 2024 @07:32AM (#40819597)
The same company reports multiple times on a finding they've made through multiple social media channels? Shocking. /s
Re:Infrastructure set-up & open-source scripts to train a 70... by bottled_poe on Friday June 28, 2024 @06:35AM (#40819319)
lmao, I was thinking this was bullshit and you’ve cemented that position. We’ve entered the grifting stage of this AI cycle. Salut.
Re:Infrastructure set-up & open-source scripts to train a 70... by knowaveragejoe on Friday June 28, 2024 @12:59PM (#40822573)
Having listened to the person who wrote this speak at length about the subject, it is not BS or grifting.
Re:Infrastructure set-up & open-source scripts to train a 70... by lolinder on Friday June 28, 2024 @09:50AM (#40820590)
This is the kind of criticism that could only come from someone without much formal writing experience.

This is a very normal workflow: You write a full-length text detailing the project you worked on. You then trim it down to a summary which you share with a group of people X. You then trim it down into a different summary which you share with a group of people Y.

When you do this multiple times you unsurprisingly end up with some sentences that make it into multiple summaries because they're that important to the thesis!

(Also, the summaries on Twitter and Reddit aren't anything close to "most of the writeup"—the full text is 6000+ words!)

Re:Infrastructure set-up & open-source scripts to train a 70... by chx on Monday July 01, 2024 @05:49PM (#40851127)
So you agree this is a formally written PR piece copy-pasted and as such it's spam. Got it.

What would've been not spam? Spontaneous writing with a link to the puff piece.

Re:Infrastructure set-up & open-source scripts to train a 70... by ac29 on Friday June 28, 2024 @11:20AM (#40821535)
Eh, seems like legit marketing to me. Yes, they are trying to sell you something, but they are doing that by releasing non-trivial research and open source code.
Re:Infrastructure set-up & open-source scripts to train a 70... by fastasucan on Friday June 28, 2024 @01:28PM (#40822844)
I dont inderstand your issue with this. Is it that they share their work several places, or that they don't describe their work in an unique way every time?
Re:Infrastructure set-up & open-source scripts to train a 70... by exe34 on Saturday June 29, 2024 @01:29PM (#40832154)
i prefer this, to the story about that time they went to Florence and their grandma made pizza for dinner and they got the recipe.