News for hackers. Stuff that matters.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by bugglebeetle on Sunday April 09, 2023 @03:47PM (#35505802)
I would assume so. Meta’s ML/AI team is very strong, but they probably don’t have a comparable product offering to ChatGPT ready for public use. So instead, they bought themselves some time by letting the open source community run wild with a lesser model and eat into OpenAI’s moat.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by BulgarianIdiot on Sunday April 09, 2023 @03:57PM (#35505900)
They didn't leak it. Someone else did.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by ericpauley on Sunday April 09, 2023 @04:11PM (#35506014)
I think the key here is that, given the way that Meta distributed the model, a leak was inevitable. So while they may not have directly orchestrated a leak it must have been an intended result.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by blameitonme on Sunday April 09, 2023 @04:02PM (#35505952)
I dont think theyre saying Meta AI leaked it, but they anticipated someone else will and still went ahead with it as they wanted the consequences.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by jjoonathan on Sunday April 09, 2023 @04:05PM (#35505972)
It's extremely common for a "leak" to actually be fully intentional, but the organization in question just wants plausible deniability to mitigate legal/political/popular blowback.

In order to preserve plausible deniability, the leak will look genuine in all aspects that are easy to simulate. "Someone else did it" is easy to simulate. A better gauge would be to see if anyone is caught and punished. If so, it was probably a real leak.

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by greyface- on Sunday April 09, 2023 @04:11PM (#35506020)
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by yieldcrv on Sunday April 09, 2023 @04:24PM (#35506142)
Only because publicly visible actions are worse for them

People have gotten DMCA takedown requests from them over Llama repositories

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by greyface- on Sunday April 09, 2023 @04:28PM (#35506167)
If they were interested in limiting distribution, saying essentially "go ahead and seed this torrent more" is worse for them than doing nothing.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by yieldcrv on Sunday April 09, 2023 @06:08PM (#35506934)
I’ve actually beat the streisand effect before by not responding.

The crowd gets bored and my DMCA requests flurry out a month later and all evidence disappears, individuals that might notice dont have the crowd to amplify that they noticed.

You can call that “tacit consent” if you want. But streisand removes all leverage.

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by int_19h on Sunday April 09, 2023 @08:03PM (#35507672)
Are they going after copies of LLaMA, or after LLaMA derivatives specifically?
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by yieldcrv on Tuesday April 11, 2023 @02:31AM (#35521570)
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by Mathnerd314 on Sunday April 09, 2023 @05:06PM (#35506470)
That's a contributor to the repo, not someone with commit access.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by greyface- on Sunday April 09, 2023 @05:19PM (#35506570)
A contributor who is also a Facebook employee, presumably speaking in official capacity.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by barbariangrunge on Sunday April 09, 2023 @05:36PM (#35506714)
Why would you presume that by default? Need a quote to conclude that
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by jagrsw on Sunday April 09, 2023 @06:13PM (#35506974)
It's widely presumed within faang-type-of companies that anything an employee says or does can be interpreted as an official company statement, especially by the press. As a result, many of these companies offer, often mandatory, trainings that underscore the importance of speaking carefully in public, since one's words can end up on the front page of a popular newspaper.

Although I don't know how FB rolls internally, it seems more likely than not to me, that it was ack'd by someone higher up in the organization than line engineers or managers. Someone with a permission of speaking publicly for a given area of a company - doesn't need to be CEO, more like a VP/Director maybe.

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by eiz on Sunday April 09, 2023 @08:55PM (#35508020)
Here's a couple more quotes from Yann LeCun, their Chief AI Scientist:

https://twitter.com/ylecun/status/1643945742850031616

https://twitter.com/ylecun/status/1644503237699969026

pretty clear the non-release and extremely half assed response to the leak is just CYA

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by pharrington on Sunday April 09, 2023 @08:30PM (#35507842)
You would not believe the amount of internal and public facing sabotage done by FB employees.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by oezi on Sunday April 09, 2023 @06:18PM (#35507016)
What would you think is holding back Meta and Google? Why can't they just scale up the compute they throw at the problem?

What are they tinkering on?

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by bugglebeetle on Sunday April 09, 2023 @06:40PM (#35507182)
I think Meta’s problems are largely similar to Google’s: they have very bad leadership, specifically Zuckerberg, and thus can’t leverage their existing talent to execute/compete. The whole Metaverse fiasco would seem to demonstrate he’s effectively a “mad king” at this point, and probably surrounded by a sycophantic c-suite. Having the best talent in the world (which they obviously do by how fast LLama was spit out) isn’t going to matter that much if its all serving at the behest of someone who has no real vision or ability to course correct.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by aierou on Sunday April 09, 2023 @07:27PM (#35507468)
Selling 20 million Quest 2 headsets is a pretty good outcome for the so-called Metaverse fiasco.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by bugglebeetle on Sunday April 09, 2023 @08:04PM (#35507677)
I think they spent 36 billion on metaverse stuff at last count, so no, not really.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by Aeolun on Sunday April 09, 2023 @08:56PM (#35508027)
How did literally nothing but Quest come out of that then?
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by detaro on Sunday April 09, 2023 @08:08PM (#35507693)
They would've sold exactly as many of those if they didn't jump full-speed into the Metaverse rabbit hole. Even the Quest 2 release predates that direction shift.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by renonce on Sunday April 09, 2023 @10:56PM (#35508739)
Spending $100b on net losses is too much for such an outcome.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by satvikpendem on Monday April 10, 2023 @02:00AM (#35509579)
Those headsets are subsidized, do you really believe that level of hardware costs less than the unit price of 300 dollars? Meta is trying to gain market share via selling at a loss and perhaps making money through games or simply getting everyone inside the "metaverse" to then show them ads.