News for hackers. Stuff that matters.
Re:Meta does everything OpenAI should be by michaelt on Wednesday April 24, 2024 @09:31AM (#40144181)
> Meta keeps things open (for now) because it's perfectly aligned with their business goals.

How?

I would have said a flood of LLM-generated spam is a pretty big threat to Facebook's business. Facebook don't seem to have any shortage of low/medium quality content; it's not like they need open-weights LLMs to increase the supply of listicles and quizzes, which are already plentiful. There isn't much of a metaverse angle either. And they risk regulatory scrutiny, because everyone else is lobotomising their models.

And if they wanted a flood of genai content - wouldn't they also want to release an image generation model, to ensure instagram gets the same 'benefits' ?

Sure there are some benefits to the open weights LLM approach that make them better at LLMs - I'm sure it makes it easier for them to hire people with LLM experience for example - but that's only helpful to the extent that Facebook needs LLMs. And maybe they'll manage to divert some of that talent to ad targeting or moderation - but that hardly seems 'perfectly aligned', more of a possible indirect benefit.

Re:Meta does everything OpenAI should be by lmeyerov on Wednesday April 24, 2024 @09:39AM (#40144271)
In a recent interview, Mark Zuckerberg said they're spending $10B-$100B on training and inferencing over the next X years. They see open source as a way to get the community to cut that cost. In his view, even just 10% cheaper inferencing pays for a lot.