News for hackers. Stuff that matters.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by sillysaurusx on Thursday April 06, 2023 @10:10AM (#35468516)
Meta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month.

This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61...

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by kamranjon on Thursday April 06, 2023 @10:16AM (#35468583)
Are the weights open source?
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by woopwoop on Thursday April 06, 2023 @10:34AM (#35468830)
Yes
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by lordswork on Thursday April 06, 2023 @10:49AM (#35469059)
Where? From the article:

>Currently, the code (without the weights) is available on GitHub

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by wongarsu on Thursday April 06, 2023 @11:26AM (#35469648)
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by dragonwriter on Thursday April 06, 2023 @04:57PM (#35474320)
The weights are linked from the readme; avoiding large binary resources in GitHub repositories is fairly normal.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by Name_Chawps on Thursday April 06, 2023 @10:17AM (#35468609)
The weights are not "source".
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by sokoloff on Thursday April 06, 2023 @10:28AM (#35468721)
That is likely true in the most pedantic sense, but in practice, if I create an algorithm that works by using a series of matrix transformations against a set of carefully chosen (read: "trained") matrices and I open-source only the matrix manipulation code but not the specially chosen matrices, I think there's a fair argument to say that I haven't open-sourced the entire algorithm.

In the phrase "the model is open-source in every sense of the word", that, IMO, must include the weights.

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by Name_Chawps on Thursday April 06, 2023 @06:42PM (#35475514)
I'd be curious to know if you think open source companies should share all of their database records too.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by sokoloff on Thursday April 06, 2023 @07:02PM (#35475714)
I think of two broad categories of database records: transactional data (data created while running the system) and domain data (data created during development and shipped to production as part of the release process).

The former type of data I wouldn't expect to ever be open-sourced. The latter type might or might not be, depending on the intent of open-sourcing the related system.

If I created a human language translation system that used a SQL database to store the dictionary (domain) data and claimed the system was open-source without shipping the domain data, I think people would rightly say that the system was not fully opened.

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by flangola7 on Thursday April 06, 2023 @02:08PM (#35472095)
The actual source code is not important. The source code can be printed on a single A4 page, the valuable final product is the weights you get after running the code for fifty million dollars of compute time.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by Name_Chawps on Thursday April 06, 2023 @06:44PM (#35475530)
If they start claiming they're "open weights" or "open final product" I'll be up in arms.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by sokoloff on Thursday April 06, 2023 @07:17PM (#35475841)
They are claiming that. They are also delivering on that claim: https://github.com/facebookresearch/segment-anything#model-c...
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by jtsiskin on Thursday April 06, 2023 @04:54PM (#35474270)
If I autogenerated a huge amount of C based on the weights, that added/multipled variables the same way the existing code+weights does, then would it be “source”?
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by dragonwriter on Thursday April 06, 2023 @04:58PM (#35474331)
The weights seem to be under the same license, just distributed separately because it doesn’t make sense for the giant binary artifacts of training to be part of the source repository.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by polygamous_bat on Thursday April 06, 2023 @12:06PM (#35470374)
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by neuronexmachina on Thursday April 06, 2023 @01:04PM (#35471269)
For anyone curious about file sizes for the PyTorch models:

* default/sam_vit_h_4b8939.pth: 2.4GB

* sam_vit_l_0b3195.pth: 1.2GB

* sam_vit_b_01ec64.pth: 358MB

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by KaiserPro on Thursday April 06, 2023 @12:04PM (#35470355)
> left hand not knowing what the right hand is doing.

No it was trying to stop abuse. Unlike OpenAI, facebook can't get away with releasing a thing that is more than capable of making up libellous, racist or any other type of illegal or PR decimating thing.

The point of the really restrictive release was to at least try to limit that kind of issue.

Fortunatly for meta, most people who use the weights aren't the end user with a large twitter following, so the risk is (now) low.

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by NelsonMinar on Thursday April 06, 2023 @12:15PM (#35470531)
The Economist had a recent overview of the AI competitive landscape that highlights Meta's outsize role thanks to their embrace of openness. https://www.economist.com/business/2023/03/26/big-tech-and-t...
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by kristopolous on Thursday April 06, 2023 @07:34PM (#35475995)
They're well on their way to yahoo'ing themselves - valuable and significant software contributions for a platform nobody is using.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by lacker on Thursday April 06, 2023 @12:36PM (#35470859)
I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much.

It's funny, back in the 90s I disliked Microsoft and thought they were inherently culturally opposed to open source. But big corporations really just follow their business incentives when it comes to open source.

It's not like Meta "loves to be open". But they would hate a world where all the powerful AI development happened on one of the big clouds. Imagine if every researchers used some closed-source API from Google or Azure or AWS. Meta would try to hire some AI people, and they'd be like, ugh if we take the job we have to use this weird Facebook-specific thing. (<cough>Flow</cough>)

So, supporting PyTorch and providing open source models is just a good business strategy for Meta. I'm glad to see it.

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by kouteiheika on Thursday April 06, 2023 @12:51PM (#35471082)
> I agree, Meta's work in AI has been really impressive, and it's encouraging how they are open-sourcing so much.

My usual reaction to anything Facebook releases is "yawn, they released yet another model that is practically useless because it's released under a non-commercial license", but I'm pleasantly surprised that this one seems to be actually liberally licensed! Hopefully this continues into the future.

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by tomcam on Thursday April 06, 2023 @03:13PM (#35473024)
I’m glad Microsoft is open sourcing a lot of things.

I have never, ever seen a convincing business case for their doing so, however.

Not your opinion. A compelling business case.

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by SimonPStevens on Thursday April 06, 2023 @03:36PM (#35473312)
The business case for open sourcing dev tooling is that more developers will use them and build on them and that brings more people to your platforms.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by tomcam on Friday April 07, 2023 @01:15AM (#35478285)
Sure. Any proof at all for that? I mean it's the obvious answer, but generally in business people who don't pay for things tend not to pay for things. In fact, in the enterprise having a big budget is the way you keep your corporate power. Free stuff isn't a way to keep your budget high.

Again, I would like to agree with your thinking. I just don't think the real world backs it up.

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by lacker on Friday April 07, 2023 @06:03PM (#35487584)
It's pretty simple, they make a lot of money off Azure, and open source software is a complement to Azure. See the classic:

https://www.joelonsoftware.com/2002/06/12/strategy-letter-v/

In particular, open source software prevents people from getting locked into any of the AWS, Linux, iOS, or Android ecosystems. All of those are popular software development ecosystems that Microsoft does not own or influence very much.

Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by tomcam on Saturday April 08, 2023 @01:35AM (#35490830)
Not convincing or even relevant IMHO. Azure infra is largely closed source and Microsoft is making a ton of money off it.
Re:Meta Releases New AI-Based Photo Segmentation Tool to Eve... by greeny7373 on Thursday April 06, 2023 @03:14PM (#35473030)
It's still Facebook.

The company who had a huge impact in fake news, discrimination, death of people, scams and scams, etc....

Facebook is cancer, the research is blood diamonds.