> It has a built-in check which prevents the program from working on inappropriate media including but not limited to nudity, graphic content, sensitive material such as war footage etc.

This is noble, but git… open-source… forks…

Since face swapping tools crop.up frequently, what is their pitch? What are the non-abusive use cases for face swapping?

Entertainment (memes). Trying out a new hairstyle matching your face.

The hairstyle thing sounds like a killer feature, but I think that it would be relatively quickly overtaken by whoever makes it easier to create 3d models of yourself at metahuman-like level.

Putting yourself or a friend in a movie scene, for example.

Lol, literally what I use it for half the time for meme reasons.

Digital marketing agencies can make website team pages look much more professional without having to go to the expense of a photo shoot

Perhaps this is a bit cheeky, but I think it'd be pretty hilarious if a company, intentionally or otherwise, used this to generate a bunch of uniform headshots that made all of the employees at a company look like they're in way better shape than they actually are.

So the model and photographer lose their job but the company bottom line is unchanged.

I use Roop (which this is a successor of) to make stablediffusion pictures of myself (e.g. for my slack avatar).

Amusement. Putting your mates in a film scene. Making silly memes. Etc.

Not everything needs a “serious” usecase.

It does where the negative use cases are very harmful. I can think of many fun projects I could pursue in my chemistry lab if only the precursors and equipment for mass producing nerve agents and high explosives were not tightly regulated.

At least that check is not hosted elsewhere and the author is clear from any defamation deriving from their programs use.

Looks like a wrapper around insightface along with a dash of GAN face smoothing (esrgan and gfpgan).

Also using a pretty standard nsfw model that could be disabled in 1 line.

> nsfw model that could be disabled in 1 line.

I would assume "that’s the point"

What is the difference to roop? Even the main dev seems to be the same.

looks like roop has bees discontinued https://github.com/s0md3v/roop

Quote:

> The reason behind shutting the project down is that a developer with write access to the code published a problematic video to the documentation of the project. This happened while I was taking a break from the project in July-Aug 2023. It went unnoticed for 2 weeks until someone reached out to me to talk about this project. It was a complete breach of trust for me and I decided that I do not have the interest or time to oversee the development of a software with such ethical issues.

Anyone have any idea what this problematic video is, or what caused this to happen?

It's linked to in the message, I don't know the context but my best guess is the image that was added is of a known celebrity or an underage person, but the context isn't clear from the thread to me, it could also just be that the person is topless (though nothing is visible) and the author has been proactive about making the program default to no nudity.

I'm also not sure the images there are the ones that the original author is upset about since it looks like a branch where images were hosted was deleted.

It was literally the bust of a woman, no real nudity. Imagine an inch above cleavage upwards, I suspect the original guy who seemingly tries to please everyone if you check their replies on feedback [1] just wanted an excuse over time to discontinue for a while for numerous reasons (career, ethics & he was the face of it, 20k stars) [2]. (I also wouldn't necessarily want to be associated with something like this similar to the insightface guy due to the potential for abuse and it has probably grown a lot more than he expected [3]) and 90% of the new features were added by henry. The first version of roop was barely a derivation from the example code in insightface [4], it just added a gui.

[1] - https://news.ycombinator.com/item?id=36117013, https://twitter.com/s0md3v/status/1663604795524149248

[2] - https://twitter.com/emilyx64/status/1663603738395951106

[3] - https://github.com/deepinsight/insightface/issues/2315#issue...

[4] - https://github.com/deepinsight/insightface/blob/master/examp...

It was literally the roop guy had issues because of where he's from being very prude/religious, so the fact they showed any cleavage at all set off his alarm bells and well roop died.

There was no cleavage, it was an image like this (https://i.imgur.com/cl6MFhi.jpg) but regardless good for him in starting it but outside of the tkinter gui he added to the original code he didn't contribute much beyond that. For the casual people putting themselves in movies and memeing their friends this was probably the best thing to happen to the project as henry brought it to where it is now.

On the commit they referenced[0] you can view the gifs by clicking the overflow/details button (three dots) in the title bar and clicking view file. The target (which I believe is the original) is a shirtless, very young girl cropped at just above the breasts. The output looks to be a slightly older young women. I can only speculate, but this could be interpreted as a kind of dog whistling or subtextual illustration of use for child pornography-related doctoring. I don’t think it’s far-fetched to argue the example is at least borderline inappropriate when there are plenty of other reasonable examples the commit author could’ve opted to add instead. Perhaps this was a catalyst for the maintainer to consider how much worse it could’ve been and decided they’d seen enough to know they should get out now before they encounter something worse.

Since I’ve been exploring ML image generation I’ve seen an alarming amount of disturbing imagery with young girls or hypersexualized, extremely young women as the subjects, and I’ve encountered it without seeking it out in any way. It’s just out there on certain smaller AI gallery sites, which I will not promote here, alongside normal content. On one recent occasion I saw what I could only describe as “soft-core” child pornography. It was enough to make me close the site immediately, and I’m not what most would describe as a prude.

[0]: https://github.com/s0md3v/roop/commit/cf7ba1caf932e8c9f39d97...

This is a very serious accusation you’re leveling, and it does not appear to be supported by the facts.

Conflating that anodyne image with “disturbing imagery with young girls or hypersexualized, extremely young women” is wildly irresponsible on your part.

I'm sorry for the misunderstanding. If it helps to clarify things, I don't personally think the image itself matches the quotation you shared from my comment. I never made any statements about the uploaded image beyond describing it because no one asked and it wasn't relevant. I'm sorry I can't agree that it's "anodyne" because the world is filled with diverse convictions about what constitutes what kind of public nudity is appropriate and when, but I do personally agree that the image is innocuous at any rate.

My anecdotal experience and concern was provided for context and conversation around what I clearly stated was pure speculation about realized ethical concerns the maintainer may have had. In other words, I was suggesting that maybe the author had seen the same kind of stuff I've seen, saw this image, and due to personal convictions decided they felt uncomfortable with continuing work on this project. Based on what some others have mentioned, that actually doesn't seem that far from the truth.

I have no idea what the person who uploaded that image's intent was, and I'm certainly not trying to libel anyone.

roop was largely maintained by henryruhs, but he wasn't the repo owner. Roop's repo owner decided to shut it down, and FaceFusion is the continuation.

Blackmirror episode: everyone has a brain implant which among other things makes anyone you look at, including yourself look ridiculously attractive, unless by law the implant is removed when you are convicted of a felony. The protagonist gets convicted only to find out he/she is really fat and ugly, only to find true beauty in another far and ugly person.

Pretty contrived.

There's a great short story by Ted Chiang that explores a similar idea: https://waldyrious.neocities.org/ted_chiang/liking-what-you-.... It's interesting to think about how much attractiveness plays into the way the world works.

How about:

After a landmark constitutional amendment guaranteeing absolute equity under the law, the government mandates the implantation of “equalizers” in all citizens at birth.

These brain implants suppress intelligence to a standardized mean and distort visual perception, rendering all faces equally devoid of distinguishing beauty.

Kurt Vonnegut wrote this story in 1961:

https://en.m.wikipedia.org/wiki/Harrison_Bergeron

And maybe the protagonist would find an exemption and turn out to be better looking and smarter which causes problems for him/her?

Not gonna be impressed until something that can beat insightface-128 comes out open, shocked no open source teams have taken the challenge to do a 512 model train.

An ideal choice for people that do not like their face.

Insightface now using improved model but closed source via discord bot.

https://github.com/deepinsight/insightface/issues/2294

https://github.com/deepinsight/insightface/issues/2315