News for hackers. Stuff that matters.
Re:AnimeGANv2: Convert Face Portraits into Anime by ksec on Tuesday November 09, 2021 @12:59PM (#29164988)
May be those examples should have instant results? I guess most people are just clicking them to see what it looks likes instead of waiting 100s.

Most of them look like photoshop filter as per other comments, but IU and Billie Eilish definitely looks good.

Re:AnimeGANv2: Convert Face Portraits into Anime by cinntaile on Tuesday November 09, 2021 @03:47PM (#29167267)
People keep stating these look like photoshop filters. This is a very shallow dismissal imo. Why don't you prove it instead by applying some Photoshop filters and achieving a similar effect? Include how long it took as well.
Re:AnimeGANv2: Convert Face Portraits into Anime by csande17 on Tuesday November 09, 2021 @10:52PM (#29170880)
Here's a tutorial I found online that achieves a similar effect in under 15 minutes: https://youtube.com/watch?v=XojsUNBLfic

It takes the presenter about seven minutes to go from "image opened in Photoshop" to "comic-style effect applied to image", and that includes a verbal explanation of each step. (The rest of the video talks about things like making sure the image is an adequate size, and adding extra elements like borders and dialogue balloons.)

Re:AnimeGANv2: Convert Face Portraits into Anime by cinntaile on Tuesday November 09, 2021 @11:44PM (#29171170)
Thanks for looking. I don't think that effect is similar enough though, but maybe that's just me?

After I wrote my original comment I thought about the filters. If Photoshop had a similar effect available as a filter, I'd assume it was achieved using a similar architecture as the OP presented.

Re:AnimeGANv2: Convert Face Portraits into Anime by ardit33 on Tuesday November 09, 2021 @06:55PM (#29169194)
I think it is pretty impressive, and dismissing it a simply a photoshop filter is not right.

While they don't look true anime style, they look properly very cartoonish, like someone would have drawn them.

Good job to the op.

Re:AnimeGANv2: Convert Face Portraits into Anime by dogma1138 on Tuesday November 09, 2021 @08:57PM (#29170238)
They don’t look anything like filters it’s actually super impressive just how clean the results are.
Re:AnimeGANv2: Convert Face Portraits into Anime by webmaven on Tuesday November 09, 2021 @12:49PM (#29164851)
Like many other comments, I don't see much resemblance to anime styles, but dismissing the results as a Photoshop filter is nuts.

The animation style this does look like is that of 2006's A Scanner Darkly, or 2019's Undone.

Re:AnimeGANv2: Convert Face Portraits into Anime by MisterTea on Tuesday November 09, 2021 @01:15PM (#29165192)
> The animation style this does look like is that of 2006's A Scanner Darkly, or 2019's Undone.

Rotoscoping is the technique. Basically, you film real life and trace over the frames by hand yielding an animated version of your irl footage.

Re:AnimeGANv2: Convert Face Portraits into Anime by erichocean on Tuesday November 09, 2021 @03:41PM (#29167176)
The first animated films to do this were the animated LOTR film and Fire and Ice shortly thereafter, both by the same director.

Logically, very similar during production to how Avatar was made, but doing the rendering "by hand" (and being unable to change the camera after capture).

Pretty impressive results given the budget and time requirements.

Re:AnimeGANv2: Convert Face Portraits into Anime by Pxtl on Tuesday November 09, 2021 @04:08PM (#29167491)
Actually while Bakshi was the first to make a movie that went all in on rotoscoping (particularly Fire and Ice where it was 100% rotoscoped while LOTR was a mixed bag) the first animated film to heavily leverage rotoscoping was Snow White.
Re:AnimeGANv2: Convert Face Portraits into Anime by webmaven on Tuesday November 09, 2021 @05:55PM (#29168677)
> The first animated films to do this were the animated LOTR film and Fire and Ice shortly thereafter, both by the same director.

Although rotoscoping is a venerable technique, the results we're looking at with this service don't bear much stylistic resemblance to early works like Fire and Ice or Snow White and the Seven Dwarfs (or more recent rotoscoped works like The Little Mermaid either). If they did, I'd have given them a pass on the 'anime' claim, even though calling the Disney house style — or Bakshi's — 'anime' is still a stretch.

Re:AnimeGANv2: Convert Face Portraits into Anime by wodenokoto on Tuesday November 09, 2021 @04:34PM (#29167789)
There was a lot of rotoscoping going on in Disney’s Snowwhite
Re:AnimeGANv2: Convert Face Portraits into Anime by dakom on Tuesday November 09, 2021 @10:03PM (#29170593)
American Pop is a hidden gem that uses this technique. Fantastic movie.
Re:AnimeGANv2: Convert Face Portraits into Anime by xgulfie on Tuesday November 09, 2021 @10:26PM (#29170730)
If you've seen what photoshop can do you wouldn't say that's a dismissive statement.
Re:AnimeGANv2: Convert Face Portraits into Anime by aliabd on Tuesday November 09, 2021 @10:59AM (#29163437)
This was built on top of the Pytorch implementation [0] of AnimeGANv2, using gradio [1] and HuggingFace Spaces [2]. See the 100s of examples [3] posted by users.

[0]: https://github.com/bryandlee/animegan2-pytorch [1]: https://gradio.app [2]: https://huggingface.co/spaces [3]: https://twitter.com/ak92501/status/1457033482115420160/retwe...

Re:AnimeGANv2: Convert Face Portraits into Anime by karaterobot on Tuesday November 09, 2021 @11:10AM (#29163603)
Does the app keep any data after generating the image?
Re:AnimeGANv2: Convert Face Portraits into Anime by aliabd on Tuesday November 09, 2021 @11:17AM (#29163700)
Nothing is saved by default. Clicking 'flag' saves the input and output (only accessible to the space owner). More info on flagging: https://gradio.app/getting_started/#flagging
Re:AnimeGANv2: Convert Face Portraits into Anime by coldacid on Tuesday November 09, 2021 @01:25PM (#29165343)
Tried a headshot of myself framed like the example pictures and all I got was something that looked like it was bombed by effects out of Paint.NET. Definitely looked nothing like an anime character.
Re:AnimeGANv2: Convert Face Portraits into Anime by warning26 on Tuesday November 09, 2021 @02:22PM (#29166190)
Even the example pictures don't really look like anime, they just look like some kind of unrealistic "drawing" filter.
Re:AnimeGANv2: Convert Face Portraits into Anime by snvzz on Tuesday November 09, 2021 @10:53AM (#29163359)
A gallery of examples would be nice.

Else, it's too much effort. People are gonna just close the browser tab, like I did.

Re:AnimeGANv2: Convert Face Portraits into Anime by aliabd on Tuesday November 09, 2021 @10:56AM (#29163404)
You're right, see 100s of examples posted by users here: https://twitter.com/ak92501/status/1457033482115420160/retwe...
Re:AnimeGANv2: Convert Face Portraits into Anime by zinclozenge on Tuesday November 09, 2021 @10:58AM (#29163435)
I guess it's impressive you can train a network to do that, but it doesn't look much better than a photoshop filter.
Re:AnimeGANv2: Convert Face Portraits into Anime by handrous on Tuesday November 09, 2021 @11:09AM (#29163596)
Now that AI figured out how to press the "posterize" button, the singularity is surely just around the corner.

Yeah, glad there were examples, saved me trying it. Results are nowhere close to what I expected. Zero of them looked like anime at all, for one thing. Many truly did look like one or two basic Photoshop filters had been applied, and that was it.

Re:AnimeGANv2: Convert Face Portraits into Anime by civilized on Tuesday November 09, 2021 @11:46AM (#29164020)
The Squid Game one looks kind of okay but the rest are uninspired.
Re:AnimeGANv2: Convert Face Portraits into Anime by bnjms on Tuesday November 09, 2021 @12:31PM (#29164596)
There is one further down for a Comic-Con and it looks really good. The rest less so. But it’s a good filter.
Re:AnimeGANv2: Convert Face Portraits into Anime by onion2k on Tuesday November 09, 2021 @12:01PM (#29164214)
I guess it's impressive you can train a network to do that, but it doesn't look much better than a photoshop filter.

I'm not sure if you're saying it's bad because you're underestimating how powerful some Photoshop filters are, or if you're saying it's good because you aren't.

Re:AnimeGANv2: Convert Face Portraits into Anime by imtringued on Wednesday November 10, 2021 @04:42AM (#29172864)
It wouldn't surprise me if those filters already use ML.
Re:AnimeGANv2: Convert Face Portraits into Anime by villasv on Tuesday November 09, 2021 @11:04AM (#29163525)
Those definitely don't look like the anime I watch
Re:AnimeGANv2: Convert Face Portraits into Anime by jackorange on Tuesday November 09, 2021 @11:09AM (#29163583)
Right, I don't see the "anime" part. This just looks like one of the thousands of nameless photo editing software filters.
Re:AnimeGANv2: Convert Face Portraits into Anime by hiccuphippo on Tuesday November 09, 2021 @12:47PM (#29164835)
Yes, Anime has many different kinds of aesthetics but not what this generates. Perhaps it should be renamed PaintingGAN or CartoonGAN?
Re:AnimeGANv2: Convert Face Portraits into Anime by jackorange on Tuesday November 09, 2021 @01:51PM (#29165742)
Surely the primary reason for the name is much fewer people would click and share otherwise. It's clickbait with software.
Re:AnimeGANv2: Convert Face Portraits into Anime by labster on Tuesday November 09, 2021 @06:41PM (#29169069)
I was looking forward to seeing if I was puni plush or shoujo style, instead I got this photoshop filter. Where is my spiky hair??11?
Re:AnimeGANv2: Convert Face Portraits into Anime by l33tman on Tuesday November 09, 2021 @11:10AM (#29163604)
To be honest, it looks pretty weird... the eyes are asymmetrical..

The Snap filter that does something similar to this looks much better, is live, and doesn't use a ton of deep learning I think :)

Re:AnimeGANv2: Convert Face Portraits into Anime by sschueller on Tuesday November 09, 2021 @01:00PM (#29165009)
Waisted resources by not providing pre rendered versions of the 7 examples. I had to wait 3 minutes to render one.
Re:AnimeGANv2: Convert Face Portraits into Anime by amelius on Tuesday November 09, 2021 @11:42AM (#29163960)
Nice, but the problem I have with this and similar techniques is that if you zoom out sufficiently far, then you don't see a difference with the original image. This is not how "anime" is supposed to work.
Re:AnimeGANv2: Convert Face Portraits into Anime by fxtentacle on Tuesday November 09, 2021 @11:56AM (#29164151)
Yes, it learns to replace the high-frequency features while leaving low frequencies intact, just like all those other style transfer CNNs.
Re:AnimeGANv2: Convert Face Portraits into Anime by kroltan on Tuesday November 09, 2021 @04:51PM (#29168000)
Great, now I can generate random cartoon portraits by combining this with https://www.thispersondoesnotexist.com/

I do second the observation that this isn't nearly "Anime" style by any definition or sample of the style I've ever seen. I would expect to see these results in a GTA 5 loading screen.

Re:AnimeGANv2: Convert Face Portraits into Anime by DrSiemer on Wednesday November 10, 2021 @12:02AM (#29171261)
Excellent, I was hoping something as accessible as this would appear to play around with this type of model!

Those that dismiss this as nothing more than a few filters are missing the finer details of what it actually does. There is a lot of targeted tweaking, like removing double chins and other old age artefacts. There are small embellishments, like adding a twinkle to the eyes or lip gloss where none was present before. The direction of a gaze is fixed towards the camera. And of course, although it's more cartoon style than anime, the eyes do become bigger.

The quality of your results depends on how appropriate your input is. Try something that has the potential to be Disney and you will get great results.

Sure, you could (with enough practice) get similar results by manually editing a photo. But the beauty of this type of conversion is that it allows for near instant effortless experimentation and (after some other improvements) application to sequenced frames.

The active model does lean towards feminizing and westernizing the subject. Mustaches are removed and an Asian subject will receive wide open blue eyes every now and then.

Re:AnimeGANv2: Convert Face Portraits into Anime by grammarnazzzi on Tuesday November 09, 2021 @08:40PM (#29170133)
Viewing these images remind me a lot of caricature portraiture.

As with real artwork, the eye is drawn to embelishments, exagerations, and simplification and directed by composition.

In pieces by a competant artist, these add a new level of interest and dimension to the piece.

With these images, following what makes each image is always a dead end. There is no composition and the embelishments are mechanical, random and uninteresting.

For example, I find myself wondering why the the artist chose to paint the mouth so asymetrical. Is the artist trying to express an emotion? Who is the subject, and why have the been rendered as they have. It's confusing and a challenge to critique the artwork... until I realize its just bit of randomness generated by algorithm incapable of any creativity beyond how the programmer applied generic and randomizing programming methods.

There isn't and cannot be anything unique to any of the images. Once you've studied any one of them, you've really experienced most of what the programmer/artist has contributed.

Re:AnimeGANv2: Convert Face Portraits into Anime by esjeon on Tuesday November 09, 2021 @09:24PM (#29170381)
One big mistake is that this is not anime. This is obviously comic-style, which is more realistic, and, in turn, closer to automated filtering.

Note that Japanese anime normally uses a much simplified style to increase the production speed. This naturally results in a highly distorted(?!) depictions that even humans often find disturbing. This makes anime-style difficult to mimic.

Re:AnimeGANv2: Convert Face Portraits into Anime by bj-rn on Tuesday November 09, 2021 @02:19PM (#29166148)
Remided me of "Waifu Synthesis- real time generative anime": http://everyoneishappy.com/portfolio/waifu-synthesis-real-ti...
Re:AnimeGANv2: Convert Face Portraits into Anime by Pxtl on Tuesday November 09, 2021 @04:09PM (#29167516)
Ugh, it doesn't properly respect EXIF rotation tags so if I try to post from my phone it gets mangled. EXIF rotation has got to be the most absurdly poorly supported feature of a common file type like jpeg.
Re:AnimeGANv2: Convert Face Portraits into Anime by messo on Tuesday November 09, 2021 @03:58PM (#29167393)
The example with Bill Gates at the bottom is wild! The "teardrop" under one of his eyes makes it slightly gangster, and the smooth face and awkward smile reminds me of a much younger Bill. Fascinating.
Re:AnimeGANv2: Convert Face Portraits into Anime by ur-whale on Tuesday November 09, 2021 @11:34AM (#29163879)
I'd be curious to see how well / stable this behaves under animation.
Re:AnimeGANv2: Convert Face Portraits into Anime by zellyn on Tuesday November 09, 2021 @12:38PM (#29164674)
Found this under that twitter thread mentioned above: https://twitter.com/AIconference/status/1457622949901574149
Re:AnimeGANv2: Convert Face Portraits into Anime by ALittleLight on Tuesday November 09, 2021 @01:16PM (#29165218)
That's really good. I could see this being a popular filter.
Re:AnimeGANv2: Convert Face Portraits into Anime by dryst on Tuesday November 09, 2021 @05:36PM (#29168470)
Lol @ the Bill Gates to middle aged woman with teardrop tattoo.
Re:AnimeGANv2: Convert Face Portraits into Anime by encryptluks2 on Tuesday November 09, 2021 @07:02PM (#29169272)
Bill Gates being Hillary Clinton confirmed.
Re:AnimeGANv2: Convert Face Portraits into Anime by chillingeffect on Tuesday November 09, 2021 @04:22PM (#29167652)
at first the result disappointed me (emotionally, not technically), but after a few minutes I went back to it and was struck by the feel the image brought out. It really reflected some of the wistfulness and sadness I feel with a tiny touch of optimism. I'm not well-versed in anime, but that does seem to be a little bit of the feel that I get from it. bravo.
Re:AnimeGANv2: Convert Face Portraits into Anime by Mumps on Wednesday November 10, 2021 @10:32AM (#29175715)
Not anime _per se_, but the toon-me [0] project gives much more stylistic outputs. I've really enjoyed making some home art with it (and the prior ArtLine).

[0] https://github.com/vijishmadhavan/Toon-Me

Re:AnimeGANv2: Convert Face Portraits into Anime by wintermutestwin on Tuesday November 09, 2021 @10:17PM (#29170670)
I found that it did an awesome job on some photos and messed up some. When it messed up, it generally made mouths look way too distorted. I also thought it was funny that it turned obviously green eyes blue. Overall, I think it is a fun implementation, but it would be much better to have a larger output file.
Re:AnimeGANv2: Convert Face Portraits into Anime by remram on Tuesday November 09, 2021 @11:12AM (#29163626)
Waited 10min then got an error.
Re:AnimeGANv2: Convert Face Portraits into Anime by aliabd on Tuesday November 09, 2021 @12:40PM (#29164714)
Sorry we had to restart the interface - can you try again?
Re:AnimeGANv2: Convert Face Portraits into Anime by Minor49er on Tuesday November 09, 2021 @12:30PM (#29164579)
Same for me
Re:AnimeGANv2: Convert Face Portraits into Anime by wodenokoto on Tuesday November 09, 2021 @04:43PM (#29167894)
I thought the selfie to waifu generator created much more interesting and anime like results.

It does look like it doesn’t work anymore though.

https://waifu.lofiu.com/

Re:AnimeGANv2: Convert Face Portraits into Anime by rbobby on Wednesday November 10, 2021 @12:51AM (#29171520)
I did my "corporate" picture and it came out looking like I had been badly beaten and with really bad teeth (100 years of coffee and cigarettes). Bit of a blow to the self-esteem.

Just not anime material I guess.

Re:AnimeGANv2: Convert Face Portraits into Anime by peterthehacker on Tuesday November 09, 2021 @12:33PM (#29164622)
Tried with Elon and Gates, but both threw this error

  Error occured while trying to proxy: hf.space/
Re:AnimeGANv2: Convert Face Portraits into Anime by aliabd on Tuesday November 09, 2021 @12:39PM (#29164696)
Sorry, we had to restart the interface for a separate issue. Please try again
Re:AnimeGANv2: Convert Face Portraits into Anime by GhettoComputers on Tuesday November 09, 2021 @01:55PM (#29165810)
Who decided this was anime? It doesn't look like any anime I have ever seen, it just looks like a smoothing filter. It looks more like a toonme but not as good and maybe more private? For referece look at this waifu generator, nobody would call these portrait conversions anime. http://thiswaifudoesnotexist.com/
Re:AnimeGANv2: Convert Face Portraits into Anime by rbobby on Wednesday November 10, 2021 @12:42AM (#29171469)
Bill Gates comes out looking a bit like Ellen DeGeneres.
Re:AnimeGANv2: Convert Face Portraits into Anime by codein on Tuesday November 09, 2021 @02:03PM (#29165930)
Did not manage to get any result. Is the service down?
Re:AnimeGANv2: Convert Face Portraits into Anime by bobobob420 on Tuesday November 09, 2021 @03:17PM (#29166898)
Unless this is open source and I can run all of the code locally with no internet connection I am not doing this. Am I too paranoid?
Re:AnimeGANv2: Convert Face Portraits into Anime by ShamelessC on Tuesday November 09, 2021 @03:47PM (#29167254)
It is and you can.
Re:AnimeGANv2: Convert Face Portraits into Anime by TulliusCicero on Tuesday November 09, 2021 @05:17PM (#29168254)
Interesting, you can see how it feminizes faces quite clearly in the examples of Bill Gates and Elon Musk. Gates looks kind of like Ellen DeGeneres to me in the anime version.
Re:AnimeGANv2: Convert Face Portraits into Anime by the_only_law on Tuesday November 09, 2021 @10:14PM (#29170650)
This one didn’t do me too bad, but a lot of the “anime filters” I’ve seen will completely feminize my face into an obviously female character despite the facial structure and beard, I assume because I have long hair.