News for hackers. Stuff that matters.
Re:Enhancing Photorealism Enhancement by tallanvor on Wednesday May 12, 2021 @06:48AM (#27128785)
I almost clicked away from the the article because those Cityscapes transformations looked worse in my opinion - just washed out and dull, so I can understand why people didn't like the look. The Mapillary Vistas processing definitely was nicer, although it looked uneven to me - the road still looked washed out, which created an almost disturbing level of contrast with the greenery.

What they've done is interesting, and I think with further refinement it is certainly a technique to consider.

Re:Enhancing Photorealism Enhancement by marcodiego on Wednesday May 12, 2021 @08:21AM (#27129428)
I think expectations influenced by culture play a role here. Since I live in a Brazilian metropolis (4mi population), the Cityscapes transformations looked more real. That is probably because they look more like what I'm used to see when I walk the streets. People from rich neighborhoods in the US will likely find the Mapillary Vistas more realistic since that is what they used to see.

Impressive result nevertheless. Improving this with adversarial networks will probably generate images which are indistinguishable from reality in just a few years.

Re:Enhancing Photorealism Enhancement by formerly_proven on Wednesday May 12, 2021 @08:35AM (#27129538)
The color grade in GTA is of course an artistic choice and rendering the entire game with foggy overcast light and a strong green tinge (which btw. is not how German cities look, we aren't living in a bad color transfer of The Matrix) makes it look bad at the macro level. The details might be enhanced by this method, but honestly it's kind of hard to tell from a heavily compressed 720p Youtube video. What looks okay or even better in a video doesn't have to look better interactively, uncompressed, in native resolution.

Hot take: The overall tone of the style produced using this dataset comes from capture artifacts.

Re:Enhancing Photorealism Enhancement by 411111111111111 on Wednesday May 12, 2021 @09:36AM (#27130146)
the only thing i could get out of the demo videos is that their fps is shit.

fps > beautiful images until you get at least 60... which this wasn't.

im pretty bearish on this kind of innovation in games tbh, its never going to be low latency enough to be viable, even if they'd improve their framerate - i dont see it going beyond academic interest because of that

definitely interesting to read about though, even if i doubt its viability in gaming

Re:Enhancing Photorealism Enhancement by container on Thursday May 13, 2021 @04:09AM (#27139641)
>its never going to be low latency enough to be viable Why is that? Just because it's expensive in terms of computation? I can't see why latency wouldn't improve with framerate.
Re:Enhancing Photorealism Enhancement by 411111111111111 on Thursday May 13, 2021 @07:59PM (#27149038)
It couldn't because of the nature of this technology.

Their post processing can only start after the full image has been rendered, so whatever photorealism filter they apply will necessarily delay the image until the process is finished.

Re:Enhancing Photorealism Enhancement by Scea91 on Friday May 14, 2021 @01:41PM (#27157252)
This is not a fundamental obstacle for the technology. Lots of stuff is happening in post-processing already.
Re:Enhancing Photorealism Enhancement by nearbuy on Wednesday May 12, 2021 @03:25PM (#27134168)
The Cityscapes transformations have a photorealism advantage because they're blurrier and more washed out. It's easier to match less detailed photos.

The blurriness, green tinge, and washed out colours are qualities photos sometimes have, but it's not what we see with our eyes. But they do help hide details that would give the image away as a computer rendering.

Re:Enhancing Photorealism Enhancement by Cthulhu_ on Wednesday May 12, 2021 @08:15AM (#27129396)
Definitely; I mean if they had a dataset of the cities and locations GTAV was based on I think it might look uncanny.