News for hackers. Stuff that matters.
Re:Google RealFill: Authentic Image Completion Using Diffusi... by crazygringo on Friday September 29, 2023 @03:17PM (#37708927)
Wow.

This actually feels like it could be an incredibly valuable post-production tool in film and TV, once they get it working consistently across multiple frames.

Not only for more flexibility in "uncropping" after shooting (there was a tree/wall in the way), but this could basically be the holy grail solution for converting 4:3 to widescreen without cutting off content on the top and bottom.

Re:Google RealFill: Authentic Image Completion Using Diffusi... by qingcharles on Friday September 29, 2023 @03:29PM (#37709042)
I already use Photoshop Generative Fill for uncropping videos, but it only works for fixed camera shots. Photoshop just added feature where you can just drag the video file in and do the uncrop in one step.

The problem I'm solving is converting videos from widescreen to vertical and sometimes you need some extra height.

Re:Google RealFill: Authentic Image Completion Using Diffusi... by jiggawatts on Friday September 29, 2023 @06:21PM (#37710788)
> widescreen to vertical

You’re a monster.

Re:Google RealFill: Authentic Image Completion Using Diffusi... by qingcharles on Saturday September 30, 2023 @10:55AM (#37716021)
I know. What would my parents think of what has become of their son..? Sorry, Mum and Dad! o_O
Re:Google RealFill: Authentic Image Completion Using Diffusi... by jiggawatts on Saturday September 30, 2023 @07:17PM (#37720901)
I know your dad would smack you on the back of the head and tell you in that all-too-familiar tone of voice: “Just turn your phone sideways!”
Re:Google RealFill: Authentic Image Completion Using Diffusi... by kennyadam on Saturday September 30, 2023 @06:05AM (#37714057)
Mind if I ask why you'd need to do that? It's a huge amount of if the frame being generated artificially, especially if you're talking cinema aspect ratio wide-screen.
Re:Google RealFill: Authentic Image Completion Using Diffusi... by qingcharles on Saturday September 30, 2023 @10:54AM (#37716011)
If you're trying to convert widescreen content so it looks good on TikTok, Reels, Shorts, then for the most part you can crop a vertical chunk from the centre of the frame, and pan if necessary to keep the action in frame. Sometimes though the shot is too wide and you can't crop that vertical chunk out, so you have to crop it as vertical as you can and then add something to the top and bottom to fill out the frame, otherwise you have a whole shot that isn't in vertical and it breaks the flow of the video.
Re:Google RealFill: Authentic Image Completion Using Diffusi... by emodendroket on Friday September 29, 2023 @03:19PM (#37708946)
I can see it working great for some stuff but wouldn't you ultimately face the issue with more artistic work that the framing might not be very good if just artificially extending.
Re:Google RealFill: Authentic Image Completion Using Diffusi... by crazygringo on Friday September 29, 2023 @03:24PM (#37708992)
It definitely needs to be applied judiciously on a shot-by-shot basis.

There have been quite a few 4:3-to-widescreen conversions that were done using the original film that was actually shot in widescreen and cropped for TV.

Sometimes, the wider shot makes perfect sense. Sometimes, they keep the original cropped one but cut off top/bottom. Sometimes it's a combination of the two. It all depends on what's being framed -- two people in a car usually benefits from cropping (nobody needs the bottom third of the frame occupied by the car's hood), while a close-up on someone's face usually benefits from extending the sides (otherwise it's an uncomfortable mega-close up that cuts off their mouth).

But having the flexibility to extend horizontally gives you the artistic possibilities.

Re:Google RealFill: Authentic Image Completion Using Diffusi... by waynenilsen on Friday September 29, 2023 @03:32PM (#37709078)
removing the cameraman from the shot is probably pretty close to the top of the list also
Re:Google RealFill: Authentic Image Completion Using Diffusi... by Wistar on Friday September 29, 2023 @07:13PM (#37711211)
… especially on highly reflective subject surfaces such as cars.
Re:Google RealFill: Authentic Image Completion Using Diffusi... by Gabrys1 on Saturday September 30, 2023 @01:21AM (#37712964)
Initially I read the above as removing the cameramen from the process of taking photos (which is also where this is going)
Re:Google RealFill: Authentic Image Completion Using Diffusi... by miahwilde on Friday September 29, 2023 @07:22PM (#37711273)
wow x2. You're right video is where this is really cool. Take enough video of a scene and you can then create most any photo from any angle in it.