News for hackers. Stuff that matters.
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by rictic on Thursday March 21, 2019 @12:40PM (#19454348)
> You can't get information out of SD video that wasn't there before with upscaling, so the algorithm is just interpolating.

In the fully general case of arbitrary video this is true, but in practice it isn't.

You can gather information over time to do superresolution, and if you want to get super fancy you can build a world model (e.g. get more information about what an actor's face looks like from a close up shot, and apply that knowledge to less detailed shots).

I expect ML based upscaling to eventually produce some truly stellar results.

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by basch on Thursday March 21, 2019 @01:23PM (#19454893)
a combination of a world model, along with non-source enhancements.

i imagine upscaling the Phantom Menace podrace to 4k, and giving the model a bunch of NEW rock texture info to use to create new detail.

Kinda of an automated way to combine these two ideas.

http://www.framecompare.com/image-compare/screenshotcomparis...

https://techcrunch.com/2019/03/18/nvidia-ai-turns-sketches-i...

What you dont want is every upscale to start looking homogeneous, so it would be best for a design team to specifically map old to new texture sets, giving each upscale a unique look.

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by tracker1 on Thursday March 21, 2019 @02:11PM (#19455477)
I would expect multi-view rendered models of ships/stations etc to also help significantly as well... vs. re-rendering sfx, it would be upscaling via AI with knowledge of detailed views/models for the actors... training stills could go a significant way.
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by ocdtrekkie on Thursday March 21, 2019 @02:02PM (#19455376)
I was thinking particularly about the space battle shots, where you could provide 3D models of each of the ships, so that the software had the higher detail information, and would just need to match position, movement, and lighting.