News for hackers. Stuff that matters.
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by neuralk on Thursday March 21, 2019 @12:36PM (#19454298)
No, it is not just interpolating. The underlying algorithm uses machine learning by applying a trained deep neural network. So there is value added besides a mere upscale.

You're ultimately right, though, and that a true HD is only going to come from the raw film content. What the neural network gives us are essentially plausible higher-res hallucinations.

Edit: as per the other comment, if the original exists only on video and not film, perhaps this is the best we're going to get.

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by rbanffy on Thursday March 21, 2019 @01:17PM (#19454814)
The neural network is applying what it "knows" about photos and inventing new data for the missing pixels. It's "creative interpolation" ;-)
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by eslaught on Friday March 22, 2019 @12:11AM (#19459546)
> Edit: as per the other comment, if the original exists only on video and not film, perhaps this is the best we're going to get.

I don't think that's quite right, at least it doesn't jibe with what the DS9Doc people have been doing (which consists partly of remastering pieces of DS9 scenes):

https://www.indiegogo.com/projects/what-we-left-behind-star-...

I think the footage really was on film, but the issue was that it was composited with low-quality CGI effects, or something like that. So you can rescan the film, but you have to redo all the compositing (and probably with your own models because I'm guessing the original CGI didn't look that good). That's why a DS9 remaster is so expensive.

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by hinkley on Thursday March 21, 2019 @02:49PM (#19455958)
That's still interpolating, by the definitions I know.

The main difference here is that the interpolation algorithm on your TV is online. It's handling 30 frames per second, over 9 million pixels per second. Doing the interpolation offline (ahead of time), you can take as long as you want, look at multiple frames to try to make better guesses, try multiple things and use some fitness measure to pick a winner, even a frame or a pixel at a time.

It's still interpolation.

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by pbhjpbhj on Thursday March 21, 2019 @04:31PM (#19456967)
No, if I interpolate a sequence 200, 400, 600, ... I might get 200, 300, 400, 500, 600, 700. I've not added info. If I look at real world situations and find that whilst the figures fall at the even hundreds it's more realistic that they fall in a range from 20 to 30 points below the hundred on odd-hundreds. Then I have added information, albeit statistically, and the resulting sequence like 200, 287, 400, 475, 600, 672 is no longer raw interpolation.

In this case they're using machine learning to add additional information about textures that isn't in the footage broadcast. They can add frames by interpolation, but the ML texturising and detailing is not interpolation.

Starting with a blob, if you interpolate you get a smoother blob, with this process you get a more structured figure.

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by roywiggins on Thursday March 21, 2019 @04:49PM (#19457166)
It's more like hallucination than anything. You're just forward-projecting your assumptions on what things ought to look like and hallucinating detail that just isn't there.

It can still look nicer than naive upscaling though.

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by avisser on Sunday March 24, 2019 @01:47PM (#19477626)
I see what you're getting at, but it still seems within the definition of interpolation. From wikipedia

> ... interpolation is a method of constructing new data points within the range of a discrete set of known data points

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by cwyers on Thursday March 21, 2019 @01:00PM (#19454594)
Is there any evidence for this? Showing bad 480p DVD rips alongside 1080p upresed video isn't really a fair comparison -- comparing it to a real TV upscaler's output would be fairer. And honestly, even the unfair comparsion doesn't show a whole lot of benefits to me.
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by basch on Thursday March 21, 2019 @01:20PM (#19454846)
Its not upscaling. Its taking what it knows about other non ST pictures and creating new texture and information.
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by cwyers on Thursday March 21, 2019 @01:24PM (#19454904)
Right, but how much does it actually add over a decent upscaler?
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by basch on Thursday March 21, 2019 @01:26PM (#19454928)
are you saying this specific program, or the idea in theory?

http://screenshotcomparison.com/comparison/132311

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by ThePadawan on Thursday March 21, 2019 @02:00PM (#19455343)
I'd be surprised to find a group more obsessed with specifics of what is and isn't quality, it would be the anime community.

There are entire catalogue of overlay comparisons of different releases, encodings etc. [0].

Example: http://compare.bakashots.me/compare.php?setId=3896&compariso...

[0] http://compare.bakashots.me/

Re:Remastering Star Trek: Deep Space Nine with Machine Learning by jjoonathan on Thursday March 21, 2019 @02:01PM (#19455360)
Interpolation looks bad enough without completely sandbagging its color correction. Why resort to that kind of nonsense?
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by basch on Thursday March 21, 2019 @02:05PM (#19455399)
Are you asking why did I change the exposure? Because I did, I was playing around. It was the comparison I had uploaded, I have a copy without on a different computer.
Re:Remastering Star Trek: Deep Space Nine with Machine Learning by Matticus_Rex on Thursday March 21, 2019 @01:53PM (#19455253)
Wow! That's a bigger difference than I expected.