News for hackers. Stuff that matters.
Re:Re-creating Disney's sodium vapor process featuring Paul ... by modeless on Monday April 08, 2024 @07:42PM (#39974841)
Hmm, why don't people do this with near infrared? It would allow using full spectrum lighting, and would be easier to selectively filter.

I'm guessing the answer is "they do, it's just uncommon and you haven't heard about it"

Re:Re-creating Disney's sodium vapor process featuring Paul ... by wokwokwok on Monday April 08, 2024 @08:30PM (#39975148)
Did you see them putting the black panels up in the video and measuring the color spectrum off the costume, and covering the skylight?

They did that to get a 'perfect' mask.

If you use infrared, which is generated by random environmental objects, how would you prevent random spill?

Practically (my understanding) is if you got random spill on the surface, you'd get random alpha in the mask.

The point of using the sodium light is that it's a single wavelength that you really really would not get naturally, so you can totally control the emission sources of it.

Could you do that with a single frequency infrared? I guess it's possible, but I'm not sure how you'd do it technically, and it's unclear what the benefit of using a different frequency would be?

Re:Re-creating Disney's sodium vapor process featuring Paul ... by modeless on Monday April 08, 2024 @08:40PM (#39975197)
Near infrared isn't generated by random environmental objects. You're thinking of far infrared. Infrared is a big spectrum, much larger than the visible spectrum.

It may be generated by lights but could be filtered out. It is generated by the Sun, but so is the sodium wavelength. The technique would work indoors just as well as the sodium one, but with important advantages. I think it could even work pretty well outdoors if you used a wavelength that is mostly filtered out of sunlight by the atmosphere, or maybe two different wavelengths in two channels simultaneously.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by wokwokwok on Monday April 08, 2024 @11:06PM (#39975914)
Huh, my bad, I thought thermal sources (ie. like random hot stuff, not glowing hot stuff) emitted a wide band of frequencies including near-IR, but fair enough. You'd still get it from any sort of incandescent light source right? (same as a sodium lamp)

> but with important advantages

What's the benefit over using any other single frequency visible light?

Even if the atmosphere absorbs most of a particular band, if any of it gets through, your mask is going to be messy, which kind of ruins the point; I don't know anything can really fix that for outdoor purposes?

I mean, broadly speaking, all you need is a way to emit a sharp frequency band and avoid having any environmental pollution in the same band.

If there's a good way to do that in near-IR, it would work; but I feel like the same could be said about pretty much any frequency.

I'm not aware of anything specific about near-IR that makes it particularly attractive.

(but, clearly, I'm no expert in near-IR)

Re:Re-creating Disney's sodium vapor process featuring Paul ... by modeless on Monday April 08, 2024 @11:20PM (#39975964)
The advantages I stated were

> It would allow using full spectrum lighting, and would be easier to selectively filter.

Also it would allow using any color background including black, and the on set lighting would appear to the eye exactly as it does to the camera. With the sodium vapor process the bright yellow light would make everything on set look different in person because the eye wouldn't be able to subtract it the way the camera does.

Yes, you would need a filter on any incandescent light. But this is also true of the sodium vapor process. They used LED lights in this video for that reason, which were very much not full spectrum and would not produce natural colors for some materials.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by wokwokwok on Tuesday April 09, 2024 @01:39AM (#39976431)
The whole point of this technique is that you have that sharp frequency band and a crystal / filter that splits like band out.

You're basically proposing something completely different here.

So... while I agree you could do something as you describe, and I'd be interested to see the results of it, I'm not sure what the results would be like.

> The advantages I stated were

>> It would allow using full spectrum lighting, and would be easier to selectively filter.

All I can say is the CC results in that video were pretty great, despite the obvious caveats, compared to green-screen.

If you (or anyone) can build on it to do better, people will be interested in it; but there's obviously a difference between us idly speculating on how/if it might work, and this, where they've actually done it and shown that it does work.

> "they do, it's just uncommon and you haven't heard about it"

I've never heard of it being done.

If anyone has, please post a link or something.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by modeless on Tuesday April 09, 2024 @01:47AM (#39976474)
No, the point of the technique is you have a frequency band that you can isolate and use in the background and not in the foreground. Using IR instead of visible as your isolated band makes the isolation easier and cheaper with fewer artifacts and limitations. It's still a very similar process otherwise.

Yes, Corridor's results were great. Fewer limitations would make the process even better!

Re:Re-creating Disney's sodium vapor process featuring Paul ... by ctrw on Tuesday April 09, 2024 @03:55AM (#39977084)
Near ir LEDs are also cheap and easy to power, with its what's in remote controls. Low pressure sodium lights aren't. I remember using them in postgrad labs and it wasn't fun.

Alternatively you could use a solid state laser or narrow band LEDs if you need the band to isolate to be in the visible spectrum too.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by pfdietz on Tuesday April 09, 2024 @10:45AM (#39980009)
> What's the benefit over using any other single frequency visible light?

One advantage might be to pulse the IR and detect it via that, if the detectors are sufficiently fast. Maybe have a filter that's pulsed also (Pockels cell?)

https://en.wikipedia.org/wiki/Pockels_effect

Re:Re-creating Disney's sodium vapor process featuring Paul ... by randomfrogs on Tuesday April 09, 2024 @11:24AM (#39980455)
One problem you might run into is that a lot of common plastics are opaque to NIR light, so you might find certain materials gave you strange results (water bottles that appear transparent to the eye would not actually pass the NIR light needed to make the mask layer).
Re:Re-creating Disney's sodium vapor process featuring Paul ... by xemoka on Monday April 08, 2024 @07:53PM (#39974927)
Neat little rabbit hole, thanks. It lead to Netflix's "Magenta Green Screen: Spectrally Multiplexed Alpha Matting with Deep Colorization" by Dmitriy Smirnov, Chloe LeGendre, Xueming Yu, Paul Debevec: https://arxiv.org/abs/2306.13702

Not with a non-visible spectrum, but along the same lines. I can't seem to directly find anything with NIR though;

Re:Re-creating Disney's sodium vapor process featuring Paul ... by djmips on Wednesday April 10, 2024 @12:25AM (#39986947)
Thanks for digging that up!
Re:Re-creating Disney's sodium vapor process featuring Paul ... by ikiris on Monday April 08, 2024 @08:10PM (#39975052)
Because you want color bands that you control, not that are naturally emitted.
Re:Re-creating Disney's sodium vapor process featuring Paul ... by modeless on Monday April 08, 2024 @08:59PM (#39975325)
Near infrared isn't naturally emitted by room temperature objects. You're thinking of far infrared.
Re:Re-creating Disney's sodium vapor process featuring Paul ... by ikiris on Tuesday April 09, 2024 @12:12AM (#39976131)
I didn't say room temperature objects. I said naturally emitted. Trying to have lights and other objects involved in film production that don't have emission spectra inside the mask range for near infrared would be a lot of effort compared to just... not having it be a problem with things that are easily attained with cheap materials like sodium narrowband.
Re:Re-creating Disney's sodium vapor process featuring Paul ... by modeless on Tuesday April 09, 2024 @12:31AM (#39976209)
By that definition the sodium wavelength is naturally emitted too. The sodium vapor process as implemented in the video requires special lights that don't emit the sodium wavelength. It's actually much harder to do that (and it affects color reproduction too) than to block some infrared from existing lights. Infrared blocking film and filters are readily available and cheap. They don't need to be fancy narrowband notch filters like a sodium wavelength filter would have to be.

Now that I think about it, Disney must have done something pretty special for the lighting in the foreground in their version of the process. They didn't have single wavelength LEDs back then. I wonder how they did it?

Re:Re-creating Disney's sodium vapor process featuring Paul ... by largbae on Monday April 08, 2024 @07:57PM (#39974948)
Does the magic color need to be within the frequency range that the camera and video format can record?
Re:Re-creating Disney's sodium vapor process featuring Paul ... by modeless on Monday April 08, 2024 @08:00PM (#39974973)
Most camera sensors need a filter to block infrared light because they are sensitive to it. Remove the filter and replace it with an infrared pass filter, and you've got an infrared camera. It may not be as sensitive as in visible wavelengths but you can use brighter infrared lights to compensate if necessary. This sodium vapor process already uses two cameras so it would work the same way. It seems possible to produce a four-channel camera sensor specifically for this use case, if it was popular enough. Given how common green screen is in Hollywood I'm surprised I haven't heard of anyone doing it.
Re:Re-creating Disney's sodium vapor process featuring Paul ... by hollerith on Monday April 08, 2024 @08:16PM (#39975082)
>brighter infrared lights to compensate if necessary

My guess that that is dangerous to human health because infrared fails to elicit the flinch reaction that too-strong visible light does.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by hansvm on Monday April 08, 2024 @08:52PM (#39975277)
Near-infrared penetrates very well. The same intensity is much safer, up till you get to the levels of radiation that are dangerous regardless of how they're distributed in your tissues.

That's one of the things that makes it suitable for thermal nano cancer therapies. You

(1) Create a nanoparticle with a gold core of the right size that it excites when exposed to near-infrared radiation (the far end of "near" is ideal),

(2) Coat it with something that's hopefully less toxic than the cancer because the gold nanoparticles are pretty reactive (silica was popular last I checked, though I'm not convinced that's actually safe, and there hasn't been much testing on it),

(3) Coat that in something that binds to the right antigens,

(4) Inject that into the patient so that you'll eventually have a tumor rich in these nanoparticles while the rest of the body has a very low concentration,

(5) Shine an intense near-infrared beam at the nanoparticles. It safely penetrates body and causes minimal heating, instead depositing all its energy at the tumor, selectively cooking just the bits of tissue you don't want anymore.

It's yet another way to make mice immortal, but human testing is a long ways off. The hard parts are (2) and (3), along with the (4a) I didn't mention where most of these things don't want to stay "nano" in most chemical environments, and the solution they're suspended in is usually also not ideally suited to being injected into living mammals who would like to retain that "living" property.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by hollerith on Monday April 08, 2024 @10:00PM (#39975644)
>Near-infrared penetrates very well. The same intensity is much safer

Glowing-hot steel produces enough IR that the workers that work with it have 7 times the rate of cataracts as the general population.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by hansvm on Monday April 08, 2024 @11:23PM (#39975975)
Sure, enough of almost anything is dangerous.

NIR is much safer than the visible spectrum at the same power levels. The threshold for a few minutes of high-intensity NIR increasing your chance of eventual cataracts is staring at an NIR source 10x brighter (w/cm^-1) than the sun integrated across all its wavelengths. The threshold for sun-colored wavelengths causing eventual cataracts above the baseline from a few minutes of staring is under 1x.

Also worth noting, very very near IR (basically red, though we can't see it) doesn't quite enjoy those same properties, and during their time working with hot metal you'd expect a lot of energy in that band.

Also worth noting, many steel workers are exposed to dangerous amounts of visible light too. I absolutely believe that they can get enough NIR to cause problems, but if I wanted to try to prove that NIR specifically causes their problems to somebody else then I'd want to try to account for that fact (and for incidental welder exposure, ...).

Re:Re-creating Disney's sodium vapor process featuring Paul ... by magicalhippo on Monday April 08, 2024 @08:57PM (#39975316)
The sensors should be sensitive[1] well into the near-IR, and there are people in the astrophotography community which can service digital cameras to remove the IR-cut filter, these[2] for example.

Another alternative I was thinking about is just to use one of those monochrome astrophotography cameras, something along the lines of this[3]. The monochrome version doesn't have the IR-cut filter and sensitivity is pretty ok down into near-IR.

edit: The IMX492 sensor in that one has a 40% response at 850nm, and 850nm IR diodes are plentiful and shouldn't emit[4] much at all below the 700nm of the IR-cut filter the color camera should have.

Not sure how mixing sensor sizes and such would affect things, or if it's better/easier to just run two of the same camera.

[1]: https://s1-dl.theimagingsource.com/api/2.5/packages/publicat...

[2]: https://www.lifepixel.com/

[3]: https://www.zwoastro.com/product/asi294mm-mc/

[4]: https://lumileds.com/wp-content/uploads/files/DS191-luxeon-i...

Re:Re-creating Disney's sodium vapor process featuring Paul ... by laserbeam on Monday April 08, 2024 @11:48PM (#39976054)
You want the 2 cameras you are recording with to be near identical. If the lens is different (for example) then the mask might be distorted and would not line up with the colored image.

Building 2 nigh identical cameras, but one with a sensor outside of the frequency range of the other, is probably a very expensive custom job.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by Glyptodon on Tuesday April 09, 2024 @12:55AM (#39976270)
If you have the prism for it and you just need a lens mount attachment at sensor distance from the prism and two reverse mounts on the other side of it to mount mirrorless cameras on (assuming light comes out of the prism straight or if you can just split the distance between each side of the prism -- note I have no idea about this) it doesn't seem that expensive - buy a couple mirrorless cameras, get yourself a cube with the mounts, and get going with one lens, no?

It seems like the cube with mounts is the most expensive part, and there's no way it can cost more than one of your cameras, let alone the lens, right?

Re:Re-creating Disney's sodium vapor process featuring Paul ... by moron4hire on Tuesday April 09, 2024 @06:17AM (#39977926)
Lens distortions can be corrected mathematically in post after a relatively simple calibration. Your standard DSLR actually already does this. Most lenses have a chip that reports an ID that gets recorded with each photo to recall from a database of distortion parameters.
Re:Re-creating Disney's sodium vapor process featuring Paul ... by wiml on Tuesday April 09, 2024 @12:58AM (#39976284)
From what I've read in old books on SFX, they did, and near-UV as well.

My guess though is that using a visible wavelength makes it easier to set up the lighting and ensure it's even and so on (remember, this was before electronic technologies that would make it possible to live-preview the result). Also, sodium lights and sodium band filters had other uses in industry so they might have been more available than NIR/NUV equivalents.

Re:Re-creating Disney's sodium vapor process featuring Paul ... by ginko on Tuesday April 09, 2024 @03:14AM (#39976883)
Apart from what others have said, you'll run into problems with chromatic lens aberrations the further your "key" wavelength is outside of the visible spectrum so your two images might start to mismatch too much.

I know in IR still photography you're supposed to add a focus offset marked on your lens to adjust for that. A regular achromatic lens quickly fails outside of the wavelength range it was designed for[1].

[1] https://en.wikipedia.org/wiki/Chromatic_aberration#Minimizat...

Re:Re-creating Disney's sodium vapor process featuring Paul ... by eurekin on Tuesday April 09, 2024 @04:12AM (#39977166)
Maybe... it would get too hot?
Re:Re-creating Disney's sodium vapor process featuring Paul ... by modeless on Tuesday April 09, 2024 @07:58PM (#39985565)
You're right, there would be lens distortion. But it should be correctable. You'd have to characterize the distortion for the lens you're using and then unwarp the infrared image.
Re:Re-creating Disney's sodium vapor process featuring Paul ... by p_noumenon on Wednesday April 10, 2024 @10:27AM (#39991077)
The answer seems more to be, "people haven't really been using this magical technology in decades", so maybe they'll start coming up with innovations to it eventually, and find out whether or not near-infrared frequencies are superior or not or what the advantages/disadvantages are.