News for hackers. Stuff that matters.
Re:Understanding ProRAW by hughes on Tuesday December 15, 2020 @03:14PM (#25434589)
If a mirrorless digital camera company ever made their software anywhere near as good as this, or if Apple ever brought their software expertise to a device with a full-frame format sensor and lens mount, they would absolutely dominate that market.
Re:Understanding ProRAW by hughes on Tuesday December 15, 2020 @03:15PM (#25434607)
Are there even any camera companies that even have ambitions of reaching a level like this?
Re:Understanding ProRAW by altarius on Tuesday December 15, 2020 @03:22PM (#25434708)
AFAIK a good chunk of digital camera processing is still done in ASIC/hardware and mindshift to GPU/CPU SIMD/software will take time, so it will probably be a while until camera manufacturers even begin to catch up.

That said, Olympus does a couple computational photography approaches (handheld multishot high res) and Fuji recently introduced in-camera HDR - but I tried neither.

Re:Understanding ProRAW by jsjohnst on Tuesday December 15, 2020 @08:29PM (#25437913)
> AFAIK a good chunk of digital camera processing is still done in ASIC/hardware

I’m not authoritative on this topic, but I can’t think of a camera produced by one of the majors which isn’t mostly or entirely ASIC based for image processing.

> Fuji recently introduced in-camera HDR

Canon has had in-camera HDR for years, but I’m not sure I’d really put the output in the same category as a modern smartphone.

Re:Understanding ProRAW by rimliu on Wednesday December 16, 2020 @04:41AM (#25440654)
Also Live Composite and friends, focus stacking.
Re:Understanding ProRAW by 67868018 on Tuesday December 15, 2020 @03:23PM (#25434736)
Olympus is dead now, though
Re:Understanding ProRAW by akuma73 on Tuesday December 15, 2020 @03:36PM (#25434908)
They should drop their custom ASICs and just stick a Qualcomm Snapdragon as a replacement. They could use Android and create a platform with an app store with APIs to access their sensor. Opening up the hardware in this standard way to developers would really add a lot of value to their cameras.

I have no idea why they haven't done this already.

Re:Understanding ProRAW by knolan on Tuesday December 15, 2020 @04:14PM (#25435341)
I’m sorry but I cannot fathom using Android (or iOS) on a professional camera. My Canon gear is extremely fast and responsive and Android is anathema to that. It powers on instantly and I can flip through menus as fast as I can physically turn the control wheel. I can change batteries in less than a second. My cameras will run for years without slowing down. My 7D is ten years old and as performant as the day I bought it. (It’s actually better since a firmware update lets me hotswap memory cards with my 5Dmk3.)

They can process raw images in body and display them at any zoom level without lag, loading or any other issue. My R5 has a touch screen but it’s faster and more comfortable to use the physical controls, especially since you can change settings without actually having to even look. It’s almost identical to my 5Dmk3 except they moved a couple of buttons because of the articulating screen hinge.

This is exactly what most photographers want. Familiar hardware that doesn’t get in the way. That gives the best optical quality that accurately and faithfully captures a scene giving total creative freedom to the photographer not the processor.

The idea of ruining a perfectly good system by pushing Android onto it ‘because apps’ or whatever it is such HN/disruptive nonsense.

Look at any smartphone photo on a large screen and they’re basically mush when it comes to detail. This is fine for most people, these phone cameras are far better than the point and shoot market they have rightfully destroyed.

People edit professional camera photos on large screens and nobody wants to use their camera to edit. Nobody wants their professional camera to introduce computational artefacts onto their exposure. Nobody wants to wait for it to boot. Nobody wants battery life to fall through the floor.

Lytro made a light field camera that ran Android. It was a fun gimmick and is now gathering dust on my shelf. Now Zeiss is making one for $6k and no one who actually cares about photography will buy it.

Re:Understanding ProRAW by djxfade on Tuesday December 15, 2020 @06:31PM (#25436876)
Fun fact, Android was originally designed to be a digital camera OS.

> The early intentions of the company were to develop an advanced operating system for digital cameras, and this was the basis of its pitch to investors in April 2004

https://en.m.wikipedia.org/wiki/Android_(operating_system)#h...

Re:Understanding ProRAW by sudosysgen on Tuesday December 15, 2020 @05:43PM (#25436300)
The user interface in my A7ii is actually Android, mostly. Responsive Android is absolutely doable if you design it a certain way, and there is no need to remove features like removable batteries or literally anything else.

There is also absolutely no need for it to introduce artifacts into your images. RAW+JPEG is already good enough for this.

The actual advantage of an open camera are huge. For example, it would be trivial to adapt the camera to literally any mount, from EF to E to G and so on, which in and of itself is completely disruptive.

Phone processors have other aces up their sleeve. For example, unlike the Canon EOS R5, they can actually process 8K video indefinitely without breaking a sweat.

As for battery life, you're once again very wrong. The biggest draws in battery life in a camera are the processor and the sensor. Using a phone processor would allow for much lower energy usage as the lithography is incredibly more efficient, and all the high-battery-usage parts of a phone would disappear, such as always-on LTE modems, background processing, and so on.

For boot, Android with a camera sized battery and no modem can last weeks in standby, months in sleep mode. Your camera already doesn't turn off, but instead enters a low-power state. Try removing the battery of an A7 or EOS R, discharging the internal energy storage, and see how long it takes to start.

The actual advantage of this is that it allows you to become a camera manufacturer for much lower costs, meaning that you don't have to limit yourself to a single mount, and can outsource some R&D externally. For example, you won't need to be Fuji to have accurate film sims, you won't need to be Canon to have native level EF compatibility, and you'd even be able to do revolutionary things like autofocus manual lenses.

Beyond that, you'd be able to do things like temporal noise reduction, 3D depth mapping for haze removal, and so on, that can be either used for automatic processing and/or made available in RAW format for further editing.

Basically, you're describing "what if a phone company made a bad camera". What I'm talking about at least is "what if photographers made a camera untethered by the restrictions of existing cameras using commodity hardware". I think the second has the potential of seriously providing value.

Re:Understanding ProRAW by jsjohnst on Tuesday December 15, 2020 @08:37PM (#25437972)
> For example, it would be trivial to adapt the camera to literally any mount, from EF to E to G and so on, which in and of itself is completely disruptive.

That’s a bit hyperbolic, the collar isn’t the only difference between those lens connectors.

Re:Understanding ProRAW by sudosysgen on Tuesday December 15, 2020 @08:55PM (#25438088)
It is a bit hyperbolic, but both the EF, E and Nikon G mounts have been essentially fully reverse engineered as far as driving a lens. The issue is that the communication to the body of some information isn't fully understood yet and might never be, which prevents third-party lenses as well as adapters from working properly.

If you were to make a camera that is fully open, maybe even modifiable on the info it sends to the lens and what information it wants back, then you would get aftermarket adapters for Canon EF (you could also make one yourself with publicly available info). Sony E would be a tougher nut to crack, but there is a fair bit of info already out and there are already E mount adapters feasible.

So yes, maybe trivial is hyperbolic because of the Sony E mount, but very feasible.

Re:Understanding ProRAW by jsjohnst on Tuesday December 15, 2020 @09:13PM (#25438195)
I agree the mounts have been mostly reverse engineered, but that doesn’t detract from my point (which I might not have done a good job of articulating). The point I was trying to make is that each mount has different focal characteristics which would make it non-trivial to support on a single body (with a swappable collar adapter). Doable, yes, but not trivial. Even ignoring the focal differences, electrically (aka lens to camera communication) wouldn’t be what I would call trivial either.

(For background, a friend and I worked on designs for making an open camera platform a few years ago)

Re:Understanding ProRAW by sudosysgen on Tuesday December 15, 2020 @09:57PM (#25438526)
Oh, I didn't mean that the physical mounts have been mostly reverse engineered. I meant that the camera→lens communications have been fully to almost fully reverse engineered.

Mount optical characteristics are very simple. Just make sure your base mount has a larger diameter and a shorter flange distance, and you're golden. If you are designing your camera around that it is almost trivially done.

The code for implementing a basic E mount is on github, for the EF mount you just have to go looking around on some forums or buy it from the guy behind Metabones, same for Nikon G.

Re:Understanding ProRAW by AussieWog93 on Tuesday December 15, 2020 @04:52PM (#25435680)
I have no idea why this was downvoted. Android is bloated and clunky, and far too many manufacturers put it in devices where it solves precisely zero problems and creates hundreds.
Re:Understanding ProRAW by jsjohnst on Tuesday December 15, 2020 @08:32PM (#25437940)
I’m not one who did, but I’m assuming the confrontational tone of GP is likely a cause.
Re:Understanding ProRAW by rektide on Tuesday December 15, 2020 @05:00PM (#25435782)
I hear your concerns, I recognize your needs. I just don't see that rebasing the camera's software atop something more flexible & open-to-building-atop like for example Android would in any way pose a threat to the camera as you know & love it.

The fact is there's no reason you'd even have to know a camera is running Android. You can put whatever user-interface shell you want on to an OS, and it could run the same form factor, present the same (hopefully better) menus and interfaces & buttons, flip through menus just as fast, have the same optics, allow the same batteries. Get Micron or someone to use persistent memory so the boot time is even less than what you have now, which is not, as you say, instant, at least not on any camera I've ever seen.

New cameras like the Sony A7S iii have really good buttons-or-touchscreen interfaces. I think a lot of people have thought buttons are the way to go, have a die-hard perspective on what a proper camera is, but they, now that the future is here, are finding the flexibility offered amazing, finding that they would never want to go back.

> The idea of ruining a perfectly good system by pushing Android onto it ‘because apps’ or whatever it is such HN/disruptive nonsense.

The software defined world is one of open possibilities. "Because apps" is such a droll unimaginative slander of that notion. It's great that you feel so well served by your fixed-function cast-in-stone device, but it A) doesn't have to be that way forever, for every-one, and B) if cameras do get more flexible & capable of user-defined behaviors, it doesn't mean you have to lose this thing you evidently love.

Allowing people the flexibility to explore additional ways of doing photography seems to me like it should be obvious & is a frontier I look forward to opening.

I come from a different place. My friends are all pro-sumer, not professionals, but we're all insulted beyond belief how inflexible, how bad the computational photography is on our fancy mirrorless cameras, especially as compared to modern Pixel cameras. More-so, failure to start allowing more creative uses of cameras is an existential risk to cameras. Yes, some photogs will keep readily buying forever, but a lot of consumers find way more value from their phones, and cameras ought to want to be able to compete, to be devices for creativity. Right now, they are, but primarily inside the same lines they have been for decades on end now.

> This is exactly what most photographers want.

Not that big a market, compared to the rest of the world, who also enjoy taking photos, it turns out. But I think the photogs would be better served too, in the long run; much better served.

And I don't think they'd lose anything either.

Re:Understanding ProRAW by rektide on Tuesday December 15, 2020 @03:59PM (#25435180)
Sony cameras secretly are Android devices. You can write your own Android apps for them[1].

Why this isn't advertised, promoted, & made available? Why digital cameras seem to want to get their lunch taken by phones? Not sure!

I think it was way too soon, but Samsung had a good go with a series of Samsung Galaxy Cameras[2] that were proud Android brandishing devices. Android has gotten better, mobile chips have gotten way better. But even something more like the unofficial OMF that I linked, a Sony camera, that doesn't look like an Android system, it looks like a camera, but is really Android and can run Android? That makes hella-sense to me.

[1] https://github.com/ma1co/OpenMemories-Framework

[2] https://en.wikipedia.org/wiki/Samsung_Galaxy_NX

Re:Understanding ProRAW by srsm on Tuesday December 15, 2020 @04:01PM (#25435205)
Well, only the older ones, the A7iii and onward don't have an accessible Android subsystem. But even for those before the A7iii, it's more of a subsystem and doesn't have access to a lot of functions that are done by specialized chips.
Re:Understanding ProRAW by srsm on Tuesday December 15, 2020 @03:55PM (#25435129)
This is a huge area for disruption IMO. Using a Snapdragon chip plus an FPGA/ASIC to translate SLVS-EC to MPI and buying a sensor would allow for a camera with much better performance characteristics possibly even at a lower price, and the programmable hardware would open up an insane amount of possibilities and allow for incredible value.

If anyone wants to consider doing this, shoot me a message.

Re:Understanding ProRAW by altarius on Tuesday December 15, 2020 @04:30PM (#25435501)
They don't even need to go full smartphone processor and OS, adding something GPGPU-esque to offload the computations to would work. Deep Neural Nets brought us many "edge TPUs", I don't see why they wouldn't equally work to process images quickly and they're reprogrammable.
Re:Understanding ProRAW by redvenom on Tuesday December 15, 2020 @11:05PM (#25438921)
In most situations that photographers actually care about (i.e. capturing beautiful, good light), ILCs already murder the iPhone. Computational photography may be cool but it is just helping the iPhone emulate ILCs.
Re:Understanding ProRAW by centimeter on Tuesday December 15, 2020 @06:34PM (#25436907)
Having demosaicing and complicated features like shot compositing happen before “raw” encoding disqualifies this from use in professional-oriented cameras.
Re:Understanding ProRAW by SigmundA on Tuesday December 15, 2020 @03:57PM (#25435153)
Imagine a Magsafe camera lens / sensor with some kind of high speed wireless interconnect to iPhone:

https://daxpix.medium.com/can-the-magsafe-hold-a-camera-lens...

Re:Understanding ProRAW by Cactus2018 on Tuesday December 15, 2020 @06:05PM (#25436582)
Sony was thinking of this too - DSC-QX series:

https://en.wikipedia.org/wiki/DSC-QX100

Re:Understanding ProRAW by myself248 on Tuesday December 15, 2020 @09:55PM (#25438506)
The Olympus AIR is the same thing. Minimal sensor-and-battery behind a lens mount, do everything from your phone.
Re:Understanding ProRAW by altarius on Tuesday December 15, 2020 @04:27PM (#25435485)
Ohh, I just remembered the long-delayed Zeiss ZX1 ($6000 fixed-lens 35mm f/2.0 camera) that has Adobe Lightroom built in. I like the concept, I bet the implementation is quite flawed though.

If I were spending that money on a fixed-lens camera, it'd be a Leica Q (thanks, craigmod :/ ) but the concept is interesting.

Re:Understanding ProRAW by cmod on Wednesday December 16, 2020 @12:03AM (#25439266)
A used Q in good shape can now be had for a reasonable amount of cash. I’m still on Q1 and love it. (Although the hardware interface improvements to Q2 are subtle but impressive.)
Re:Understanding ProRAW by altarius on Wednesday December 16, 2020 @06:54PM (#25450425)
I loved your Leica Q writeup and have been contemplating one ever since.
Re:Understanding ProRAW by lmilcin on Tuesday December 15, 2020 @03:36PM (#25434917)
iPhones make good photos because they stand out from competition. People look at them and see they are different. Soon everybody is going to be fed up with dramatic lighting, extended dynamic range because competition will be doing the same.

Good photos stand the test of time because they are interesting, not because they have pumped colors and HDR.

Re:Understanding ProRAW by unicornporn on Tuesday December 15, 2020 @04:14PM (#25435339)
> iPhones make good photos because they stand out from competition. People look at them and see they are different.

https://www.youtube.com/watch?v=kbeEkwlTeqQ

Re:Understanding ProRAW by vmception on Tuesday December 15, 2020 @10:18PM (#25438649)
The iPhone 12 Pro is better than EVIL & DSLR cameras, and that mostly comes down to software.

Introducing ProRAW in a software update is already going to solidify that.

If digital cameras want to compete here is what they need to do:

- add live photos as a default

If photography enthusiasts wants to gatekeep:

- buy an older camera and stick with that... collectible.

If Apple wants to continue making their devices more appealing than dedicated cameras:

- Add live photos to portrait mode

Re:Understanding ProRAW by redvenom on Tuesday December 15, 2020 @11:04PM (#25438914)
The iPhone 12 may have some cool auto computational features, but in no way is it better than an ILC camera like a DSLR. If you actually compare image quality side by side, a DSLR typically will smoke an iPhone. Not to mention there is no way to go past ~100mm on even the best phones.
Re:Understanding ProRAW by vmception on Wednesday December 16, 2020 @12:38AM (#25439452)
Oh I forgot, I only do portraits and stopped taking interchangeable lens cameras with me places over half a decade ago. I don't do landscapes or wildlife photography, nor did I ever have a desire to to make rivers look like smudges with a long exposure.

For portraits, iPhone 12 Pro in okay lighting is the first one where I say, yeah good enough and often times better.

I don't care about DXOMark, I care about what humans think, and across mediums a photo from an iPhone 12 Pro absolutely is good and great enough.

Re:Understanding ProRAW by matwood on Wednesday December 16, 2020 @06:19AM (#25441317)
I keep trying to leave my DSLR at home, but instead am looking at upgrading my Nikon. I love the iPhone and what it can do, and think flagship phones are the best snapshot cameras there have ever been.

But, my Nikon with my 50mm just takes noticeably better pictures in so many situations, particularly portraits. And if I expand my lens usage to my wide angle or my 300mm now we’re into types of pictures phones are completely incapable of taking.

Re:Understanding ProRAW by AuryGlenz on Wednesday December 16, 2020 @02:06AM (#25439884)
This is going to sound unintentionally confrontational but I’ll put up one of my DSLR portrait shots against your phone shots any day.

Good enough? Maybe. Better than a much larger sensor and better lens? No way.

Re:Understanding ProRAW by vmception on Wednesday December 16, 2020 @02:39AM (#25440048)
And what do you use those photos for?

I’m only going to sound realistic

Re:Understanding ProRAW by AuryGlenz on Wednesday December 16, 2020 @12:42PM (#25445598)
I’m a professional photographer, so...

Even if I wasn’t, I love large prints and we always have some up in our house. Cell phone pictures are fine if you’re looking at them on your phone - not so much at 20x30”.

Re:Understanding ProRAW by formerly_proven on Wednesday December 16, 2020 @04:21AM (#25440526)
> The iPhone 12 Pro is better than EVIL & DSLR cameras

goalshifted into "it is ok enough for this single type of photo + light".

Re:Understanding ProRAW by vmception on Wednesday December 16, 2020 @10:23AM (#25443611)
A daguerreotype was probably superior processing technology than film with paper but it wasn’t convenient or superior enough to remain an option.

That's where we are today, and that's what "better" colloquially means.

Re:Understanding ProRAW by latenightcoding on Wednesday December 16, 2020 @02:27AM (#25439977)
knowing that you only do portraits makes me disagree with you even more, no way your iphone can come close to a portrait shot with an 85mm or 135mm lens. Also the bokeh effect on iphones looks super unnatural
Re:Understanding ProRAW by sudosysgen on Wednesday December 16, 2020 @02:01AM (#25439859)
Well, if you take one single kind of image that the software is optimized to almost fake, yes you can get close. But you'll never get to the level of, say, an a7iii+85mm1.4 even for portraits, even in good light.

In any case, good enough and better are two very different words. I really enjoy taking pictures on an ILC much more and the results I get are noticeably better even in portraits, including by people that don't know what I took it with. For example, good luck emulating the look of a 135mm f/2.8 (at night) with an iPhone if we're talking about portraits, or good luck doing better than a 50mm 1.4 for street, good luck doing better than a 70-200 2.8, and so on.

But yes, it has a much lower skill ceiling and often more consistent results, and it really does get close.

Re:Understanding ProRAW by vmception on Wednesday December 16, 2020 @02:41AM (#25440055)
I enjoy the a-series but that’s exactly what I’m moving on from

I think I’ll get a gimbal and some contraption to trigger flash and maybe some adapter lenses as they trickle out for this form factor

Yes, the consistency in such a wide range of lighting situations is what’s attractive. Along with the built in non-destructive editing. Soon, ProRAW for even more of that. Live Photos by default which “captures the moment” more than the composition itself, and a software and syncing pipeline that supports that seamlessly. With the nearest replacement being an entire tool-belt and bags of gear.

I think at this point we will see the market choose, and often times I ahead of the accepted trend on that. A daguerreotype was probably superior processing technology than film and paper but it wasn’t convenient enough to remain an option. Same went for film and dedicated digital cameras. I think this is where we are now with the iphone 12 pro and ProRAW, even for photo enthusiasts.

Re:Understanding ProRAW by sudosysgen on Wednesday December 16, 2020 @11:25AM (#25444433)
Well, to boot, no, film and paper were far way easier and more powerful to process than daguerréotype, and digital is also way more powerful to process than film. That being said, I do think you lose out on a lot of convenience with an iPhone as your sole camera.

To start, you can actually crop. You can use lenses with a higher focal length than 70mm, which for many people makes all the difference in portraits. If you're using something like ProRAW, you're limited to 1/3 of an FPS vs 20FPS.

If you want to capture the moment on an ILC, you can also just hold the shutter. This would be the very first time we go from a platform that has higher image quality and more editing lattitude to a technology that has less of it. The replacement isn't an entire tool belt and bags of gear, for me it's an A7ii and a 28-75 2.8 (for a total cost lower than the iPhone 12 Pro + my current phone and will outlive it by four or five times).

As for sales, the iPhone has already gobbled up everything except the high end camera market, which is actually seeing increasing sales, so we'll see about that. I don't find it all that probable.

As for ProRAW, it's technically completely inferior to, say, an ARW file.

Re:Understanding ProRAW by geerlingguy on Tuesday December 15, 2020 @11:57PM (#25439244)
You can go past 100mm (35mm equivalent), but the quality really turns to mud even with the best adapted lenses!