News for hackers. Stuff that matters.
Re:Apple Depth Pro: Sharp Monocular Metric Depth in Less Tha... by jonas21 on Friday October 04, 2024 @01:44PM (#41743735)
> The way to judge the quality of a depth map is to use it to reproject the image into 3D and rotate it around a bit.

They do this. See figure 4 in the paper. Are the results cherry-picked to look good? Probably. But so is everything else.

Re:Apple Depth Pro: Sharp Monocular Metric Depth in Less Tha... by threeseed on Friday October 04, 2024 @02:33PM (#41744246)
> Figure 4

We plug depth maps produced by Depth Pro, Marigold, Depth Anything v2, and Metric3D v2 into a recent publicly available novel view synthesis system.

We demonstrate results on images from AM-2k. Depth Pro produces sharper and more accurate depth maps, yielding cleaner synthesized views. Depth Anything v2 and Metric3D v2 suffer from misalignment between the input images and estimated depth maps, resulting in foreground pixels bleeding into the background.

Marigold is considerably slower than Depth Pro and produces less accurate boundaries, yielding artifacts in synthesized images.