News for hackers. Stuff that matters.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by andrewmcwatters on Tuesday January 30, 2024 @02:55PM (#39194833)
They can already do this with the desktop composition software they use today. All the windows are virtualized onto backing layers that you can draw anywhere and add effects to. It’s how window shadows work, and how certain window effects are done.

They just haven’t done it.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by brookst on Tuesday January 30, 2024 @04:49PM (#39196347)
Yes?

The first iphone didn’t have copy/paste.

Apple will always prioritize critical scenarios over nice to have. None of these things are technically difficult, it’s just time. I’m willing to believe they released too early, but at some point you have to start learning from real users.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by cududa on Tuesday January 30, 2024 @03:32PM (#39195361)
I'm aware. I've worked in the space. It isn't as simple as you're making it out.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by AshamedCaptain on Tuesday January 30, 2024 @04:05PM (#39195806)
Sorry but almost 10 years ago I could do this on Xorg where the worst problem is that compositors cannot redirect input (so you had to kludge new events from scratch). I cannot imagine it would take more than _half an hour_ for someone with macOS display compositor experience to implement it.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by glhaynes on Tuesday January 30, 2024 @04:55PM (#39196418)
I cannot imagine it would take more than _half an hour_ for someone with macOS display compositor experience to implement it.

What fools Apple engineering management must be, then!

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by andrewmcwatters on Tuesday January 30, 2024 @07:11PM (#39197909)
It probably actually is a quick initial implementation, but like everything else, it needs to be planned, ticketed, developed, tested, and slated for release.

Compositor work isn't tremendously hard when the graphics primitives are already done.

UI state handling and input is a majority of the work from there. I've implemented this work before. A large portion of my background is in compositors and UI primitives.

What's really cool about having window backing layer handles, is you can do all sorts of crazy fun stuff in the office and show off to your coworkers or tech demo that basically will never make it to production because it's totally impractical.

The best example of that which actually did end up in a final product in my opinion was Windows Flip 3D. Totally fun implementation, I'm sure.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by wharvle on Tuesday January 30, 2024 @04:20PM (#39196017)
I doubt making the windows draw is what’s taking them time to get right.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by refulgentis on Tuesday January 30, 2024 @04:08PM (#39195858)
You nailed it, down to how you'd do it without any help from Cupertino: https://github.com/saagarjha/Ensemble
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by kj99 on Tuesday January 30, 2024 @05:05PM (#39196529)
Except that doesn’t actually do it. It is just a proof of concept.

Try it with a full suite of Mac Apps and you’ll find it falls apart because they aren’t all well behaved.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by AshamedCaptain on Wednesday January 31, 2024 @04:55PM (#39209946)
It falls apart how exactly? There's some app for which the popup menus are not shown at the right coordinates?

You are making this sound much more complicated than it really is.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by kj99 on Wednesday January 31, 2024 @07:35PM (#39211526)
Amongst many possible edge cases. Not to mention shearing with things that have rapid animations etc.

The trivial case is simple. You are imagining it's all the trivial case.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by AshamedCaptain on Wednesday January 31, 2024 @09:44PM (#39212246)
But they have already fixed shearing, otherwise there would be no MacBook display mirroring feature at all, multiple surfaces or not.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by kj99 on Thursday February 01, 2024 @08:15AM (#39215589)
I’m talking about this open source project, not Apple’s implementation.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by sleepybrett on Tuesday January 30, 2024 @04:29PM (#39196108)
It's probably more down to the getting the UI right on apple's end.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by saagarjha on Wednesday January 31, 2024 @03:27AM (#39201395)
Unfortunately I happen to live in Cupertino
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by kj99 on Tuesday January 30, 2024 @05:04PM (#39196514)
And the reason Xorg is now dying in favor of a system that doesn’t have this capability is because the architecture that enabled it, while cool at the time, severely limited the graphics performance and capability of the applications.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by ubercow13 on Tuesday January 30, 2024 @05:44PM (#39196982)
What? Doesn't Wayland work this way by design?
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by kj99 on Tuesday January 30, 2024 @09:29PM (#39199020)
Indeed it does not. It’s local only.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by ori_b on Wednesday January 31, 2024 @06:53AM (#39202713)
I see. Do you mean like the Xorg fast path for local 3d rendering that became the basis for Wayland?
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by kj99 on Wednesday January 31, 2024 @11:30AM (#39205746)
Exactly that. A local only path that provides high performance.

Remember the original comment was the claim that Xorg could easily do remote windows years ago. This is only true using the low performance path that modern operating systems have universally rejected.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by AshamedCaptain on Wednesday January 31, 2024 @04:53PM (#39209923)
No, the original comment is that by writing an Xorg compositor I could project separate windows into separate surfaces at arbitrary positions in the 3D world. There's no need for network transparency and you can very well do with an HDMI cable (actually, I was using an HDMI cable -- this was 10 years ago).
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by kj99 on Wednesday January 31, 2024 @07:38PM (#39211539)
Network transparency is exactly what people want. If you're going to say just tether it to your computer with a wire then you just aren't understanding the product.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by AshamedCaptain on Wednesday January 31, 2024 @09:41PM (#39212233)
Network transparency is not required for wireless video, either.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by rokkitmensch on Tuesday January 30, 2024 @09:49PM (#39199164)
Don't be letting actual experience get in the way of shitting on Xorg, now! Wayland will never win with that attitude!
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by refulgentis on Tuesday January 30, 2024 @04:03PM (#39195777)
Yes, it is.

In fact, there's already a project for it on GitHub. https://github.com/saagarjha/Ensemble

480 lines total, including comments, headers, whole shebang.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by chaos_emergent on Tuesday January 30, 2024 @04:25PM (#39196069)
> Ensemble is currently "pre-alpha": it's really more of a demo at this point. There's a lot of things I need to work on and until then it is unlikely I will be taking any code contributions.... The code is definitely not designed for general-purpose use yet, so don't expect much of it :)
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by threeseed on Tuesday January 30, 2024 @05:06PM (#39196537)
Tech demos are often easy to put together.

It's all of the edge cases and UX refinements that takes time.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by refulgentis on Tuesday January 30, 2024 @05:34PM (#39196851)
Yeah, sure. I'm gonna go ahead and say Apple probably could have found a way to ship this over the visionOS dev cycle.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by saagarjha on Wednesday January 31, 2024 @03:29AM (#39201410)
Some of the code is factored out into individual libraries. For example the networking and serialization code is separate and it is likely that screen recording will get pulled out too at some point.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by ncr100 on Tuesday January 30, 2024 @03:09PM (#39195041)
So Apple could have done this, but did not. Why? (Speculation and leaks welcome)

- [Profit on basic innovation] Did they want to wait and see how their customers would adopt VisionOS's native free-floating windows, so as to avoid cognitive overload by commingling with MacOS windows?

- [Benevolence to fellow competitors] Did they not want to takeover the existing market of virtualized VR desktops?

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by realslimjd on Tuesday January 30, 2024 @04:01PM (#39195763)
I'm reasonably certain it's a combination bandwidth and tech issue.

The Vision Pro is effectively using AirPlay to mirror the whole screen. If you used AirPlay to mirror each window as a whole screen, you'd run out of bandwidth pretty quickly.

The windowing system in MacOS, Quartz Compositor, also isn't built to stream window information. Right now it has a big built in assumption that any windows its displaying are on a screen it also controls. It was probably too big a lift across teams to also re-write the graphics stack for MacOS for the launch of the Vision Pro. Hopefully they get it working in the future, but neither of these problems are easy to solve.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by ncr100 on Monday February 12, 2024 @02:35AM (#39342452)
Makes a lot of sense, future will solve it someday.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by theultdev on Tuesday January 30, 2024 @03:16PM (#39195150)
Most likely because it wasn't polished, so get it out now in a polished and limited state and now you have a fancy update to tout when it is done.
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by gorkish on Tuesday January 30, 2024 @05:01PM (#39196486)
> They just haven’t done it.

Literally nobody has done it. It's beyond ridiculous that you can't already show or duplicate an application window on any display you want and allow it to be controlled from anywhere it is visible.

Searching for ways to do this lead one into extremely niche software ecosystems. Please is there any collaboration app out there that makes it seamless to toss windows around like everyone actually wants?

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by jandrese on Tuesday January 30, 2024 @05:23PM (#39196735)
Isn't this how ordinary spanning monitors works? It might be slightly awkward with AR goggles since the relative orientation of the displays will be constantly changing as your head moves, and what happens to a window you have half on and half off of the Macbook's screen when you look away? Or do you want to have the application jump between devices, like appearing on your fridge when you go for a drink? With the old X11 protocol and a daemon in the middle this was possible but the use cases were extremely limited and the security issues made it a pain in the ass to actually use. With distros moving away from X11 this is only going to get harder, and you have to ask yourself how much you really want it.

This would mean the goggles would be basically just a dumb display for the Mac. It would also be weird to try to move an AR app onto your Mac.

Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by joshspankit on Tuesday January 30, 2024 @05:14PM (#39196630)
I feel like multiple people did it back in the original X11 days, and almost certainly when compiz was the new hotness
Re:Apple Vision Pro Review: The Best Headset yet Is Just a G... by jonhohle on Wednesday January 31, 2024 @10:14AM (#39204745)
Nearly 20 years ago there was an OS X screensaver that would capture all the window buffers and then float them around the screen as they rotated various ways. Another app would save a snapshot of all windows as Photoshop layers with appropriate transparency (before blur was added). X11 was always network transparent, though I don’t think windows could easily be moved from one client to another.

Even classic Mac OS, which wasn’t designed to be “rootless” could be run that way could have its windows mixed with OS X windows in the classic days.

As others have pointed out, there is already a PoC app that is doing it, so it seems if Apple wants to, it’s completely in their power. However, does this match their vision? (pun intended) Time will tell.