News for hackers. Stuff that matters.
Re:Developer tools to create spatial experiences for Apple V... by jedberg on Wednesday June 21, 2023 @05:09PM (#36424565)
I'm not skilled enough to do it myself, but I can't wait for the AR apps to help with physical skills, especially things like art.

I do ceramics on the wheel, and having an app that can show me techniques, highlight areas that are thin or weak, critique my technique in real time, and so on, would be something I would definitely pay for.

Same with painting.

I can't wait to see the AR apps!

Re:Developer tools to create spatial experiences for Apple V... by chasd00 on Wednesday June 21, 2023 @05:29PM (#36424872)
cooking too, it would be really neat if you can incorporate other sensors. like a little avatar telling you the pan is too hot/cold. I can def. see things like a floating recipe while you do messy prep so you don't have to wash/dry your phone to scroll to the next step.
Re:Developer tools to create spatial experiences for Apple V... by thebricklayr on Wednesday June 21, 2023 @06:13PM (#36425416)
A temperature indicator is such a good idea. I’m going to add this to Umami.
Re:Developer tools to create spatial experiences for Apple V... by mjsweet on Wednesday June 21, 2023 @09:58PM (#36427150)
I was thinking that you could pin timers above each pot as well as other timers around the kitchen.
Re:Developer tools to create spatial experiences for Apple V... by eastbound on Thursday June 22, 2023 @04:57PM (#36438869)
Piloting planes! A Cessna usually is 50+ years old (since regulations apply for newer planes), instruments are awfully analog, and a good share of crashes happens by fly-into-IFR. Get a helmet: You’ll still get the analog instruments + warnings if they go outside range + 3D navigation map + horizon + a circle around far-away planes that might fly towards you (TCAS) + weather map. All of these are today routine causes for accidents. All that in the $3500 helmet that you also use for work. Plus you can look at your feet and see the terrain.

Could even put dinosaurs in there.

Re:Developer tools to create spatial experiences for Apple V... by astrange on Wednesday June 21, 2023 @05:25PM (#36424824)
Both of those things seem like they have a chance of splattering on the cameras.
Re:Developer tools to create spatial experiences for Apple V... by jedberg on Wednesday June 21, 2023 @05:26PM (#36424843)
I'm sure there will be a thriving ecosystem of protective accessories.
Re:Developer tools to create spatial experiences for Apple V... by astrange on Wednesday June 21, 2023 @05:35PM (#36424963)
Eh, I just mean it's hard to do AR if you're getting paint on the AR camera. I guess you could just keep swapping protective covers.

Although it might not matter - even cracks on a camera lens affect the picture less than you'd think, because they're out of focus.

Re:Developer tools to create spatial experiences for Apple V... by jedberg on Wednesday June 21, 2023 @05:44PM (#36425074)
Or just wipe it off.
Re:Developer tools to create spatial experiences for Apple V... by notbeuller on Wednesday June 21, 2023 @07:38PM (#36426274)
I saw a video of some sort of motocross meet (not familiar with it) and apparently the visors become completely covered with mud, so riders start the race with several clear plastic strips on the visor and they tear one layer off off as needed. (A comment was made that motocross meets are littered with the debris). Probably wouldn’t need to be so dramatic here.

As an alternative - would a headset lite version without the AR work better here? Display needed information on a nearby tablet or large tv while the user wears a headband only.

Re:Developer tools to create spatial experiences for Apple V... by SirSourdough on Wednesday June 21, 2023 @09:07PM (#36426879)
This is also done in auto racing, particularly endurance racing where you might pick up 4+ hours of bugs and debris on the windshield over a driver stint.

The windshield has a stack of huge stickers on it that get torn away by the pit crew during stops. Apparently you can get stacks up to about 20 layers.

Seems like a reasonable possibility for messy AR applications.

Re:Developer tools to create spatial experiences for Apple V... by taeric on Thursday June 22, 2023 @02:02AM (#36428489)
Of course, you have the "pit crew" do this for a reason. Whatever is getting those dirty is likely getting the driver/operator dirty, as well...
Re:Developer tools to create spatial experiences for Apple V... by astrange on Wednesday June 21, 2023 @09:21PM (#36426968)
I assume some of the things you'd want to wipe off need cleaning agents that would also remove the anti-fingerprint coating. Which I'm assuming exists.
Re:Developer tools to create spatial experiences for Apple V... by prawn on Wednesday June 21, 2023 @09:46PM (#36427089)
I watched a video compilation of VR headset mishaps (running into walls, hitting things, etc) and I think that most Vision Pro users will be a lot more reserved in their use. Apple's promotional collateral showed fairly static use cases: couch, standing near a desk, etc.

I'm keen on trying it or getting one, but I have zero interest in using it while cooking or similar.

Re:Developer tools to create spatial experiences for Apple V... by dylan604 on Wednesday June 21, 2023 @05:14PM (#36424644)
Do you have to tell it the style? Like if you're trying to do a portrait, but it's in Picasso mode vs Michelangelo mode, does your portrait have a funky face
Re:Developer tools to create spatial experiences for Apple V... by jedberg on Wednesday June 21, 2023 @05:25PM (#36424822)
Lol that would be an awesome feature!
Re:Developer tools to create spatial experiences for Apple V... by greggh on Thursday June 22, 2023 @01:04AM (#36428180)
Vermillion is the best app in this space I think. I get to paint with oil paints, and have nothing to clean up and no major expenses like buying more paint.

And with a browser in place, I can watch painting tutorials while actually painting, and not worry that I dont own a specific brush or other tool.

It's awesome. It's on Steam for anything that supports SteamVR or PCVR, and on the Quest store for Meta devices.

https://vermillion-vr.com

Re:Developer tools to create spatial experiences for Apple V... by zmmmmm on Thursday June 22, 2023 @01:33AM (#36428335)
If you really can't wait, just go out and buy a Quest for 1/7th the price and start doing it today. It's a rounding error on what you will pay for Vision Pro and you can get an idea early of what it will be like.

(I probably would recommend waiting for Quest 3 in a couple of months though ... it'll be so much more like the Vision Pro ...)

Re:Developer tools to create spatial experiences for Apple V... by jedberg on Thursday June 22, 2023 @01:54AM (#36428446)
I already have two quests. But the AR is terrible. The external cameras suck.
Re:Developer tools to create spatial experiences for Apple V... by zmmmmm on Thursday June 22, 2023 @02:02AM (#36428490)
I assume neither of them was a Quest 3 though ...
Re:Developer tools to create spatial experiences for Apple V... by dagmx on Thursday June 22, 2023 @01:56AM (#36428453)
Quest 2 and Quest Pro passthrough is terrible.

The Quest 3 may be better but literally everything they asked for requires good passthrough.

That 1/7th the price would be sunk money if they’re trying to evaluate real world interaction.

Re:Developer tools to create spatial experiences for Apple V... by zmmmmm on Thursday June 22, 2023 @02:01AM (#36428486)
yes ... but they "can't wait". If they want it that badly then such a tiny cost would be easily tolerable to get it earlier. Quest 3 pass through is awesome by all counts from the people who have tried it.
Re:Developer tools to create spatial experiences for Apple V... by dagmx on Thursday June 22, 2023 @02:42AM (#36428726)
Where are these impressions that you’re talking about? I haven’t seen anyone legitimate talk about using it.
Re:Developer tools to create spatial experiences for Apple V... by zmmmmm on Thursday June 22, 2023 @03:43AM (#36429127)
Lex Friedman is one who used it:

https://youtu.be/7KCez6Ocxxg?t=40

So did Marc Gurman:

https://www.bloomberg.com/news/newsletters/2023-05-28/meta-q...

> video pass-through on the Quest 3 presented colors more accurately and offered an almost lifelike rendering of the real world. I was even able to use my phone while wearing the headset, something that often feels impossible on a Quest 2

It will certainly be fascinating to see how good it really is.

Re:Developer tools to create spatial experiences for Apple V... by 76SlashDolphin on Thursday June 22, 2023 @06:04AM (#36429951)
What's wrong with the Quest Pro passthrough? It's been a while since I last tried it but I remember being very impressed with the latency and fidelity of it. That's not to say it was a great experience, the software was really unstable but I was very impressed with what it could do.
Re:Developer tools to create spatial experiences for Apple V... by zmmmmm on Friday June 23, 2023 @12:40AM (#36442847)
it's sort of both great and terrible

honestly, for it's primary purpose it's great. That is, you get complete situational awareness, you can see people and talk to them, pick up your coffee and drink from it all just fine.

But the actual quality is super dependent on the environment. In poor lighting it completely goes to hell, turning into pixelated goo, and the frame rate drops to the point you can physically see it. It also experiences distortions, so around the edges of objects you get major waviness that changes as you move which can be very distracting.

This is why you'll hear completely contradictory reports of it from different people. If you happened to use it in a really well lit environment with nice uniform lighting you probably would have thought it was really good.