News for hackers. Stuff that matters.
Re:Project Starline: Feel like you're there, together by bullfightonmars on Tuesday May 18, 2021 @04:32PM (#27200651)
If this was a consumer product I would buy two of these today, one for myself, and one for my parents. It is more compelling that any product I have seen for a long time.
Re:Project Starline: Feel like you're there, together by codeecan on Tuesday May 18, 2021 @06:53PM (#27202312)
Re:Project Starline: Feel like you're there, together by chewxy on Tuesday May 18, 2021 @07:52PM (#27202854)
This is a 3D monitor. Not a light field display like Starline.

The traditional glasses free 3d monitors rely on special coatings on the glass to "split" the direction of a pixel. Some coatings are electronically controlled (like Sony's), some are physical (lenticular filters) It still displays a 2D projection of a 3D image, but twice.

By contrast, my understanding is lightfield displays projects the entire volume. So you don't have a pixel, you have a voxel. So each eye gets a different bit of the same voxel

Re:Project Starline: Feel like you're there, together by mhalle on Wednesday May 19, 2021 @11:22AM (#27209962)
The term light field display includes lenticulars and parallax barrier displays (and holograms and volumetric displays). They are all different ways of carving up, sweeping out, or multiplexing a light field.
Re:Project Starline: Feel like you're there, together by ipsum2 on Tuesday May 18, 2021 @04:52PM (#27200924)
How much would you pay? I expect the lower end to be around $20,000 from hardware alone, plus at least gigabit down/up connectivity.
Re:Project Starline: Feel like you're there, together by signal11 on Tuesday May 18, 2021 @05:09PM (#27201178)
I suspect eventually this will percolate down, somewhat like Facebook's Portal TV (£149) but possibly also integrated with something like a Google Assistant/Siri type smart device to power the software and do other smart-home type things in your home.

Many ordinary folk already have 4k TVs at home and 8k will probably become commonplace in the future. The real bottleneck will be good low-latency broadband both up and down, but fibre to the home should make that easier. I wonder if ISPs in the future will offer QoS guarantees to enable really good videoconferencing?

I mean, Zoom, Meet et al are much better than video conferencing solutions like Webex even from a few years ago, but it's hilarious how much drama there still is around video calls. "oh, sorry, I didn't realise I had muted myself", "can you hear me...?", "I think we just lost Steve", and so on. I'll be glad to see all of that just go away.

Re:Project Starline: Feel like you're there, together by eps on Tuesday May 18, 2021 @05:52PM (#27201726)
Facebook Telescreen™
Re:Project Starline: Feel like you're there, together by kbenson on Tuesday May 18, 2021 @06:35PM (#27202161)
To be followed up by Facebook Telepresence™ and then Facebook Omnipresence™? ;)
Re:Project Starline: Feel like you're there, together by dane-pgp on Tuesday May 18, 2021 @07:19PM (#27202571)
Mark Zuckerberg might announce that, but I think he'll go straight from Facebook Telescreen™ to Facebook Panopticon™.
Re:Project Starline: Feel like you're there, together by throwaway3699 on Tuesday May 18, 2021 @04:57PM (#27201002)
I doubt you need gigabit for an 8K stream. The real issue is the abysmal common network infrastructure. Latency will be a bottleneck if most ISPs don't care about treating your packets properly.
Re:Project Starline: Feel like you're there, together by perttir on Wednesday May 19, 2021 @03:38AM (#27205683)
Most internet providers here in Finland provides you fiber connections from 100-1000mbs pretty cheap. And 4g/5g connections from 100-300mbs for cheap prices too. Most of them does not have any data caps.

I have 300/100mbs connection which costs 20 euros in month.

Re:Project Starline: Feel like you're there, together by cogman10 on Tuesday May 18, 2021 @05:30PM (#27201465)
Agreed, 10Mbps is likely where it'll be, probably less. If I were to guess, they are going to apply a lot of smarts to texture mapping to avoid needing a lot of bandwidth.
Re:Project Starline: Feel like you're there, together by kbenson on Tuesday May 18, 2021 @06:47PM (#27202267)
Doubtful, IMO. The fact that you need it to be both extremely low latency and with essentially zero compression artifacts (probably lossless, based on their goal). If the numbers listed here[1] are correct, then the most efficient lossy codec at that time was doing 100 minutes of 8k video in ~37GB of data. From that we can intuit that it was using an average of 50 Mbps for that 100 minutes of video. For the most efficient codec, and I'm not even sure from that whether it was using lossy or lossless numbers, because apparently HVEC can do both (but I would assume lossy, since it's about streaming video in that case).

You can't do weird texture mapping or lossy compression and expect people to really seem like they are there. Even if you don't notice that stuff normally watching a video, I think you'll notice it when you're interacting like someone is really in front of you, and that will throw off the immersion.

1: https://www.quora.com/In-regards-to-filesize-how-big-is-1-mi...

Re:Project Starline: Feel like you're there, together by cogman10 on Tuesday May 18, 2021 @07:06PM (#27202445)
HVEC is no longer king of the hill when it comes to compression efficiency. AV1 and the upcoming VVC do better.

That said, my intuition is they aren't doing a pure video encoding solution. The fact that they talk about 3d modeling leads me to believe they are doing a combination of model + texture to get the realistic results. That would significantly decrease the amount of bandwidth and computational power needed. Over a low bandwidth situation you'd simply need to send model updates and do some smart interpolation to determine what things should look like.

Similar to the concept that playing a 3d game requires MB of resources but recording the same game at 8k would require a boatload more memory.

My assumption is they are using LIDAR to get a good model, high quality cameras to texture things, and a nice AI to stitch things together and interpolate when data isn't arriving fast enough.

Re:Project Starline: Feel like you're there, together by scoopertrooper on Tuesday May 18, 2021 @07:38PM (#27202733)
Re:Project Starline: Feel like you're there, together by mensetmanusman on Tuesday May 18, 2021 @08:12PM (#27203011)
I think this is what will be done in the future. You will interact with the camera for 15 minutes or so and it will create a custom compreasion algorithm for you.
Re:Project Starline: Feel like you're there, together by Aeolun on Tuesday May 18, 2021 @07:18PM (#27202565)
That seems unlikely. My game stream in 1080p at 60fps already takes 40Mbps. So 4K at 30fps would need more like 80Mbps, and 8K 320Mbps
Re:Project Starline: Feel like you're there, together by fomine3 on Tuesday May 18, 2021 @08:14PM (#27203029)
It heavily depends on what encoder and config you use. In my experience, 20Mbps (or less) HEVC by Turing NVEnc realtime encoder is enough for 1080 60p. Also halving frame rate won't halve bitrate because of how video compressed by reference frame. Also video meeting won't move pictures as much as FPS gaming.
Re:Project Starline: Feel like you're there, together by IshKebab on Tuesday May 18, 2021 @06:04PM (#27201888)
You can't even do basic video calling on a 10 Mbps connection. You definitely need the reliability and low latency of fibre for this.
Re:Project Starline: Feel like you're there, together by true_religion on Tuesday May 18, 2021 @08:45PM (#27203250)
Max I'd pay would be $6,000 because I'd need to buy two: one for me, and one for my parents. If it were $3000, I'd have already bought it.

$20,000 is a bit out of the reach of most people, and reserves this for business use or desperate need.

I could see a bunch of execs getting this installed in their home offices as a company perk, and then using it for personal reasons too.

Re:Project Starline: Feel like you're there, together by benhurmarcel on Wednesday May 19, 2021 @04:54AM (#27206101)
> reserves this for business use

Even for business use a price with 5 digits would make it confined to a few executive offices.

Re:Project Starline: Feel like you're there, together by ghaff on Tuesday May 18, 2021 @09:38PM (#27203588)
A lot of execs don’t have optimal setups with current tech. A lot of people just don’t care.
Re:Project Starline: Feel like you're there, together by bullfightonmars on Tuesday May 18, 2021 @08:17PM (#27203047)
Well that wouldn't be a consumer product then. But I would pay as much as a high end tv. 2500? Maybe more? The experience looks to be transformative.
Re:Project Starline: Feel like you're there, together by fnord77 on Tuesday May 18, 2021 @06:14PM (#27201977)
probably built into smartphones in 10 years.
Re:Project Starline: Feel like you're there, together by cocoggu on Tuesday May 18, 2021 @07:09PM (#27202482)
I think one of the major aspects of this technology is that the person you are talking with appears in its real size, with the same ratio than in real life. Something you cannot do with a smartphone, except if you are referring to a projector.
Re:Project Starline: Feel like you're there, together by paxys on Tuesday May 18, 2021 @04:35PM (#27200683)
I imagine it isn't (yet) because of the price tag.
Re:Project Starline: Feel like you're there, together by bostonvaulter2 on Tuesday May 18, 2021 @04:40PM (#27200764)
And it would probably be very difficult to install at the moment as well.
Re:Project Starline: Feel like you're there, together by CountHackulus on Wednesday May 19, 2021 @11:24AM (#27209985)
I've used the Echo Show 10 with the drop-in feature for my mom with vision issues (basically can't use touchscreens) and it works fairly well. That said I fully agree with you that something like this would be really excellent. A full-sized person's face and head in 3D is far easier to recognize and understand than a poorly lit 2D 10" display.