Re:Show HN: Spatially aware group video calls from the browser
by smoo on Saturday April 11, 2020 @12:37AM
(#22839663)
Made this to try and simulate real world interactions - normally I found on large video calls, only one person gets to speak. With this you can dip in and out of conversations with groups of people just by moving your avatar towards or away from them!
It also uses modern web technologies and does not even need a login, just show it your face and it will try and use emojis to tell people what you're doing even if you're not in a call with them
A 3d version of this concept is well executed by Mozilla Hubs, but the lack of echo cancellation makes headphones a necessity when using Hubs which is a downside.
Re:Show HN: Spatially aware group video calls from the browser
by gfodor on Sunday April 12, 2020 @08:11PM
(#22852009)
Echo cancellation works in Firefox, we are landing a fix for chrome this week. It turned out to be quite involved to do spatialized audio and echo cancellation:
Re:Show HN: Spatially aware group video calls from the browser
by fortran77 on Sunday April 12, 2020 @06:43PM
(#22851550)
A lot of this can be solved with push-to-talk, like what Virtual Airwaves is doing. They simulate radio in that the closer you are to someone, the "stronger" the signal is. (Take a look at their patents). https://virtualairwaves.com/ or try it at https://cb.virtualairwaves.com/ There are usually conversations on Channel 1 each evening, UK timezone.
Re:Show HN: Spatially aware group video calls from the browser
by smoo on Sunday April 12, 2020 @03:22PM
(#22850443)
It uses your face to make the little avatar to show to people as you move around the map! (as well as to animate the little emoji that follows you around!)
I honestly don't know if a show-your-face policy is the best to prevent people being mean to each other online - I'd love to hear your thoughts! You can read my code though, nothing gets saved anywhere and the video calling functionality is all peer-to-peer!
Re:Show HN: Spatially aware group video calls from the browser
by jtvjan on Sunday April 12, 2020 @05:03PM
(#22851020)
If you don't want to show your face, you can use the parameters "--use-fake-device-for-media-stream --use-file-for-fake-video-capture=/path/to/y4m_or_mjpeg" on Chromium. You can get y4ms from xiph.org[1].
Re:Show HN: Spatially aware group video calls from the browser
by ghostpepper on Sunday April 12, 2020 @03:25PM
(#22850460)
The fact that if I hadn't used a physical barrier then my face would have been immediately fed into a detection algorithm without any explanation or warning.
I get that it's just a tech demo but a small disclaimer about what will be done with the data before requesting the permission would go a long way.
Re:Show HN: Spatially aware group video calls from the browser
by ghostpepper on Sunday April 12, 2020 @03:34PM
(#22850507)
Yeah it doesn't need to be long (short is actually better as more chance of people reading it through)
1. The app requests permission to view your camera
2. Your video stream is displayed and a local js script will run facial recognition (not against a database, just a binary "is this a face") and only then will it allow you to join the chat.
3. When you join the chat, your video and audio will be transmitted but will not be stored.
some people likely won't even read it and just click anyway, but for the curious and/or paranoid it will definitely be reassuring.
Re:Show HN: Spatially aware group video calls from the browser
by contravariant on Sunday April 12, 2020 @08:46PM
(#22852143)
Maybe, but it makes it impossible for me to test it at the moment as my webcam doesn't capture enough light to get the face detection working apparently.
Re:Show HN: Spatially aware group video calls from the browser
by ambicapter on Sunday April 12, 2020 @04:34PM
(#22850846)
Firefox asked me for permission to use my video camera, so unless that didn't happen for you not sure why you would be surprised that its using your camera feed.
Re:Show HN: Spatially aware group video calls from the browser
by tempestn on Sunday April 12, 2020 @04:18PM
(#22850746)
Love the idea, but the other party couldn't hear me even though my mic was working, and the video seemed to be stacked in a strange way where my own camera was generally half off the screen. Tried both Firefox and Chrome. Would certainly love this or something like this for virtual social gatherings though!
Re:Show HN: Spatially aware group video calls from the browser
by throwaway15392 on Sunday April 12, 2020 @02:44PM
(#22850204)
That’s so cool. You could add background chatter too if you haven’t already, you’d just have to amplify the local conversation the user wants to tune into
Edit: by background chatter I mean the noise from all the other conversations happening in the moment nearby
Re:Show HN: Spatially aware group video calls from the browser
by zhoujianfu on Sunday April 12, 2020 @05:40PM
(#22851196)
Very nice! I had exactly this idea a couple weeks ago when on a 25+ person “zoom party”. We needed a way to break into little groups. This is a cool way to do it, obviously with little improvements. I think requiring a face is good too! You could have not map in the background too, it’s not really necessary, just the radar is fine!
Re:Show HN: Spatially aware group video calls from the browser
by shireboy on Sunday April 12, 2020 @08:51PM
(#22852168)
This is a really cool idea I've been thinking about as well. Schools/churches/clubs/etc. looking for an online equivalent to informal meeting spaces need something like this. Zoom/Hangouts/etc. break down with lots of people. The map is creative, but another metaphor I've thought of was just tables. Show a handful of tables in a room, maybe with avatars on them? I also had an issue where I couldn't easily pick which camera to use.
Re:Show HN: Spatially aware group video calls from the browser
by smoo on Sunday April 12, 2020 @03:10PM
(#22850379)
Thanks! I've only added in a map for London at the moment but will be sure to add different places soon! I've actually also made it open source too at https://github.com/souramoo/party - it uses standard ecmascript and webpack for the client, nodejs for the backend hosted on heroku and webrtc peer-to-peer for video :)
Re:Show HN: Spatially aware group video calls from the browser
by polymorpher on Sunday April 12, 2020 @08:23PM
(#22852064)
Would be nice if we can host a meeting and pre-select the locations in the background. I think this can be an excellent solution for virtual meetups during the pandemic - much better than Zoom or chat rooms.
Re:Show HN: Spatially aware group video calls from the browser
by antoncohen on Sunday April 12, 2020 @03:07PM
(#22850363)
I agree. Even after approving the camera and mic, the way it was presented makes it seem like the camera is only going to be used for controlling the emoji. But that isn't the case, the camera video is shown to other people.
I feel like there shouldn't be a #public room. It is basically Chatroulette.
You can turn your camera off once you're in a room too - I actually made this to try and host my birthday party next month where it would be nice to see everyone :)
Re:Show HN: Spatially aware group video calls from the browser
by antoncohen on Sunday April 12, 2020 @03:29PM
(#22850480)
I think the idea is really great for private parties. Zoom and similar conferencing systems don't work well because either everyone is the same volume and it is just loud noise, or it mutes everyone but the loudest person, which kills lively conversations.
I really like the idea of being able to mingle, and "walk" around to chat with different groups, all at the same party.
It also uses modern web technologies and does not even need a login, just show it your face and it will try and use emojis to tell people what you're doing even if you're not in a call with them
https://news.ycombinator.com/item?id=22818300
A 3d version of this concept is well executed by Mozilla Hubs, but the lack of echo cancellation makes headphones a necessity when using Hubs which is a downside.
https://github.com/mozilla/hubs/pull/2361
Very creepy.
[1]: https://media.xiph.org/video/derf/
I get that it's just a tech demo but a small disclaimer about what will be done with the data before requesting the permission would go a long way.
But I do appreciate the feedback and will be sure to add a disclaimer and make it clear what's going on!
1. The app requests permission to view your camera
2. Your video stream is displayed and a local js script will run facial recognition (not against a database, just a binary "is this a face") and only then will it allow you to join the chat.
3. When you join the chat, your video and audio will be transmitted but will not be stored.
some people likely won't even read it and just click anyway, but for the curious and/or paranoid it will definitely be reassuring.
thanks for sharing your work.
What exactly do you think will happen other than _using your camera_?
Edit: by background chatter I mean the noise from all the other conversations happening in the moment nearby
Also, I'd try to make it easy for a person to leave the chat room. Couldn't find an exit. Not good UX
I'm sure you'll improve it along the way. Good stuff :)
Edit: I got it. My roommate's browser was not working for it in general.
We are working on something similar: https://www.joinvoiceplace.com
Go to game rooms, and play some game online. Go to a club, and listen to the same Spotify track.
I feel like there shouldn't be a #public room. It is basically Chatroulette.
You can turn your camera off once you're in a room too - I actually made this to try and host my birthday party next month where it would be nice to see everyone :)
I really like the idea of being able to mingle, and "walk" around to chat with different groups, all at the same party.
There have been a lot of changes since I made the first post a week ago. Check out the github, I'm looking for contributors!