Re:Navigation for the Visually Impaired Using a Google Tango...
by DanAndersen on Saturday May 16, 2015 @02:39PM
(#9557138)
This is a project I've been working on for the past couple of months, using the Project Tango tablet for a navigation system for people with visual disabilities.
It uses pose estimation and point cloud data to (1) build a chunk-based voxel environment of the user's surroundings, (2) render a set of depth maps surrounding the user, and (3) use the depth map and OpenAL to generate 3D audio that gives indications of where mapped obstacles are.
I don't have it at a state where folks can try it out, but I did do a writeup of my approach and wanted to share it.
It uses pose estimation and point cloud data to (1) build a chunk-based voxel environment of the user's surroundings, (2) render a set of depth maps surrounding the user, and (3) use the depth map and OpenAL to generate 3D audio that gives indications of where mapped obstacles are.
I don't have it at a state where folks can try it out, but I did do a writeup of my approach and wanted to share it.
Demonstration video (with quiet audio) here: https://youtu.be/EnNuDiJazBs