Back in about 2000 I remember exchanging emails with a guy who had built a modified renderer for (I think) the Half-Life 1 engine. He was using audio rendering to enable blind players to play first person shooters. My recollection is he was using a series of horizontal scan lines across the display region with different octaves or similar indicating which scan line was being "rendered" and different tones indicating the brightness value along the sweep of each scan line. I think he was primarily using mono audio at the time, but it's been long enough that I can't entirely recall.
For serious users, The Android version of The vOICe also runs on smart glasses from Vuzix (Vuzix Blade, M300) <a href="https://www.vuzix.com/appstore/app/the-voice-for-android" rel="nofollow">https://www.vuzix.com/appstore/app/the-voice-for-android</a>, EPSON (Moverio BT-300) <a href="https://moverio.epson.com/jsp/pc/pc_application_detail.jsp?pack=vOICe.vOICe" rel="nofollow">https://moverio.epson.com/jsp/pc/pc_application_detail.jsp?p...</a> as well as on sub-$200 VISION-800 smart glasses <a href="https://www.seeingwithsound.com/android-glasses.htm" rel="nofollow">https://www.seeingwithsound.com/android-glasses.htm</a><p>Also try the experimental visual object recognition under Options | Say object names.
You can actually try this out in your browser with your webcam here: <a href="https://www.seeingwithsound.com/webvoice/webvoice.htm" rel="nofollow">https://www.seeingwithsound.com/webvoice/webvoice.htm</a>
Cool, that's an interesting scheme for translating vision to audio.<p>I have experimented a little with using 3D binaural audio for navigating environments and translating objects' location in 3D space into audio. Here's my blog post about my experiment <a href="https://blog.syllablehq.com/project-sonorous-a-proposed-navigation-tool-for-the-visually-impaired/" rel="nofollow">https://blog.syllablehq.com/project-sonorous-a-proposed-navi...</a><p>The blog post links to an app you can demo where you can practice navigating a maze with your eyes closed using only binaural audio to guide you. Anyone can do it with very little practice!<p>I would love to spend more time on this in the future and I'd love to consider adopting this vOICe scheme.
This feels really groundbreaking to me. It's like echolocation. Although it also seems to be projecting 3d onto 2d, while true echolocation gives you a 3d picture(?)
Has some overlap with the wave scanner from Elite Dangerous.<p><a href="http://wavescanner.net/" rel="nofollow">http://wavescanner.net/</a>