VibAuView

VibAuView is an application that seeks to facilitate the perception of the world by people with blindness.
It detects colors, outlines and distances by providing tactile and audio feedback.

The distance may not be accurate, so DO NOT USE IT TO MOVE IN AN UNSAFE ENVIRONMENT.

To avoid excessive overheating of the haptic feedback motor, the signal stops for continuous use longer than approximately 10 seconds and resumes after a few seconds.

Functionality:

Mode 1:
Feel or hear feedback as you move your finger across the screen. With iPhone dual camera you can continuously explore the depth value, if your device has Force Touch you can increase the perception of differences by pressing the screen harder.
With a double tap in the center of the screen the image is processed after a fraction of a second, becoming explorable, in this case you get the depth map with AI algorithms and use the wide-angle camera instead of the double camera.
Thanks to the gyroscopic sensors you can also explore the image simply by placing a finger on the screen and tilting the device, as if you were changing the direction of the camera. With pinching it is possible to zoom, wait a fraction of a second for the tactile signal that signals the end of processing.
You can also double tap to get a depth map from flat images such as a canvas or distances greater than about 5 meters as long distances are not distinguished.

With tactile feedback at higher frequencies for more distant objects and at lower frequencies for closer objects and color-related intensity, it is possible to perceive the scene of the environment.

Mode 2:

Available only for iPhones with dual cameras, it allows you to use the "virtual stick". It signals if you are aiming for something closer to the length of the virtual club (at launch it sets its length equal to the distance), which can be changed by scrolling up and down.
With the swipe to the right you switch to the "surface slope" function to orient yourself with respect to a wall. Touch the screen and the vibration will change according to the inclination of the wall. Swipe left to return to the "virtual stick".

Mode 3:

Touch the screen and you will hear a vibration or a characteristic sound depending on the touched color, the image is blurred to allow the analysis of an average of the color, if your device has the Force Touch you can press harder to reduce the blur.

Mode 4:

This feature brings you 3D spatial sound, better use it with earphones.
Hear the depth and colors with an audio atmosphere based on these from a 7 x 7 sound matrix (shrinks down to 3 x 3 and restarts if the device overheats).
By swiping up you will hear only the depths and by swiping down you will also hear the colors, keep swiping up or down to change the sounds.
If your device has a dual camera, the calculated distance will be in real time and absolute, otherwise the audio scene will be recalculated when the shot changes and you will have a small delay, also the distance will be relative.

Switch between modes with a double tap on the right or left edge of the screen.

VibAuView does not access the Internet or store images in any way.

Shake the device to activate the sound mode and listen to the sounds, keep shaking the device to return to the touch mode after all the sounds.

In some versions of the operating system, it may be necessary to disable VoiceOver.