caro-place

Ultrasonic Exploration

Project Summary

What would it be like to navigate an environment using sound to navigate instead of sight?

To investigate, I built an echolocation device and used it to explore a room that I’d never seen visually. The probe is made using ultrasonic distance sensors that trigger both an LED and a speaker based on proximity.

I set up a 360 camera to document this exploration process, and wrote a simple processing sketch to add the brightness of the LED to each future frame of video. The end result is a recording of my path through the space.

Place: Somewhere I’ve Never Been

In documenting the process of visually blind exploration, it was important that I have no preconceived image of the room I’m documenting. I had my boyfriend come wander around campus with me and help pre-select mysterious rooms for filming. He chose the most unfamiliar room of all: the men’s bathroom in the basement of Doherty.

Capture System Part 1: Ultrasonic Probe

My probe consists of three ultrasonic sensors, an LED, a buzzer, and an Arduino. All of these are wired together onto an old crutch I had lying around in my closet.

The ultrasonic sensors use echolocation to determine distance. They emit a high frequency sound waves, and time how long it takes the waves to return. Whenever any of the ultrasonic sensors get within a certain range of an obstruction, the LED lights up and a buzzer beeps to let me know I’m close to something.

Here’s a longer video I made playing around with it (the buzzer was disabled for this because I didn’t want to wake people up):

At the end I wound up putting a “shield” on the LED to mitigate the classic “light painting” look of following a glowing dot around. This way it’s more about what’s being illuminated than the light source itself.

Capture System Part 2: 360 Camera 

I chose to document the exploration process using a 360 camera.

I had my boyfriend put the 360 camera in the room for me and turn off the lights so that I never saw the location. I blindfolded myself, and then began the process of blindly probing the room. My only spatial cue was the beeping of the speaker.

The 360 camera wound up documenting my exploration via only the LED light’s path around the room. Similarly, all I knew about my environment was a single beeping noise: in my mind, the buzzer and the LED are equivalent, but one is sonic and one is visual.

Media Product: Additive Brightness 360 Video

The original video I got was a light moving around a room in 360, turning on and off. Using ffmpeg, I split the video into frames. Then, I wrote a simple processing sketch to additively composite all of the bright areas from the previous frames into all future frames. This way, the LED additively paints the environment, similarly to how every new “beep” from the speaker gave me new spatial information.

The video is meant to be viewed in a Google Cardboard, so people can spatially experience the environment.

 

Evaluation

Blindly wagging a stick around deserted men’s bathrooms at 3AM with only beeps to guide me was quite an experience. It was very uncomfortable not being able to see what I was doing. It felt like I lost control of the product I was creating by not being able to see it. In the end, this was really the point of the project.

Result

One comment

  1. golan

    Comments from the Group Review.

    Created an audiovisual echolocation device to document a place she’d never seen before

    General: great contraption, great setup. Someone picking spaces is great, adds an element of trust. Include led beeping in documentation. Hide and seek – trying to find particular things in space. +1

    SO GREAT SUCH GREAT PROBE *****

    This could be really fertile material for a performance piece involving a live audience +

    && documenting the interaction between a Normal audience member and You would be really really interesting.

    I think this project is more interesting with the 360 documentation than echolocation as perceptions for the blind.

    Everything about this project is, basically, perfect.

    Audio would be good accompaniment. Just use the original sound.

    Did you not cover up the arduino LED’s? (I think she did, but there’s still some leak)

    Have you seen the videos of blind people who actually click and then can find their way around from the sound refractions?

    THere is a lot untouched about how blind actually navigate the world. There’s a lot of history,
    design history, and more that can/could be unpacked. The have been some interesting studies about how the blind conceptualize their worlds, the final (visual) video is, perhaps not intentionally, making a comment on this conceptualization. <- but is she suggesting that this is a product for the blind? It seems to me that she is instead augmenting her sensory perception in a funny/experimental way I love your work. It’s all about the process and it’s smart, gutsy and has character. + Marco polo