Daily Archives: 02 Apr 2013

Dev

02 Apr 2013

For the capstone I finally decided to do a hardware project. I was inspired by this blog post which I had read some months back. Please watch the videos in it, they are quite entertaining:
http://www.andrespagella.com/important-gestures-public-speaking

After reading that article I sorta fell in love with Italian hand gestures. They are so expressive, and I love the fact that the gestures themselves form a language. For this project I want to create a piece that will make learning these beautiful gestures easy and interactive.

As a source I plan on using Speak Italian: The Fine Art of Gesture (http://www.amazon.com/Speak-Italian-The-Fine-Gesture/dp/0811847748/?tag=braipick-20).

My goal is to translate gestures into animatronic hands. There are several instructables on how to make these. (http://www.instructables.com/id/Simple-Animatronics-robotic-hand/)

At the end of the day I want users to speak some word or words in English and have them spoken back with an Italian accent and the appropriate hand gestures.

Robotic hands are nothing new. And neither is the concept of having them gesture. (See video below) The interesting part of this project will  be the fact that I am reinterpreting Bruno Murani’s book in a very physical way.

Alan

02 Apr 2013

Abstraction: Browser and iPhone Interaction Experiment

Background: There are many interactions with sensors like Kinect, LeapMotion, Wii. All these interactions require additional sensors with limitation of context and cost. They are either scalable but with high cost or with cheap device but limited with size. Therefore, an idea using ubiquitous devices like a smart phone or iPad as sensors is on the right track. Using browser as the interaction medium also frees the system from heterogeneousness between different mobile operating systems.

Inspired by Boundary Functions (1998) by Scott Snibbe, every person in real world has a physical relationship with others, I am thinking how about relation between people in virtual space. This interaction installation will be set in public spaces, like airports and train stations. People are getting into Internet through devices. Identity of human is represented as identity of digital devices. With interactions between their mobile devices, people are getting sense of relations between others(whether anonymous or not) in the same public spaces.

Verification & Communication

Currently I didn’t implement the verification for the system right now. User can access the system by visit the server ip address with websocket. Once a device is connected to server, the server will generate a new ball for the user. Server can get the device id to identify the user.

Interaction

The browser on the mobile devices will obtain gravity and accelerometer of the current device and send data to the server. The server will normalize the velocity and orientation of x-axis and y-axis values and map them to the position on the browser page.

context

Tech

I use Node.js as server with now.js and socket.io for live interaction. Apple accelerometer is the sensor on the client device.

Github repo: https://github.com/hhua/xBall