Touch with Kinect – Color Picker

Author: Keqin Summary: Use kinect to turn any surfaces into touch screen Abstract: There are many kinect app online. There are many turn-any-surfaces-into-touch-screen hack. So I made this and also built a very simple application called color picker which can choose color on the surface. Repository:

There are many great hack with kinect. When we can get the depth image from the camera, we can do a lot of interesting things with this data. At first, I just think that traditional input method is too bored to use, why not turn everyday things into input device. How can we make this? Then I found a video:

But I want to make a more customized user interface which user can use different objects to be the user interface. But then I found this is a very big project, I just make the touch part and made a very simple color picker application for it.

Then I began to built the environment.

20130325_014840 copy


On the top, it’s the kinect fixed to about 70cm above the surface. The sruface is cardboard and on the surface there are objects to pick color.

This is the video for the project :

For touch part, it’s a little technical in Computer vision.

Firstly, I need to get the first 50 frames and get the average data of this. And it can be the background information for later use.

Secondly, when new things added into the kinect range, it will find the difference between background information and current frame. Also before find the difference, it will use some tech to reduce the noise in the current frame.

Thirdly, find the fingertip in some depth range(This would be different depend on how high the kienct from surface.) and get the fingertip’s location.

For colorpicker, I just use the location to get the color in RGB image which get from kinect RGB camera.


Maybe the final project I will continue to make something based on this.

This entry was posted in project-3 on by .

About Keqin

I'm Keqin Dou. I'm now the first year Tangible Interaction Design Master student at Carnegie Mellon University. I learnt more things about interaction design, physical prototyping than computer science. So I believe I can do anything range from development to design. I also held a BS degree in Computer Science and Technology at University of Science and Technology,Beijing. During my undergraduate time, I did the HCI, TUI research in HCI lab of Chinese Academy of Sciences. I'm also very interesting in chanlleging uncomforable zones.

Leave a Reply