Trend Edition

Multi-touch Whiteboard - Wii Style

Johnny Chung Lee, from Carnegie Mellon University, is making wonders with his Wii remote. First of all he has turned it into a multi-touch receiver that you can use for whiteboards - or practically any surface you can think of.

Here is the video:

Loading video

His first attempt, as you can see in this video (below), looks much more technical. Instead of using a pen - he uses reflective tape and his fingers to control a TV. It is still very impressive, but needs some "design" :)

Loading video

Then he moves on to create the most impressive 3D experiences I have ever seen. There are so many potentials with this kind of technology. Not just for the obvious - for games - but just think about the possibilities in terms of interaction design.

People have been trying to create 3D interfaces for as long as I can remember, but all of them have failed - again short of games - because it was displayed on a 2D screen. Now you got a 3D interface on a (simulated) 3D screen.

Loading video

See Also:

Comments

1

Tracy - Dec. 28, 2007

This is wonderful! Thank you for sharing this Thomas. I also see fabulous benefits for education. Imagine how many 'smartboards' we can create for the cost of a real one!

I'm going to look into this and see about building the parts for my classroom.

Tracy

2

ZK - May. 28, 2008

Thank you, very usefull!

3

René Garcia, Jr. - Jul. 6, 2008

Thomas, thank you so much for posting these videos. Awesome find. Now I'm off to Johnny Lee's site!

René

http://www.workingauthor=.com

4

Bapudi - Jul. 13, 2008

Where do you get the software that maps the Wiimote space to the screen space, and handles the multi-touch functions?

5

Bapudi - Jul. 13, 2008

Oh, off his website. I guess I should have watched the whole thing before posting. Sorry!

6

dawt - Jul. 13, 2008

Wow-WII is all I can say! I'm off to his Web site, too! (Thanks for posting this, Thomas, it's fantastic!)

~Dorothy

7

sherlockzz - Jul. 14, 2008

I dont own a WII or any gaming system. How is the remote interfacing with the computer? Is he using a Wii console or does the remote plug in to most laptops?

8

Darius - Jul. 14, 2008

This is pretty awesome stuff. I'm glad I Stumbled here.

9

Roberto - Jul. 14, 2008

Great compilation of Johnny Lee's work. He's a terrific hacker. Nintendo should hire him as an honorary researcher.

10

paresh - Jul. 14, 2008

nice, useful article.

11

chris - Jul. 15, 2008

Interesting, but I'm not sure interacting with a projected image in this fashion is more productive or practical than simply using a mouse. And having to remember to not block the Wii would get annoying I'd imagine. Still, pretty neat.

12

Thomas Baekdal - Jul. 16, 2008

Chris, I must admit that I see a lot of potentials. Being able to interact directly provides for a more engaging experience.

As for blocking both the screen and the Wii, then that could potentially be placing the projector behind the screen instead (but I am not sure if the Wii could detect you through a screen).

13

kalle - Jul. 17, 2008

the 3d vid should be on the top:P It's really cool. I wanna see some games too!

14

Carissa - Jul. 17, 2008

I've already created a pair of gloves to use for a keyboard...this is going to be sweet

15

Benjie - Jul. 18, 2008

Wow! I wish I was capable of stuff like this, seems like you guys have tons of fun!

I am hoping Nintendo is watching this and looking forward to some amazing things from the wii!

16

Online Advertising - Jul. 24, 2008

Wii is so amazing. =)

17

RPO - Jul. 28, 2008

Wii is crazy. I just saw something about wii making a microphone so gamers can talk. As i recall, xbox live has already produced this, yet it will probably still make a splash.

18

Don Jones - Jul. 28, 2008

This guy's gonna get SOOOOO rich.,

19

Joel - Jul. 29, 2008

I like the electric cello in the background.

20

Thomas Baekdal - Jul. 29, 2008

Joel, he he... I think I have seen those videos 20 times, but I never noticed a cello

 

Published: Dec. 23, 2007
in User Experience

Subscribe / Select »

Thomas Baekdal

Thomas Baekdal is a Writer, Interaction Designer, Change Advocate and Project Manager.

» About Baekdal
» Contact Information