Trend Edition
Multi-touch Whiteboard - Wii Style
Johnny Chung Lee, from Carnegie Mellon University, is making wonders with his Wii remote. First of all he has turned it into a multi-touch receiver that you can use for whiteboards - or practically any surface you can think of.
Here is the video:
Loading video
His first attempt, as you can see in this video (below), looks much more technical. Instead of using a pen - he uses reflective tape and his fingers to control a TV. It is still very impressive, but needs some "design" :)
Loading video
Then he moves on to create the most impressive 3D experiences I have ever seen. There are so many potentials with this kind of technology. Not just for the obvious - for games - but just think about the possibilities in terms of interaction design.
People have been trying to create 3D interfaces for as long as I can remember, but all of them have failed - again short of games - because it was displayed on a 2D screen. Now you got a 3D interface on a (simulated) 3D screen.
Loading video
See Also:
- Johnny's blog - Procrastineering.com
- Johnny's website - johnnylee.net
Comments
ZK - May. 28, 2008
Thank you, very usefull!
René Garcia, Jr. - Jul. 6, 2008
Thomas, thank you so much for posting these videos. Awesome find. Now I'm off to Johnny Lee's site!
René
Bapudi - Jul. 13, 2008
Where do you get the software that maps the Wiimote space to the screen space, and handles the multi-touch functions?
Bapudi - Jul. 13, 2008
Oh, off his website. I guess I should have watched the whole thing before posting. Sorry!
dawt - Jul. 13, 2008
Wow-WII is all I can say! I'm off to his Web site, too! (Thanks for posting this, Thomas, it's fantastic!)
~Dorothy
sherlockzz - Jul. 14, 2008
I dont own a WII or any gaming system. How is the remote interfacing with the computer? Is he using a Wii console or does the remote plug in to most laptops?
Darius - Jul. 14, 2008
This is pretty awesome stuff. I'm glad I Stumbled here.
Roberto - Jul. 14, 2008
Great compilation of Johnny Lee's work. He's a terrific hacker. Nintendo should hire him as an honorary researcher.
chris - Jul. 15, 2008
Interesting, but I'm not sure interacting with a projected image in this fashion is more productive or practical than simply using a mouse. And having to remember to not block the Wii would get annoying I'd imagine. Still, pretty neat.
Thomas Baekdal - Jul. 16, 2008
Chris, I must admit that I see a lot of potentials. Being able to interact directly provides for a more engaging experience.
As for blocking both the screen and the Wii, then that could potentially be placing the projector behind the screen instead (but I am not sure if the Wii could detect you through a screen).
kalle - Jul. 17, 2008
the 3d vid should be on the top:P It's really cool. I wanna see some games too!
Carissa - Jul. 17, 2008
I've already created a pair of gloves to use for a keyboard...this is going to be sweet
Benjie - Jul. 18, 2008
Wow! I wish I was capable of stuff like this, seems like you guys have tons of fun!
I am hoping Nintendo is watching this and looking forward to some amazing things from the wii!
RPO - Jul. 28, 2008
Wii is crazy. I just saw something about wii making a microphone so gamers can talk. As i recall, xbox live has already produced this, yet it will probably still make a splash.
Don Jones - Jul. 28, 2008
This guy's gonna get SOOOOO rich.,
Joel - Jul. 29, 2008
I like the electric cello in the background.
Thomas Baekdal - Jul. 29, 2008
Joel, he he... I think I have seen those videos 20 times, but I never noticed a cello
Published: Dec. 23, 2007
in User Experience
Thomas Baekdal is a Writer, Interaction Designer, Change Advocate and Project Manager.
Tracy - Dec. 28, 2007
This is wonderful! Thank you for sharing this Thomas. I also see fabulous benefits for education. Imagine how many 'smartboards' we can create for the cost of a real one!
I'm going to look into this and see about building the parts for my classroom.
Tracy