Very nice. I wish we could see the actual UI to get a better sense of how it works - can you post a screenshot?<p>If you paired this with a Kinect or similar multi-camera system you could allow the other hand to interact with the the model/model elements (when not busy doing extravagant gestures of course). Pretty amazing no matter how you slice it, nice job!
I have been using this for a project at work - simply as a remote keyboard & mouse for multiple PCs/Macs in the same room. Could you add arrow keys to the keyboard?
It looks stunning.<p>It hadn't occurred to me that phones could be used as sophisticated remote controllers. What technology do you use for real-time communication?