Found this on the interweb.
It’s a video of some chap whose created a Minority Report interface using
Fancy Custom pair of gloves (with leds in the fingers I reckon)
A piece of string
Then using the custom hardware (gloves) can control the items on screen. The Wiimote can track up to four infra-red LED items at a time, the rest is all software.
This should be possible in Silverlight 2.0 as well.,
**UPDATE** : reading the forums its unlikely this is the case. Silverlight reacts to the keys and the mouse specifically, people are saying the sway silverlight is built, is that is is not possible.