I wish i could do that…
tracking a move/cordenate or range of coords , then conver those into keyboard actions can be really fun for anything.
that will bring replayable value to lot of stuff. i was also thinking into implementing it into 3d applications like zbrush 3d max or maya, the way you can click any ground, then then rotate or move the controller , to speed up any process specially for animation, one hand controlls the rotations/position, and other edits the stuff.. with the digital tablet or pen or mouse.. that would be awesome. lot of ideas are yet to come!