Thread: 360/Kinect And Sign Language

Kinect Detects Sign Language
Microsoft's movement tracking technology opens up more possibilities.
August 6, 2010
IGN

At long last, Microsoft's Kinect console patent has been released to the public. Details reveal the mechanics of the program's "gesture keyboarding" system, which is tracked by a unique PrimeSense-developed depth camera.

But one of the most substantial features of note is that, not only does the system recognize gameplay movement, but it also detects American Sign Language. This will allow fluent users to input letters, words and even entire phrases to be interpreted as readable data. This could end up being a very significant feature for those proficient in ASL



Kinect essentially operates by initiating a "skeletal mapping" feature, creating a dynamic wireframe representation of the user. The depth camera is then able to recognize even the subtlest of movements, including the minutia of ASL finger positioning.

Overall, the Kinect seems to be opening up the doors to even more possibilities than we first expected. Not only is it tapping into its primary gamer demographic, but the system also seems to have the potential to become a functional learning tool as well.

A full transcription of the patent can be found here.

http://xbox360.ign.com/articles/111/1110976p1.html