Kinect Sees Experimental Use as ASL Tool

People are using the Kinect Xbox 360 add-on in ways that transcend the idea of a video console accessory. It was this type of development that was hoped for when a bounty was put out for open source Kinect drivers, and look what the latest possibility is: using Kinect to help people learn American Sign Language.

>Researchers at Georgia Tech College of Computing are working such a project. They've taken the Kinect and coupled it with custom software, CopyCat. The prior, pre-Kinect version required the users to wear colored gloves with 3-axis accelerometers.

The new system performed very accurately. In a series of increasingly more difficult tests, the software returned results with 100 percent accuracy, 99.98 percent accuracy, and 98.8 percent accuracy.

Reportedly
the team will be working on updates including a larger vocabulary which necessitates the need of "hand shape features." The initial proof-of-concept demo launched with a small vocabulary that excluded them in favor of broader gestural movements with the arms and body.
It's clear that the four-fold increase in Kinect accuracy that Microsoft is rumored to be working on could be very useful in this effort.

Watch a video on the project below.

Via:  Joystiq
Comments
3vi1 4 years ago

Does this mean people will no longer immediately bombard me with "A/S/L?" messages on IRC?

dodgers2213 3 years ago

really cool! But this could be tough to adapt as a game....there are sooo many variations and personal touches to how a person can sign an entire sentence or story

Post a Comment
or Register to comment