Microsoft Research Demos Kinect Real-Time Sign Language Translation

rated by 0 users
This post has 4 Replies | 1 Follower

Top 10 Contributor
Posts 26,393
Points 1,192,505
Joined: Sep 2007
ForumsAdministrator
News Posted: Thu, Oct 31 2013 11:34 AM
Microsoft’s Kinect is nothing short of impressive, but it can used for much more than just entertaining games. Microsoft Research Asia is developing the Kinect Sign Language Translator system which translates sign language into text or speech (and vice versa) in real time.

Microsoft Research Asia has been working with the Chinese Academy of Sciences and Beijing Union University on the project in China, and in the collaboration between engineers, educators, and sign language practitioners has resulted in working demos that are amazing.

Kinect Sign Language Translator

The Kinect-based system can capture signs made by a person; recognize the meaning of it using the sign itself as well as body positioning and posture; and then it translates the signs into spoken language or written words. There’s an avatar in the Kinect system that will translate the spoken words of the hearing person into signs for the hearing-impaired person on the other end.



The system is also designed to communicate between Chinese sign language and American Sign Language (ASL), which use different gestures.

Kinect Sign Language Translator

Although this is still a research prototype, progress is being made at a rather brisk pace; hopefully this excellent technology will emerge mature and fully-formed soon. Microsoft Research says that there are over 20 million hearing-impaired people in China and about 360 million worldwide.
  • | Post Points: 35
Not Ranked
Posts 5
Points 55
Joined: Dec 2011
Roth replied on Thu, Oct 31 2013 2:28 PM

I've seen some interesting use of the Microsoft Kinect. The most impressive use I've seen so far is that paranormal investigators have been using it to document paranormal activity such as this episode of Ghost Adventures: http://www.youtube.com/watch?v=IWNUkosz2HY

It's also been seen used in the latest Paranormal Activity movie, Paranormal Activity 4.

  • | Post Points: 20
Not Ranked
Posts 3
Points 30
Joined: Oct 2013
Okami123 replied on Thu, Oct 31 2013 7:44 PM

It seems to me that most people don't use kinect, also if they wanna make the kinect a big deal, the need to add more games to it.

  • | Post Points: 20
Top 150 Contributor
Posts 541
Points 4,510
Joined: Apr 2012
Location: Schertz, Texas
ajm531 replied on Fri, Nov 1 2013 12:07 AM

I dont think using it to catch fake sounds and images for their show is as impressive as helping real people or for those that believe in this sort of stuff helping alive individuals that have a disability such as not being able to hear or to some degree even teach others how to sign to communicate with those who are deaf. but thats my personal opinion.

  • | Post Points: 5
Top 150 Contributor
Posts 541
Points 4,510
Joined: Apr 2012
Location: Schertz, Texas
ajm531 replied on Fri, Nov 1 2013 12:08 AM

hmmmm i mean more games are a good thing but this will get it much more attention if its actually more useful than just letting people copy dance moves from an on screen avatar.

  • | Post Points: 5
Page 1 of 1 (5 items) | RSS