Arama They Didn't

10:34 am - 04/10/2012

Tongue-controlled Kinect interface under development in Japan

A research group at The University of Electro-Communications is developing an interface to detect tongue movement using the Kinect.

This interface is intended mainly for training the oral muscles, which include the tongue, for people who have oral motor function disorders affecting their ability to speak or swallow. The research group suggests this as a hygienic detection method, which doesn't require attaching a device to the tongue.

"First of all, the face and eyes are detected using Kinect. When both eyes are recognized, the system can estimate the position of the nose, and based on the position of the nose, movement values are obtained. The minimum movement value indicates the tip of the nose. Based on that position, the system determines the mouth area. Based on the mouth area, movement values are obtained, like before. So finally, the position of the tongue is obtained."

"One way of training the tongue is to move it left and right. We've created a shooting game based on that motion."

"When you stick your tongue out, a bullet is shot from the player in the middle. The bullet's trajectory depends on which way the tongue is pointing. That's how you aim at the targets in this game."

"The first problem is that detection isn't very precise, the system isn't very robust. So we're considering how to improve the precision. Also, we'd like to develop an interface that uses the motion of the lips as well as the tongue, so training can include a combination of mouth motions."

Just "kissing" the posters wasn't enough.

Source: Diginfo Tv
csaca 10th-Apr-2012 07:09 am (UTC)
Just kissing the poster wasn't enough.........
mjspice 10th-Apr-2012 07:10 am (UTC)
baka_tenshi 10th-Apr-2012 07:28 am (UTC)
i can see some use coming out of this much more than the kissing posters. :\ like it could help with language learning and maybe even some kind of medical research.

but playing games with tongues is just as cool, i guess.

oh wait. i'm being too logical again! sorry, sorry.

Edited at 2012-04-10 07:48 am (UTC)
rainbow_yarn 10th-Apr-2012 08:00 am (UTC)
I had some physical needs students who had a lot of trouble speaking. I can see how this would be helpful to them. Comment at the end of the post is tacky.
mjspice 10th-Apr-2012 08:05 am (UTC)
Comment at the end of the post is tacky.

The place where I had first read this had included it with the Kissing Posters article hence the comment.
ynaoblivious 10th-Apr-2012 07:37 am (UTC)
LOL what???? what are they coming up with? next we'll all have virtual girlfriends/boyfriends well since I'm a fangirl this already applies

and they wonder why their birthrate is so low. (>.>)
squallina 10th-Apr-2012 08:18 am (UTC)
I can see some useful applications for this. The one mentioned above (to help people with oral motor function disorders) is one but I think it would also give people with physical disabilities or arthritis the ability to play games without using their hands or any straining hand movements.

However aren't we missing a step here?

To quote Yahtzee in his review of the Kinect (The whole review is brilliant but possibly NSFW):
"…I'd be lying if I said that there wasn't appeal in the idea of sifting through interfaces by making regal dismissive gestures from my couch. Like with those computers in Minority Report. But if the Kinect is like the computers from Minority Report then that explains why they cast Tom Cruise in that film."

So while we're developing tongue recognition for the Kinect, let's not forgot to also make the Kinect capable of reading our hand movements while sitting on the couch. It should be a mix of body (for dance and fitness games), hand (for games with spell-casting, brushing curtains aside, pulling levers etc), and tongue (for the above reasons.) :)
mjspice 10th-Apr-2012 08:21 am (UTC)
Thank you for your wonderful insight as always. :)
squallina 10th-Apr-2012 08:27 am (UTC)
Should I take that as a "Yay, you're back with something interesting!" or a "You again!?" comment? (^^; ) *hides*
baka_tenshi 10th-Apr-2012 08:52 am (UTC)
I heard the Kinect is being used for the new Mass Effect game but there's still some kinks they need to work out (as with any other motion control system).

Oh, is Yahtzee still making reviews? :o
squallina 10th-Apr-2012 09:02 am (UTC)
M.E. developers will probably add fully interactive kissing if the tongue recognition gets their way.

Yes, yes, he is. New one out every Wednesday/Thursday! And for the most part they're pretty awesome. I found the Amy and Dead Island ones hilarious! :)
kazeryl 10th-Apr-2012 08:52 am (UTC)
Nice one, again. XD
But I dont really want to imagine people using their tongues to play though..
Will get cramps if the game is played for too long.
katzsong 10th-Apr-2012 08:58 am (UTC)
Approve OP's techno-quirk posts for today :Db
mjspice 10th-Apr-2012 08:59 am (UTC)
Hehe thanks! XD
yume_no_yousei 10th-Apr-2012 07:53 pm (UTC)
Impressive, that's a really innovative and interesting way to use the Kinect. This seems to be more useful than the kissing posters, at least.
This page was loaded Dec 13th 2018, 12:01 am GMT.