A Kinect-based Oral Rehabilitation System



Tse-Yu Pan


Yong-Xiang Wong

We present an interactive oral rehabilitation system, which detects bites or licks based on the mouth and tongue movements with the aid of Kinect. In order to perform oral physical therapy, our system goads the user into exercising their oral muscles by playing games. The user will get scores when he/she bites or licks the virtual foods falling from the sky. The movements of lips are measured to detect the bite action, and different strategies are designed to locate the tip-of-tongue for various face orientations so that the lick action can be detected more accurately. Our system is designed to provide different levels of therapy according to the rehabilitation situation of each patient in real-time. Also, the experimental results show that our method can be successfully applied to different users.



@INPROCEEDINGS{7498478, author={T. Y. Pan and Y. X. Wong and T. C. Lee and M. C. Hu}, booktitle={2015 International Conference on Orange Technologies (ICOT)}, title={A Kinect-based oral rehabilitation system}, year={2015}, pages={71-74}, month={Dec},} @inproceedings{Wang:2014:EMY:2647868.2654887, author = {Wang, Yong-Xiang and Lo, Li-Yun and Hu, Min-Chun}, title = {Eat As Much As You Can: A Kinect-based Facial Rehabilitation Game Based on Mouth and Tongue Movements}, booktitle = {Proceedings of the 22Nd ACM International Conference on Multimedia}, series = {MM '14}, year = {2014}, isbn = {978-1-4503-3063-3}, location = {Orlando, Florida, USA}, pages = {743--744}, numpages = {2}, url = {http://doi.acm.org/10.1145/2647868.2654887}, doi = {10.1145/2647868.2654887}, acmid = {2654887}, publisher = {ACM}, address = {New York, NY, USA}, }

Paper Download1 Download2