Gesture Interaction for Coronary Heart Diseases Based on Wavelet Transform and Semi-Continuous Hidden Markov Model in Augmented Reality

Title:Gesture Interaction for Coronary Heart Diseases Based on Wavelet Transform and Semi-Continuous Hidden Markov Model in Augmented Reality

Volume: 10 Issue: 2

Author(s): Mingke Gao, Yimin Chen*, Dianhua Zhang, Zeyu Li, Siyu Jiang, Shengqing Lv, Rongrong Lu, Jiahui Lu and Chen Huang

Affiliation:

• School of Computer Engineering and Science, Shanghai University, P.O. Box: 200444, Shanghai,China

Keywords: Augmented reality, coronary heart disease, gesture interaction, gesture recognition, semi-continuous hidden markov model, wavelet transform.

Abstract: Background: Most doctors are used to locate the vascular stenosis position first then clinically estimate vascular stenosis by the CAG images instead of using mouse, keyboard and computer during the preoperative diagnosis. Therefore, it is necessary to have an effective, intuitive and natural method to replace the existing preoperative diagnosis mode for diagnosing the coronary heart disease.

Methods: This work presents the gesture interactive diagnostic method for coronary heart disease based on wavelet transform and Semi-continuous Hidden Markov Model in Augmented Reality. Firstly, the dynamic gesture trajectory is analyzed by using K-means cluster algorithm to determine the gesture trajectory plane. Secondly, the integrity of the trajectory is preserved on the sensor plane by employing trajectory projection and space rotation transformation. Thirdly, the features include the azimuth of gesture trajectory and the changes of hand shape are extracted. Meanwhile, the azimuth of gesture trajectory is analyzed by utilizing wavelet transform and the singularity of the trajectory is detected to compute the state number of SCHMM for all the dynamic gestures. The gesture training is completed by employing Baum-Welch algorithm with multi-features and multi-observation sequences. Ultimately, gesture recognition is realized by using Viterbi algorithm based on self-learning mechanism. It is then applied into the gesture interactive diagnosis of coronary heart disease and the diagnosis of the vascular stenosis are intuitively and naturally realized with augmented reality and gesture interactive techniques.

Results: The number of states of dynamic gesture is determined by using wavelet transform which precisely detect singular points of gesture trajectory. The recognition rate of dynamic gesture is average of 96.1% and the semi-dynamic gesture is average of 92.6%, the total recognition rate is average of 95.6%. The dynamic gesture recognition rate of the proposed method is 7% higher than the traditional method. The intuitive and natural gesture interactive experiments and the affirmed measuring results are approved by surgeons.

Conclusions: The proposed method is a feasible, usable and reliable gesture interactive diagnostic method for coronary heart disease based on wavelet transform and Semi-continuous Hidden Markov Model in Augmented Reality. The results demonstrate that the proposed method could improve the gesture recognition rate, extend the gesture manipulation space and expand the diagnostic method for coronary heart diseases.

Cite this article as:

Gao Mingke , Chen Yimin *, Zhang Dianhua , Li Zeyu , Jiang Siyu , Lv Shengqing , Lu Rongrong , Lu Jiahui and Huang Chen , Gesture Interaction for Coronary Heart Diseases Based on Wavelet Transform and Semi-Continuous Hidden Markov Model in Augmented Reality, Recent Advances in Electrical & Electronic Engineering 2017; 10 (2) . https://dx.doi.org/10.2174/2352096510666170601123551

DOI https://dx.doi.org/10.2174/2352096510666170601123551	Print ISSN 2352-0965
Publisher Name Bentham Science Publisher	Online ISSN 2352-0973