Login Register Cart 0
Generic placeholder image

Recent Patents on Mechanical Engineering

Editor-in-Chief

ISSN (Print): 2212-7976
ISSN (Online): 1874-477X

Back
Journal Home About Journal Editorial Board Journal Insight Current Issue Volumes/Issues
Subscribe
Review Article

Recent Advances on Human-Robot Interface of Wheelchair-Mounted Robotic Arm

Author(s): Mingshan Chi, Yufeng Yao, Yaxin Liu and Ming Zhong*

Volume 12, Issue 1, 2019

Page: [45 - 54] Pages: 10

DOI: 10.2174/2212797612666190115151306

Price: $65

Abstract

Background: Wheelchair mounted robotic arm is a typical assistive robot, which is widely used to help the elders and the disabled to complete the activities of daily life. But limited by the restrictions of the users’ athletic ability and cognitive ability, how to flexibly manipulate such robot is still a problem in front of them. The human-computer interaction technology is the core technology of the robot. Its performance directly affects the user's acceptability, satisfaction and promotion of intelligent wheelchairs.

Objective: The study aims to give a general summary of recent human-robot interface of wheelchair mounted robotic arm and introduce their respective characteristics.

Methods: Based on various patents and research developments about the human-robot interface of the assistive robot at home and abroad, this paper puts forward the basic principle of designing the humanrobot interaction mode, divides the man-robot interface into two categories based on the perspective of user control robot arm, and describes in detail, the typical human-robot interface and its related characteristics contained in each classification.

Results: The development trends of the human-robot interface in future are predicted, so as to provide some research reference for the related scientific researchers.

Conclusion: Wheelchair mounted robotic arm has important practical significance. Further improvements are needed in the design of the human-robot interface. It can effectively improve the operation performance of the WMRA, and take full advantage of the user’s existing movement ability to meet the requirement of dominating the control process. Furthermore, these improvements in the human-robot interface will allow more and more users to accept the WMRA, manipulate the WMRA, and enjoy improvements in the quality of their life for these assistive robots.

Keywords: Assistive robot, auxiliary control device, human-robot interface, robotics, self-movement, wheelchair mounted robotic arm.

« Previous Next »
[1]
Alqasemi RM, McCaffrey EJ, Edwards KD, Dubey RV. Analysis, Evaluation and development of wheelchair-mounted robotic arms. IEEE 9th International Conference on Rehabilitation Robotics. Chicago, USA, June, 2005.
[2]
Cobb CB. Robotic arm for wheelchair. WO017964 (1994).
[3]
Kim JB, Kim HS. Robotic arm for severely disabled people. WO2015076446 (2015).
[4]
Stuijt HJA, Romer GRBE. Wheelchair with mechanical arm. EP1771139 (2007).
[5]
Zhang ZJ, Li JH, Lin YJ, Qu JR. Robotic arm for electric wheelchair. CN207506707 (2017).
[6]
Kinetic Rehabilitation Instruments, Inc. Robotic arm for wheelchair. WO001437 (1994).
[7]
Ni ZQ, Wang TM, Liu D. Survey on medical robotics. J Mech Eng 2015; 51(3): 48-51.
[8]
Claire D, Christophe L, Eric M. Intuitive human interaction with an arm robot for severely handicapped people- a one click approach. IEEE International Conference on Rehabilitation Robotics Noordwijk, Netherlands, June, 2007.
[9]
Wang JC, Chen WD, Guo W. Autonomous intelligent wheelchair can open the door and open the door to independent method. CN104398346 (2015).
[10]
Topping M. An overview of the development of Handy 1, a rehabilitation robot to assist the severely disabled. J Intell Robot Syst 2002; 34(3): 253-63.
[11]
Song WK, Lee H, Bien Z. KARES: Intelligent wheelchair-mounted robotic arm system using vision and force sensor. Robot Auton Syst 1999; 28: 83-94.
[12]
Bien Z, Chung M, Chang P, Kwon D. Integration of a rehabilitation robotic system (KARESII) with human-friendly man-machine interaction units. Auton Robots 2004; 16: 170-9.
[13]
Bien Z, Song W. Blend of soft computing techniques for effective human-machine interaction/interface in service robotic systems. Fuzzy Sets Syst 2003; 134: 5-25.
[14]
Martens C, Ruchel N, Lang O, Ivlev O, Graser A. A friend for assisting handicapped people. IEEE Robot Autom Mag 2001; 8(1): 57-65.
[15]
Volosyak I, Ivlev O, Graser A. Rehabilitation robot FRIEND Ⅱ-the general concept and current implementation. IEEE 9th International Conference on Rehabilitation Robotics Chicago, USA, June, 2005.
[16]
Valbuena D, Cyriacks M, Friman O, Volosyak I, Graser A. Braincomputer interface for high-level control of rehabilitation robotic systems. IEEE 10th International Conference on Rehabilitation Robotics Noordwijk, The Netherlands, June, 2007.
[17]
Alqasemi RM. Maximizing manipulation capabilities of persons with disabilities using a smart 9-degree-of-freedom wheelchairmounted robotic arm system. PhD Dissertation, University of South Florida, Florida, United States, March, 2007.
[18]
Schrock P, Farelo F, Alqasemi R, Dubey R. Design, simulation and testing of a new modular wheelchair mounted robotic arm to perform activities of daily living. IEEE 11th International Conference on Rehabilitation Robotics Kyoto International Conference Center, Japan, June, 2009.
[19]
Farelo F, Alqasemi R, Dubey R. Task-oriented control of a 9-DoF WMRA system for opening a spring-loaded door task. IEEE International Conference on Rehabilitation Robotics Rehab Week Zurich, Switzerland, June, 2011.
[20]
Wang H, Xu J, Grindle G, Vazquez J, Salatin B, Kelleher A, et al. Performance evaluation of the personal mobility and manipulation appliance (PerMMA). Med Eng Phys 2013; 35(11): 1613-9.
[21]
Grindle GG, Wang HW, Salatin BA, Vazquez JJ, Cooper RA. Design and development of the personal mobility and manipulation appliance. Assist Technol 2011; 23(2): 81-92.
[22]
Exact Dynamics. Available at: http://www.exactdyna-mics.nl/site/?page=iarm (Accessed on: May 1, 2018)
[23]
Driessen B, Liefhebber F, Kate TT, Woerden KV. Collaborative control of the MANUS manipulator. IEEE 9th International Conference on Rehabilitation Robotics Chicago, USA, June, 2005.
[24]
Kinova empowering people through robotics. Available at: http://www.kinovarobotics.com/ (Accessed on: May 1, 2018).
[25]
Capille JW, Alqasemi RM, Carey S, Dubey R. Kinematic evaluation of commercial wheelchair-mounted robotic arm. IEEE International Conference on Systems, Man, and Cybernetics Anchorage, Alaska, USA, October, 2011.
[26]
Caron LJ, Deguire C. Portable robotic arm. EP2355958 (2011).
[27]
Deguire C. Mechanical finger. CA2765250 (2010).
[28]
Katherine T, Holly Y, David K, Linda B. Development and evaluation of a flexible interface for a wheelchair mounted robotic arm. International Conference on Human Robot Interaction Amsterdam, The Netherlands, March, 2008.
[29]
Su YY. Research on Teaching and Playback Method based on user plan recognition for intelligent wheelchair mounted manipulator. MD Dissertation, Harbin Institute of Technology, Harbin, China, June, 2010.
[30]
Argall BD. Turning assistive machines into assistive robots. Proceedings of SPIE-The International Society for Optical Engineering San Francisco, California, United States, February, 2015.
[31]
Kim DJ, Rebekah HK, Heather CG. How autonomy impacts performance and satisfaction: Results from a study with spinal cord injured subjects using an assistive robot. IEEE T Syst Man Cy-S 2012; 42(1): 2-6.
[32]
Gorsek EJ. Joystick controller. EP0357274 (1990).
[33]
Leung AM. Joystick controller apparatus. US4924216 (1990).
[34]
Paul T. Joystick control device. US11803700 (2008).
[35]
Maheu V, Frappier J, Archambault PS, Routhier F. Evaluation of the JACO robotic arm: Clinico-economic study for powered wheelchair users with upper-extremity disabilities. IEEE International Conference on Rehabilitatin Robotic ETH Zurich Science City, Switzerland, June, 2011
[36]
Jiang HR, Wachs JP, Duerstock BS, Pendergast M. 3D joystick for robotic arm control by individuals with high level spinal cord injuries. IEEE International Conference on Rehabilitation Robotics Seattle, Washington, USA, June, 2013.
[37]
Axel G, Heyer T, Leila F, Lange U, Kampe H. A supportive FRIEND at work: Robotic workplace sssistance for the disabled. IEEE Robot Autom Mag 2013; 20(4): 148-58.
[38]
Ramirez D, Foulds R. Adaptive real-time interfaces for wheelchair-mounted manipulators in unstructured environments. ASME Bioengineering Conference Naples, Florida, USA, June, 2010.
[39]
Dellinger TL. Hand-held trackball computer pointing device. US6816151 (2009).
[40]
Rafael B, Kevin S, Hiroshi H. Determining orientation of a trackball. WO2017028751 (2017).
[41]
Harri JK, Douglas AD. Electronic device with trackball user input. US09362367 (2002).
[42]
Kim DJ, Lovelett R, Behal A. An empirical study with simulated ADL tasks using a vision-guided assistive robot arm. IEEE International Conference on Rehabilitation Robotics Kyoto International Conference Center, Japan, June, 2009.
[43]
Liu SW. On the principles of general user interface design in touch screen. MD Dissertation, Shanghai Jiao Tong University, Shanghai, China, March, 2009.
[44]
Bernd MR. Touch screen controller. US09698848 (2000).
[45]
Liu ZG, Mu W, Tang MC. OGS capacitive touch screen. CN201320220519 (2013).
[46]
Rundel BM. Touch screen controller. WO029573 (2000).
[47]
Cooper RA, Grindle GG, Vazquez JJ, Xu J, Wang H, Candiotti J, et al. Personal mobility and manipulation appliance - design, develop-ment, and initial testing. Proc IEEE 2012; 100(8): 2505-11.
[48]
Wang HW, Grindle GG, Candiotti J, et al. The personal mobility and manipulation of appliance (PerMMA): A robotic wheelchair with advanced mobility and manipulation. 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society San Diego, California, USA, August, 2012.
[49]
Hazlett R, Smith MA, Behal A. Knowledge based design of user interface for operating an assistive robot. Human Centered Design. Springer Berlin Heidelberg. 2011: 304-312.
[50]
Camilo PQ, Oscar R, Martin J. VIBI: Assistive vision- based interface for robot manipulation. IEEE International Conference on Robotics and Automation (ICRA) Seattle, Washington, May, 2015.
[51]
Wang W, Zhang ZM, Suga Y, Iwata H, Sugano S. Intuitive operation of a wheelchair mounted robotic arm for the upper limb disabled: the mouth-only approach. IEEE International Conference on Robotics and Biomimetics Guangzhou, China, December, 2012.
[52]
Andrew C, William K, Utkarsh S, David W. Jamster: A mobile dual-arm assistive robot with Jamboxx control. IEEE International Conference on Automation Science and Engineering Taipei, Taiwan, August, 2014.
[53]
Luo Y, Zhang Y, Hu ZF, Li L, Li M, Xu XD. Humanmachine interaction system and method for intelligent wheelchair based on head movement. CN102048621 (2014).
[54]
Zhang Y, Liu J, Luo Y, Hu HS. Human-machine interaction based on shape of lip for intelligent wheelchair. Control Engineering of China 2013; 20(3): 501-4.
[55]
Zhang Y, Luo MW, Luo Y, Xu XD. Intelligent wheelchair human-machine interaction using α / β wave of EEG. J Huazhong Univ Sci Tech 2013; 41(7): 109-14.
[56]
Gao X, Zhang J, Xu GZ, Wang Q, Fu YQ. Intelligent wheelchair control method and system based on face orientation recognition and tracking. CN105105938 (2015).
[57]
Nolan DA. Wheelchair voice control apparatus. US5812978 (1998).
[58]
Gao X. Research on the speech recognition technology in human computer interaction. MS Dissertation, North China University of Technology, Beijing, China, June 2017.
[59]
Christian M, Oliver P, Axel G. The rehabilitation robots FRIEND-I & II: Daily life independency through semi-autonomous task execution. Rehab Robot 2007: 138-51.
[60]
Birbaumer N. Breaking the silence: Brain-Computer Interfaces (BCI) for communication and motor control. Psychophysiology 2006; 43(6): 517-32.
[61]
He QH. The experimental study on visual evoked potential based brain-computer interface. PhD Dissertation, Chongqing University, Chongqing, China, April 2003.
[62]
Li YQ, Wang HT. Intelligent wheelchair based on multimode brain-machine interface. CN102309380 (2012).
[63]
Meggiolaro MA, Barbosa AOG. Process and device for brain computer interface. US9211078 (2015).
[64]
He QH, Peng CL, Wu BM. Research methods of brain-computer interface technology. J Chongqing Univ 2002; 25(12): 106-9.
[65]
Grigorescu SM, Luth T, Fragkopoulos C, Cyriacks M, Graser A. A BCI-controlled robotic assistant for quad-riplegic people in domestic and professional life. Robotica 2012; 30(3): 419-31.
[66]
Palankar M, Laurentis KJ, Dubey R, Arbel Y, Donchin E. Control of a 9-DoF wheelchair-mounted robotic arm system using a P300 brain computer interface: Initial experiments. IEEE International Conference on Robotics and Biomimetics Bangkok, Thailand, February, 2009.
[67]
Patirage I, Khokar K, Klay E, Alqasemi R, Duby R. A vision based P300 brain computer interface for grasping using a wheelchairmounted robotic arm. IEEE/ASME International Conference on Advanced Intelligent Mechatronics Wollongong, Australia, July, 2013.
[68]
Zhang Y, Xu XD, Luo Y, Xie Y. Intelligent wheel-chair dynamic gesture recognition method based on Kinect depth information. CN103390168 (2017).
[69]
Liu Z, Shang L, Zhang HX, Sun B, Liu HT. Humancomputer interaction method and device based on gesture control. CN201410597981.2 (2014).
[70]
Jiang HR, Wachs JP, Duerstock BS. Integrated vision- based robotic arm interface for operators with upper limb mobility impairments. IEEE International Conference on Rehabilitation Robotics Seattle, Washington, USA, June, 2013.
[71]
Bassily D, Georgoulas C, Guettler J, Linner T. Intuitive and adaptive robotic arm manipulation using the leap motion controller. Isr/Robotik 2014 International Symposium on Robotics Munich, Germany, June, 2014.
[72]
Jain S, Farshchiansadegh A, Broad A, Abdollahi F, Argall B. Assistive robotic manipulation through shared autonomy and a body-machine interface. IEEE International Conference on Rehabilitation Robotics Singapore, August, 2015.
[73]
Wu ZM. The research of low-cost computer-human interaction system based on blinking. MS Dissertation, Wuhan University of Technology, Wuhan, China, April, 2013.
[74]
Song Z, Wu ZM, Nie L. Human-computer interaction method and system based on blinking action. CN201210261379 (2012).
[75]
Fall CL, Turgeon P, Campeaulecours A. Intuitive wireless control of a robotic arm for people living with an upper body disability. IEEE Engineering in Medicine and Biology Society Milan, Italy, August, 2015.
[76]
Fall CL, Gagnon-Turcotte G, Dube JF, Gagne JS, Delisle Y, et al. A wireless sEMG-based body-machine interface for assistive technology devices. IEEE J Biomed Health Inform 2017; 21(4): 967-77.
[77]
Kathryn JDL, Merry LM, Matthew AW, Sravan KE. Hands-free user interface devices. US9241851 (2016).
[78]
Thomas RG, Harry JS. Automatically adapting user interfaces for hands-free interaction. US13250947 (2011).

Rights & Permissions Print Cite
Article Metrics
52
4
1
1
© 2024 Bentham Science Publishers | Privacy Policy