Interaction Method of Rehabilitation Robot Based on VPE and VEP
DOI:
https://doi.org/10.61173/qv3t5943Keywords:
Telerehabilitation, Master-slave setup, RGB-D camera, Hand exoskeletonAbstract
The development of rehabilitation robots has shown significant potential in improving patient recovery through intelligent interaction mechanisms. The passage introduces two telerehabilitation methods called Vision-based Pose Estimation and Vision-based Environmental Perception. The first method is to apply a non-invasive solution in order to treat upper limbs by wearing a hand exoskeleton with human robot interaction. With a set of master-slave setup, the RGB-D camera captures an image of what operators perform and delivers it to the wearable hand exoskeleton remotely by a bidirectional combination link, while an external sensor records the forces. It is convenient to estimate data and find a better solution. The second method is about an exoskeleton robot that is equipped with the ability of environmental perception. It is surrounded by visional sensors, a control system and critical technologies. Vision-based Pose Estimation (VPE) and Vision-based Environmental Perception (VEP) are testified to be promising in the prospective telerehabilitation robot. This paper aims to provide a new perspective on human-robot interaction in the field of neurorehabilitation.
References
[1] Andrade R L, Figueiredo J, Fonseca P, Vilas-Boas J P, Silva M T, Santos C P. Human-robot joint misalignment, physical interaction, and gait kinematic assessment in ankle-foot orthoses. Sensors, 2023, 24(1): 246.
[2] Wendong W, Hanhao L, Menghan X, Yang C, Xiaoqing Y, Xing M, Bing Z. Design and verification of a human-robot interaction system for upper limb exoskeleton rehabilitation. Medical Engineering & Physics, 2020, 79: 19–25.
[3] Beckerle P, Salvietti G, Unal R, Prattichizzo D, Rossi S, Castellini C, Hirche S, Endo S, Amor H B, Ciocarlie M, Mastrogiovanni F, Argall B D, Bianchi M. A human-robot interaction perspective on assistive and rehabilitation robotics. Frontiers in Neurorobotics, 2017, 11: 24.
[4] Placidi G, Di Matteo A, Lozzi D, Polsinelli M, Theodoridou E. Patient-therapist cooperative hand telerehabilitation through a novel framework involving the virtual glove system. Sensors, 2023, 23(7): 3463.
[5] Dalla Gasperina S, Roveda L, Pedrocchi A, Braghin F, Gandolla M. Review on patient-cooperative control strategies for upper-limb rehabilitation exoskeletons. Frontiers in Robotics and AI, 2021, 8: 745018.
[6] Airò Farulla G, Pianu D, Cempini M, Cortese M, Russo L O, Indaco M, Nerino R, Chimienti A, Oddo C M, Vitiello N. Visionbased pose estimation for robot-mediated hand telerehabilitation. Sensors, 2016, 16(2): 208.
[7] Wang C, Pei Z, Fan Y, Qiu S, Tang Z. Review of visionbased environmental perception for lower-limb exoskeleton robots. Biomimetics, 2024, 9(4): 254.
[8] Sandison M, Phan K, Casas R, Nguyen L, Lum M, Pergami- Peries M, Lum P S. HandMATE: Wearable robotic hand exoskeleton and integrated Android app for at-home stroke rehabilitation. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2020, 4867–4872.
[9] Donati M, Vitiello N, De Rossi S M M, Lenzi T, Crea S, Persichetti A, Giovacchini F, Koopman B, Podobnik J, Munih M, et al. A flexible sensor technology for the distributed measurement of interaction pressure. Sensors, 2013, 13(1): 1021–1045.
[10] Cempini M, Cortese M, Vitiello N. A powered finger–thumb wearable hand exoskeleton with self-aligning joint axes. IEEE/ ASME Transactions on Mechatronics, 2015, 20(3): 705–716.
[11] Krausz N E, Hargrove L J. A survey of teleceptive sensing for wearable assistive robotic devices. Sensors, 2019, 19(23): 5238.
[12] Nelson M, MacIver M A. Sensory acquisition in active sensing systems. Journal of Comparative Physiology A, 2006, 192(6): 573–586.
[13] Zhu X, Li Y, Lu H, Zhang H. Research on vision-based traversable region recognition for mobile robots. Applied Research of Computers, 2012, 29(7): 2009–2013.
[14] Hall D S. High definition lidar system. U.S. Patent EP2041515A4, 2009.
[15] Intel RealSense. LiDAR Camera—Intel RealSense Depth and Tracking Cameras. 2013. https://www.intelrealsense.com/ lidar-camera-l515/
[16] Intel RealSense. Depth Camera D435i—Intel RealSense Depth and Tracking Cameras. 2013. https://www.intelrealsense. com/depth-camera-d435i/
[17] Stereolabs. ZED Mini Stereo Camera. 2002. https://store. stereolabs.com/products/zed-mini
[18] Massalin Y, Abdrakhmanova M, Varol H A. Userindependent intent recognition for lower limb prostheses using depth sensing. IEEE Transactions on Biomedical Engineering, 2018, 65(8): 1759–1770.
[19] Zhu H. Research on terrain recognition of flexible exoskeleton based on computer vision. Wuhan University of Technology, 2020.
[20] Krausz N E, Hargrove L J. A survey of teleceptive sensing for wearable assistive robotic devices. Sensors, 2019, 19(23): 5238.
[21] Zhu H. Research on terrain recognition of flexible exoskeleton based on computer vision. Wuhan: Wuhan University of Technology, 2020.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 by the authors.
This work is licensed under a Creative Commons Attribution 4.0 International License.
