Haptic Feedback Systems for Underwater Teleoperation: A Review of Technologies and Human Factors

S. Ilavarasi, C. S. Madhumathi

Abstract


Underwater teleoperation presents unique challenges where visual feedback is often degraded by turbidity, lighting limitations, and narrow camera fields of view, making haptic feedback essential for effective manipulation and navigation in subsea environments. This comprehensive review examines haptic feedback technologies for underwater remotely operated vehicles (ROVs) and their impact on operator performance through the lens of human factors engineering. We systematically analyze haptic rendering approaches that convey underwater interaction forces to operators including kinesthetic feedback through force-reflecting master devices (impedance control, admittance control), tactile feedback providing surface texture and contact information through vibrotactile arrays or electrotactile stimulation, and proprioceptive feedback enhancing spatial awareness through wearable exoskeletons. The review examines the underwater-specific challenges in haptic teleoperation: significant time delays (100-500ms) from acoustic communication or long tether lengths causing instability in bilateral control, force scaling requirements to map large underwater manipulation forces to comfortable operator interaction forces, and environmental disturbances from currents and vehicle motion that must be distinguished from intentional contact forces. We comprehensively analyze control architectures for bilateral teleoperation including direct force reflection, four-channel architectures separating position and force control, passivity-based approaches guaranteeing stability under arbitrary delays, and wave variable methods transforming energy flow to maintain passivity. Particular emphasis is placed on transparency—the degree to which operators perceive actual environmental impedance—and stability trade-offs, examining how different control architectures perform across the transparency-stability spectrum. The review synthesizes human factors research quantifying haptic feedback benefits for underwater tasks: manipulation studies demonstrating 30-50% reduction in task completion time and 40-60% reduction in contact forces when haptic feedback is available, navigation experiments showing improved obstacle avoidance and spatial awareness, and training studies indicating accelerated skill acquisition with haptic guidance. We analyze perceptual factors including human force discrimination thresholds (approximately 10% Weber fraction), temporal sensitivity to delays (instability perception above 300ms), and multi-modal integration where haptic feedback combined with visual and auditory cues produces superior performance than any single modality. The paper examines haptic device technologies spanning commercial force-feedback joysticks and styluses, custom-designed underwater manipulation interfaces, and emerging wearable haptic systems including gloves with finger-level force feedback and arm exoskeletons for whole-limb kinesthetic display. Application-specific considerations are discussed for different underwater operations: delicate manipulation for biological sampling requiring fine force control, heavy manipulation for subsea construction emphasizing stability under large forces, and inspection tasks where haptic feedback aids in maintaining tool-surface contact. We critically evaluate validation methodologies including laboratory testbeds with hardware-in-the-loop simulation, pool trials with simplified underwater environments, and open-water experiments in operational conditions, identifying gaps between controlled studies and real-world performance. Advanced techniques are reviewed including shared control where autonomous assistance filters operator commands to prevent collisions while preserving haptic transparency, adaptive haptic rendering that adjusts feedback based on task phase and operator skill level, and augmented haptic feedback that enhances or modifies actual forces to improve task performance. Emerging technologies are analyzed including mid-air haptic displays using ultrasound for untethered feedback, soft robotic haptic interfaces conforming to operator anatomy, and neuromorphic haptic processing for ultra-low-latency rendering.

Keywords


haptic feedback, underwater teleoperation, bilateral control, human factors.

References


Akizono, Junichi, Taketsugu Hirabayashi, Takashi Yamamoto, Hiroshi Sakai, Hiroaki Yano, and Masaki Iwasaki. “Teleoperation of Construction Machines with Haptic Information for Underwater Applications”. In Proceedings of the 21st International Symposium on Automation and Robotics in Construction. Jeju, Korea: International Association for Automation and Robotics in Construction (IAARC), 2004. https://doi.org/10.22260/ISARC2004/0059.

Bayraktaroglu, Zeki Y., Omer F. Argin, and Sinan Haliyo. “A Modular Bilateral Haptic Control Framework for Teleoperation of Robots”. Robotica 37, no. 2 (2019): 338–57. https://doi.org/10.1017/S0263574718001042.

Bolopion, Aude, and Stéphane Régnier. “A Review of Haptic Feedback Teleoperation Systems for Micromanipulation and Microassembly”. IEEE Transactions on Automation Science and Engineering 10, no. 3 (2013): 496–502. https://doi.org/10.1109/TASE.2013.2245122.

Gao, Xiao, João Silvério, Sylvain Calinon, Miao Li, and Xiaohui Xiao. “Bilateral Teleoperation with Object-Adaptive Mapping”. Complex & Intelligent Systems 8, no. 4 (1 August 2022): 2983–90. https://doi.org/10.1007/s40747-021-00546-z.

Ghavifekr, Amir Aminzadeh, Amir Rikhtehgar Ghiasi, and Mohammad Ali Badamchizadeh. “Discrete-Time Control of Bilateral Teleoperation Systems: A Review”. Robotica 36, no. 4 (2018): 552–69. https://doi.org/10.1017/S0263574717000583.

Hirabayashi, Taketsugu, Junichi Akizono, Takashi Yamamoto, Hiroshi Sakai, and Hiroaki Yano. “Teleoperation of Construction Machines with Haptic Information for Underwater Applications”. Automation in Construction 15, no. 5 (1 September 2006): 563–70. https://doi.org/10.1016/j.autcon.2005.07.008.

Hirche, Sandra, and Martin Buss. “Human-Oriented Control for Haptic Teleoperation”. Proceedings of the IEEE 100, no. 3 (2012): 623–47. https://doi.org/10.1109/JPROC.2011.2175150.

Muscolo, Giovanni Gerardo, Simone Marcheschi, Marco Fontana, and Massimo Bergamasco. “Dynamics Modeling of Human–Machine Control Interface for Underwater Teleoperation”. Robotica 39, no. 4 (2021): 618–32. https://doi.org/10.1017/S0263574720000624.

Nahri, Syeda Nadiah Fatima, Shengzhi Du, and Barend Jacobus Van Wyk. “A Review on Haptic Bilateral Teleoperation Systems”. Journal of Intelligent & Robotic Systems 104, no. 1 (27 December 2021): 13. https://doi.org/10.1007/s10846-021-01523-x.

Park, Sungman, Yeongyu Park, and Joonbum Bae. “Performance Evaluation of a Tactile and Kinesthetic Finger Feedback System for Teleoperation”. Mechatronics 87 (1 November 2022): 102898. https://doi.org/10.1016/j.mechatronics.2022.102898.

Sivčev, Satja, Joseph Coleman, Edin Omerdić, Gerard Dooly, and Daniel Toal. “Underwater Manipulators: A Review”. Ocean Engineering 163 (1 September 2018): 431–50. https://doi.org/10.1016/j.oceaneng.2018.06.018.

Tavakoli, Mahdi, Arash Aziminejad, Rajni V. Patel, and Mehrdad Moallem. “High-Fidelity Bilateral Teleoperation Systems and the Effect of Multimodal Haptics”. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 37, no. 6 (2007): 1512–28. https://doi.org/10.1109/TSMCB.2007.903700.

Wang, Ting, Yujie Li, Jianjun Zhang, and Yuan Zhang. “A Novel Bilateral Impedance Controls for Underwater Tele-Operation Systems”. Applied Soft Computing 91 (1 June 2020): 106194. https://doi.org/10.1016/j.asoc.2020.106194.

Xia, Pengxiang, Kevin McSweeney, Feng Wen, Zhuoyuan Song, Michael Krieg, Shuai Li, Xiao Yu, Kent Crippen, Jonathan Adams, and Eric Jing Du. Virtual Telepresence for the Future of ROV Teleoperations: Opportunities and Challenges. Vol. SNAME 27th Offshore Symposium. SNAME Offshore Symposium, 02 2022. https://doi.org/10.5957/TOS-2022-015.

Zhang, Dawei, Roberto Tron, and Rebecca P. Khurshid. “Haptic Feedback Improves Human-Robot Agreement and User Satisfaction in Shared-Autonomy Teleoperation”. In 2021 IEEE International Conference on Robotics and Automation (ICRA), 3306–12. IEEE, 2021. https://doi.org/10.1109/icra48506.2021.9560991.

Zhu, Qi, Jing Du, Yangming Shi, and Paul Wei. “Neurobehavioral Assessment of Force Feedback Simulation in Industrial Robotic Teleoperation”. Automation in Construction 126 (1 June 2021): 103674. https://doi.org/10.1016/j.autcon.2021.103674.


Refbacks

  • There are currently no refbacks.




Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.