Evaluation of Display Methods for Teleoperation of Road Vehicles
Abstract
During teleoperation of road vehicles, live images from the vehicle are sent to an operator via a cellular connection, who then inputs his control demands. Time delays resulting from signal processing and transmission times can cause instabilities in the control loop and decrease driving performance. To mitigate the negative effects of time delays, predictive displays have long been used in the field of robotics. This paper presents the “Frame Prediction” method for drawing a predictive display for teleoperation of road vehicles. It also shows the results of an experiment in a simulated environment which compared the presented method to 1) driving under the influence of time delays and 2) a display method where the video images are modified as if there was no time delay present. Results revealed that the Frame Prediction method significantly increases driving performance and decreases operator workload for delayed systems. For some scenarios it even supersedes the driving performance without delays.
Full Text:
PDFReferences
Diermeyer, F., Gnatzig, S., Chucholowski, F., et atl., “Der Mensch als Sensor – Der Weg zum teleoperierten Fahren,” KAAET – Automatisierungssysteme, Assistenzsysteme und eingebettete Systeme für Transportmittel: Beiträge zum gleichnamigen 12. Braunschweiger Symposium, 2011.
Gnatzig, S., Chucholowski, F., Tang, T. & Lienkamp, M., “A System Design for Teleoperated Road Vehicles,” 10th International Conference On Informatics In Control, Automation and Robotics ICINCO2013, Vol. 2, July 2013, p. 231-238.
Davis, J., Smyth, C., & McDowell, K., “The Effects of Time Lag on Driving Performance and a Possible Mitigation,” IEEE Transactions on Robotics, 26(3), 2010, p. 590–593. doi:10.1109/TRO.2010.2046695, 2010
Tang, T., Chucholowski, F., Yan, M. & Lienkamp, M., “A novel Study on Data Rate by the Video Transmission for Teleoperated Road Vehicles,” 9th International Conference on Intelligent Unmanned Systems, Jaipur, 2013 (submitted for publication)
Ferrell, W. R. “Remote manipulation with transmission delay,” Technology, 6(February), 1965, p. 24–32.
Cunningham, D. W., Chatziastros, A., Von Der Heyde, M., & Bülthoff, H. H. „Driving in the future: temporal visuomotor adaptation and generalization,” Journal of vision, 1(2), 2001, p. 88–98.
Niemeyer, G. and Slotine, J.-J., “Towards force-reflecting teleoperation over the Internet,” in Proceedings. 1998 IEEE
International Conference on Robotics and Automation (Cat. No.98CH36146), vol. 3, no. May. IEEE, 1998, pp. 1909–1915.
Gnatzig, S.; Schuller, F.; Lienkamp, M.: “Human-machine interaction as key technology for driverless driving - A trajectory-based shared autonomy control approach,” IEEE RO-MAN, 2012The 21st IEEE International Symposium on Robot and Human Interactive Communication, 2012, p. 913-918.
Arnold, J. E. and Braisted, P. W., “Design and evaluation of a predictor for remote control systems operating with signal transmission delays,” NASA, Tech. Rep. December, 1963.
Burkert, T., Leupold, J., and Passig, G., “A Photorealistic Predictive Display,” Presence: Teleoperators and Virtual Environments, vol. 13, no. 1, Feb. 2004, pp. 22–43.
Verplank, W., “Display Aids for Remote Control of Untethered Undersea Vehicles,” in OCEANS ’78. IEEE, 1978, pp. 238–241.
Sullivan, B., Ware, C., and Plumlee, M., “Predictive Displays for Survey Vessels,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 50, no. 22, Oct. 2006, pp. 2424–2428.
Chucholowski, F., Büchner, S., Reicheneder, J., & Lienkamp, M., “Prediction Methods for Teleoperated Road Vehicles.,” Conference on Future Automotive Technology (CoFAT). Garching: Bayern Innovativ GmbH., 2013
Mathan, S., Hyndman, A., Fischer, K., Blatz, J., & Brams, D. “Efficacy of a predictive display, steering device, and vehicle body representation in the operation of a lunar vehicle,” Conference companion on Human factors in computing systems common ground - CHI ’96 (pp. 71–72). New York, New York, USA: ACM Press, 1996. doi:10.1145/257089.257147
Jagersand, M., Rachmielowski, A., Lovi, D., Birkbeck, N., Hernandez-Herdocia, A., Shademan, A. & Yerex, K. “Predictive Display from Computer Vision Models.” The 10th International Symposium on Artificial Intelligence, Robotics and Automation in Space I-SAIRAS 2010, Sapporo, Japan, 2010
DOI: http://dx.doi.org/10.21535%2FProICIUS.2013.v9.213
Refbacks
- There are currently no refbacks.