Hostname: page-component-76c49bb84f-rx8cm Total loading time: 0 Render date: 2025-07-04T14:16:16.750Z Has data issue: false hasContentIssue false
  • English
  • Français

Augmented reality projection errors in maritime navigation

Published online by Cambridge University Press:  27 June 2025

Bruno Giordano Leite Open the ORCID record for Bruno Giordano Leite [Opens in a new window] ,
Helio Takahiro Sinohara  and
Eduardo Aoun Tannuri Open the ORCID record for Eduardo Aoun Tannuri [Opens in a new window]
Bruno Giordano Leite*
Affiliation:
Escola Politécnica, Universidade de São Paulo, São Paulo, Brazil
Helio Takahiro Sinohara
Affiliation:
Paranaguá Pilots, Paranaguá, Brazil
Eduardo Aoun Tannuri
Affiliation:
Escola Politécnica, Universidade de São Paulo, São Paulo, Brazil
*
Corresponding author: Bruno Giordano Leite; Email: bruno.giordano.leite@usp.br
Get access Rights & Permissions [Opens in a new window]

Abstract

Augmented reality (AR) is a technology designed to display three-dimensional virtual elements in a real environment. This technology could reduce the cognitive load of marine operators by simplifying information interpretation. However, field tests often reveal qualitative reports of inaccurately projected virtual elements. To address this issue, we present a theoretical model to quantify the error between virtual projections and their observed positions. Numerical simulations, using normal random variables, indicate agreement between the predicted model variance and the error’s standard deviation. Furthermore, a real navigation experiment is conducted where observed errors are inferior to corresponding estimates for error bounds, further indicating the model’s adequacy. The proposed model enables real-time error estimation, system performance prediction and the specification of accuracy requirements. Overall, this study aims to contribute to the systematic definition of accuracy standards for AR-based maritime navigational assistance.

Keywords

e-navigationhuman-computer interface (HCI)modellingnumerical simulationuncertainty

Information

Type
Research Article
Information
The Journal of Navigation , First View , pp. 1 - 20
Check for updates
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of The Royal Institute of Navigation

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Azuma, R. T. (1997). A Survey of Augmented Reality. Presence: Teleoperators & Virtual Environments, 6(4), 355–385.10.1162/pres.1997.6.4.355CrossRefGoogle Scholar
Bauer, M., et al. (2006). Predicting and Estimating the Accuracy of N-Occular Optical Tracking Systems. In 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality, 43–51.10.1109/ISMAR.2006.297793CrossRefGoogle Scholar
Bradski, G. (2000). The OpenCV Library. Dr. Dobb’s Journal of Software Tools.Google Scholar
Bräker, J., Osterbrink, A., Semmann, M. and Wiesche, M. (2023). User-Centered Requirements for Augmented Reality as a Cognitive Assistant for safety-critical services. Business and Information System Engineering, 65, 161–178. https://doi.org/10.1007/s12599-022-00779-3 CrossRefGoogle Scholar
Butkiewicz, T. (2017). Designing Augmented Reality Marine Navigation Aids using Virtual Reality. In OCEANS 2017-Anchorage, Anchorage, AK, USA.Google Scholar
Coelho, E. M., Julier, S. and Maclntyre, B. (2004). Osgar: A scene graph with uncertain transformations. In Third IEEE and ACM International Symposium on Mixed and Augmented Reality, 6–15.10.1109/ISMAR.2004.44CrossRefGoogle Scholar
Davis, L., Clarkson, E. and Rolland, J. P. (2003). Predicting Accuracy in Pose Estimation for Marker-Based Tracking. In The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 28–35.10.1109/ISMAR.2003.1240685CrossRefGoogle Scholar
Freeman, R. M., Julier, S. J. and Steed, A. J. (2007). A Method for Predicting Marker Tracking Error. In 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, 157–160.10.1109/ISMAR.2007.4538841CrossRefGoogle Scholar
Frydenberg, S., Nordby, K. and Eikenes, J. O. (2018). Exploring Designs of Augmented Reality Systems for Ship Bridges in Arctic Waters. In RINA, Human Factors 2018. Royal Institution of Naval Architects.Google Scholar
Furuno. (2024). FURUNO ENVISION AR Navigation System | FURUNO. https://www.furuno.com/special/en/envision/. Accessed 16 December 2024.Google Scholar
Gao, X. S., Hou, X. R., Tang, J. and Cheng, H. F. (2003). Complete Solution Classification for the Perspective-Three-Point Problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(8), 930–943.Google Scholar
Groves, P. (2013). Principles of GNSS, Inertial, and Multisensor Integrated Navigation Systems, Second Edition, Artech.Google Scholar
Hartley, R. and Zisserman, A. (2003). Multiple View Geometry in Computer Vision. Cambridge University Press.Google Scholar
Hertel, J., Schmidt, S., Briede, M., Anders, O., Thies, T. and Steinicke, F. (2023). Welcome AboARd! Evaluating Augmented Reality as a Skipper’s Navigator. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Sydney, Australia.10.1109/ISMAR59233.2023.00035CrossRefGoogle Scholar
Holloway, R. L. (1997). Registration Error Analysis for Augmented Reality. Presence: Teleoperators and Virtual Environments, 6(4), 413–432. https://doi.org/10.1162/pres.1997.6.4.413 CrossRefGoogle Scholar
Hong, T. C., Andrew, H. S. Y. and Kenny, C. W. L. (2015). Assessing the Situation Awareness of Operators Using Maritime Augmented Reality System (MARS). Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59(1), Los Angeles, CA. https://doi.org/10.1177/1541931215591372 CrossRefGoogle Scholar
Hughes, C. L., Fidopiastis, C., Stanney, K. M., Bailey, P. S. and Ruiz, E. (2020). The Psychometrics of Cybersickness in Augmented Reality. Frontiers in Virtual Reality, 1, 602954.CrossRefGoogle Scholar
Jaeyong, O. H., Park, S. and Kwon, O. S. (2016). Advanced Navigation Aids System based on Augmented Reality. International Journal of e-Navigation and Maritime Economy, 5, 21–31.Google Scholar
Kannala, J. and Brandt, S. S. (2006). A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(8), 1335–1340.10.1109/TPAMI.2006.153CrossRefGoogle ScholarPubMed
Ke, T. and Roumeliotis, S. (2017). An Efficient Algebraic Solution to the Perspective-Three-Point Problem. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.491CrossRefGoogle Scholar
Laera, F., Fiorentino, M., Evangelista, A., Boccaccio, A., Manghisi, V. M., Gabbard, J., Gattullo, M., Uva, A. E. and Foglia, M. M. (2021) Augmented Reality for Maritime Navigation Data Visualisation: A Systematic Review, Issues and Perspectives. Journal of Navigation, 74(5), 1073–1090. https://doi.org/10.1017/S0373463321000412 CrossRefGoogle Scholar
Laera, F., Manghisi, V. M., Evangelista, A., Foglia, M. M., and Fiorentino, M. (2021). Augmented reality interface for sailing navigation: a user study for wind representation. In 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Held 4–8 October 2021, Virtual Conference.10.1109/ISMAR-Adjunct54149.2021.00060CrossRefGoogle Scholar
Lee, J. M., Lee, K. H., Nam, B., and Wu, Y. (2016). Study on Image-Based Ship Detection for AR Navigation. In 2016 6th International Conference on IT Convergence and Security (ICITCS), Prague, Czech Republic. 10.1109/ICITCS.2016.7740373CrossRefGoogle Scholar
Leite, B. G., Sinohara, H. T., Maruyama, N. and Tannuri, E. A. (2022). Maritime Navigational Assistance by Visual Augmentation. The Journal of Navigation, 75(1), 57–75.10.1017/S0373463321000795CrossRefGoogle Scholar
Lepetit, V., Moreno-Noguer, F. and Fua, P. (2009). Epnp: An Accurate O(n) Solution to the PNP Problem. International Journal of Computer Vision, 81(2), 155–166.10.1007/s11263-008-0152-6CrossRefGoogle Scholar
Microsoft. (2024). Microsoft HoloLens | Mixed Reality Technology for Business. https://www.microsoft.com/en-us/hololens/. Accessed 09 April 2024.Google Scholar
Morgère, J. C., Diguet, J. P. and Laurent, J. (2014). Mobile Augmented Reality System for Marine Navigation Assistance. In: 2014 12th IEEE International Conference on Embedded and Ubiquitous Computing, Milano, Italy.Google Scholar
Okazaki, T., Takaseki, R., Shoji, R. and Matsubara, K. (2017). Development of Sea Route Display System by using Augmented Reality. In 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, Alberta, Canada.10.1109/SMC.2017.8123156CrossRefGoogle Scholar
Porcino, T., Trevisan, D. and Clua, E. (2020). Minimizing Cybersickness in Head-Mounted Display Systems: Causes and Strategies Review. In 2020 22nd Symposium on Virtual and Augmented Reality (SVR), Porto de Galinhas, Brazil.10.1109/SVR51698.2020.00035CrossRefGoogle Scholar
Raymarine. (2024). Augmented Reality Marine Cameras | Raymarine. https://www.raymarine.com/en-us/our-products/marine-cameras/augmented-reality. Accessed 16 December 2024.Google Scholar
Van Den Oever, F., Fjeld, M. and Sætrevik, B. (2023). A Systematic Literature Review of Augmented Reality for Maritime Collaboration. International Journal of Human–Computer Interaction, 40 (15), 1–16. https://doi.org/10.1080/10447318.2023.2209838 Google Scholar
Wisernig, E., Sadhu, T., Zilinski, C., Wyvill, B., Albu, A. B. and Hoeberechts, M. (2015). Augmented reality visualization for sailboats (ARVS). In 2015 International Conference on Cyberworlds (CW), Visby, Sweden.10.1109/CW.2015.74CrossRefGoogle Scholar
Zalewski, P., Bąk, A. and Bergmann, M. (2022) Evolution of Maritime GNSS and RNSS Performance Standards. Remote Sensing, 14(21), 5291. https://doi.org/10.3390/rs14215291 CrossRefGoogle Scholar
Zhang, Z. (2000). A Flexible New Technique for Camera Calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11), 1330–1334.10.1109/34.888718CrossRefGoogle Scholar