Innovative ideas for the use of augmented reality devices in aerodrome control towers

Innovative ideas for the use of augmented reality devices in aerodrome control towers

Jürgen Teutsch

Abstract. In recent years Augmented Reality (AR) has become one of the major focus points of user interface development. With the rapidly increasing computing power and developments in software and hardware applications during the last two decades, it has moved from theoretical approaches towards industry-wide application and mass production. The Royal Netherlands Aerospace Centre, NLR, tested several devices in the past, but only recent developments made it possible to effectively use them in an Air Traffic Control (ATC) working environment for Aerodrome Control Towers. In 2021 NLR carried out innovative technology experiments on their high-fidelity real-time air traffic control simulation and validation platform, NARSIM. These experiments were part of the SESAR 2020 project Digital Technologies for Tower (DTT) and focused on advanced HMI interaction modes for aerodrome tower controllers. A proposed Attention Capturing and Guidance concept with an AR device was evaluated inside an aerodrome control tower environment for Amsterdam Airport Schiphol. This paper reflects on the technology development activities that took place at NLR during the last decade and describes the different steps taken to apply the technology in a conventional control tower environment. It is shown that the recent technology developments must be seen as a big step forward in practical application of AR devices for ATC. Furthermore, an outlook into the expected future use of AR devices in conventional control tower environments will be given that goes beyond abovementioned concept elements. This outlook considers additional developments for standardization of digitized airport information and communication between different stakeholders and general performance improvements for AR devices.

Keywords
Augmented Reality, Air Traffic Control, Aerodrome Control Tower, Attention Guidance, Human Machine Interface, SESAR, NARSIM

Published online 11/1/2023, 4 pages
Copyright © 2023 by the author(s)
Published under license by Materials Research Forum LLC., Millersville PA, USA

Citation: Jürgen Teutsch, Innovative ideas for the use of augmented reality devices in aerodrome control towers, Materials Research Proceedings, Vol. 37, pp 763-766, 2023

DOI: https://doi.org/10.21741/9781644902813-163

The article was published as article 163 of the book Aeronautics and Astronautics

Content from this work may be used under the terms of the Creative Commons Attribution 3.0 license. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.

References
[1] R.B. Wood, P.J. Howells, Head-up Display, in: C.R. Spitzer, U. Ferrell, T. Ferrell (Eds.), Digital Avionics Handbook, third edition, CRC Press, Taylor & Francis Group, Boca Raton (FL), 2015, pp. 17-1 to 17-27. https://doi.org/10.1201/b17545
[2] S. Park, S. Bokijonov, Y. Choi, Review of Microsoft HoloLens Applications over the Past Five Years, Applied Sciences, 2021; 11(16):7259. https://doi.org/10.3390/app11167259
[3] CORDIS EU Research Results, PJ05-W2 Digital Technologies for Tower, European Commission Website, Brussels, 2023. https://doi.org/10.3030/874470
[4] J. Teutsch, T.J.J. Bos, G.D.R. Zon, Appendix A – Technological Validation Exercise 001 Report, in: SESAR 2020 PJ.05-W2 Sol. 97.1 and Sol. 97.2 TVALR, TRL4 Data Pack, Deliverable D3.1.050, SESAR-JU, Brussels, 2023. https://doi.org/10.3030/874470
[5] J. Teutsch, T.J.J. Bos, M.C. van Apeldoorn and L. Camara, Attention Guidance for Tower ATC Using Augmented Reality Devices, 2022 Integrated Communication, Navigation and Surveillance Conference (ICNS), Dulles/Herndon, VA, USA, 2022, pp. 1-12. https://doi.org/10.1109/ICNS54818.2022.9771479
[6] R. Santarelli, S. Bagassi, J. Teutsch, R. Garcia Lasheras et al., Towards a digital control tower: the use of augmented reality tools to innovate interaction modes, SESAR Innovation Days (SID) 2022, SESAR-JU, Brussels, 2022
[7] P. Ortner, R. Steinhöfler, E. Leitgeb and H. Flühr, Augmented Air Traffic Control System – Artificial Intelligence as Digital Assistance System to Predict Air Traffic Conflicts, AI Journal, MDPI, 2022, 3(3), 623-644. https://doi.org/10.3390/ai3030036
[8] European Aviation Artificial Intelligence High Level Group, The Fly AI Report – Demystifying and Accelerating AI in Aviation/ATM, EUROCONTROL, Brussels, 2020.