Preliminary experimental results on a multidimensional model for cognitive assistance systems in manufacturing

Preliminary experimental results on a multidimensional model for cognitive assistance systems in manufacturing

BARTOLOMEI Mirco, BARRAVECCHIA Federico, REA Maria, MASTROGIACOMO Luca, CANNIZZARO Davide, FRANCESCHINI Fiorenzo

Abstract. Cognitive assistance systems aim to enhance cognitive ergonomics by supporting operators in decision-making and task execution, addressing the high demands imposed by modern manufacturing processes. Existing frameworks for characterising cognitive assistance systems are fragmented, lacking a systematic approach to define and evaluate their constituent features. To address this gap, a multidimensional conceptual model is proposed, encompassing five core dimensions: cognitive functions, autonomy, adaptivity, interaction modality, and portability. A case study is conducted to preliminarily verify the model’s applicability by analyzing how variations in these core dimensions influence cognitive load, number of failures, and cycle time. Overall, the study provides two main contributions: (i) a multidimensional conceptual model to bridge the gap in the characterisation of cognitive assistance systems, and (ii) some preliminary findings from a case study in the context of Human-Robot Collaboration (HRC).

Keywords
Human Robot Collaboration, Ergonomics, Quality Engineering

Published online 9/10/2025, 9 pages
Copyright © 2025 by the author(s)
Published under license by Materials Research Forum LLC., Millersville PA, USA

Citation: BARTOLOMEI Mirco, BARRAVECCHIA Federico, REA Maria, MASTROGIACOMO Luca, CANNIZZARO Davide, FRANCESCHINI Fiorenzo, Preliminary experimental results on a multidimensional model for cognitive assistance systems in manufacturing, Materials Research Proceedings, Vol. 57, pp 29-37, 2025

DOI: https://doi.org/10.21741/9781644903735-4

The article was published as article 4 of the book Italian Manufacturing Association Conference

Content from this work may be used under the terms of the Creative Commons Attribution 3.0 license. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.

References
[1] Barravecchia F, Bartolomei M, Mastrogiacomo L, Franceschini F. Redefining Human-Robot Symbiosis: a bio-inspired approach to collaborative assembly. International Journal of Advanced Manufacturing Technology 2023;128:2043-2058. https://doi.org/10.1007/s00170-023-11920-1
[2] Bartolomei M, Barravecchia F, Mastrogiacomo L, Gatta DM, Franceschini F. Streamlining Assembly Instruction Design (S-AID): A comprehensive systematic framework. Computers in Industry 2025;165:104232. https://doi.org/10.1016/j.compind.2024.104232
[3] Eversberg L, Ebrahimi P, Pape M, Lambrecht J. A cognitive assistance system with augmented reality for manual repair tasks with high variability based on the digital twin. Manufacturing Letters 2022;34:49-52. https://doi.org/10.1016/j.mfglet.2022.09.003
[4] Mark BG, Rauch E, Matt DT. Worker assistance systems in manufacturing: A review of the state of the art and future directions. Journal of Manufacturing Systems 2021;59:228-250. https://doi.org/10.1016/j.jmsy.2021.02.017
[5] Leins N, Gonnermann-Müller J, Teichmann M. Comparing head-mounted and handheld augmented reality for guided assembly. Journal on Multimodal User Interfaces 2024;18:313-328. https://doi.org/10.1007/s12193-024-00440-1
[6] Funk M, Heusler J, Akcay E, Weiland K, Schmidt A. Haptic, Auditory, or Visual? Towards Optimal Error Feedback at Manual Assembly Workplaces. Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, New York, NY, USA; 2016. https://doi.org/10.1145/2910674.2910683
[7] Cai H, Lin Y. Coordinating Cognitive Assistance With Cognitive Engagement Control Approaches in Human-Machine Collaboration. IEEE Transactions on Systems, Man, and Cybernetics – Part A: Systems and Humans 2012;42:286-294. https://doi.org/10.1109/TSMCA.2011.2169953
[8] Stoessel Christian and Wiesbeck M and SS and ZMF and SA. Towards Optimal Worker Assistance: Investigating Cognitive Processes in Manual Assembly. Manufacturing Systems and Technologies for the New Frontier, 2008, p. 245-250. https://doi.org/10.1007/978-1-84800-267-8_50
[9] Preum SM, Munir S, Ma M, Yasar MS, Stone DJ, Williams R, et al. A Review of Cognitive Assistants for Healthcare: Trends, Prospects, and Future Directions. ACM Computer Surveis 2021;53:130. https://doi.org/10.1145/3419368
[10] Angulo C, Chacón A, Ponsa P. Towards a cognitive assistant supporting human operators in the Artificial Intelligence of Things. Internet of Things 2023;21:100673. https://doi.org/10.1016/j.iot.2022.100673
[11] Sochor R, Kraus L, Merkel L, Braunreuther S, Reinhart G. Approach to increase worker acceptance of cognitive assistance systems in manual assembly. Procedia CIRP, vol. 81, 2019, p. 926 – 931. https://doi.org/10.1016/j.procir.2019.03.229
[12] Parasuraman R, Sheridan TB, Wickens CD. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans 2000;30. https://doi.org/10.1109/3468.844354
[13] Wickens CD, Carswell CM. INFORMATION PROCESSING. HANDBOOK OF HUMAN FACTORS AND ERGONOMICS, John Wiley & Sons, Ltd; 2021, p. 114-158. https://doi.org/10.1002/9781119636113.ch5
[14] O’Neill T, McNeese N, Barron A, Schelble B. Human-Autonomy Teaming: A Review and Analysis of the Empirical Literature. Human Factors 2022;64:904-938. https://doi.org/10.1177/0018720820960865
[15] Bernabei M, Costantino F. Adaptive automation: Status of research and future challenges. Robotics and Computer-Integrated Manufacturing 2024;88:102724. https://doi.org/10.1016/j.rcim.2024.102724
[16] van Erp JBF, Toet A, Janssen JB. Uni-, bi- and tri-modal warning signals: Effects of temporal parameters and sensory modality on perceived urgency. Safety Science 2015;72:1-8. https://doi.org/10.1016/j.ssci.2014.07.022
[17] RealWear: Navigator520 device, https://www.realwear.com/devices/navigator-520.
[18] Capponi M, Gervasi R, Mastrogiacomo L, Franceschini F. Assembly complexity and physiological response in human-robot collaboration: Insights from a preliminary experimental analysis. Robotics and Computer-Integrated Manufacturing 2024;89:102789 https://doi.org/10.1016/j.rcim.2024.102789
[19] Kutner MH, Nachtsheim CJ, Neter J. Applied Linear Statistical Models. 5th ed. New York: 2005.