Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing

Philipp Haindl; Thomas Hoch; Javier Dominguez; Julen Aperribai; Nazim Kemal Ure; Mehmet Tunçel

doi:10.1007/978-3-031-14179-9_1

Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing

Philipp Haindl^*, Thomas Hoch, Javier Dominguez, Julen Aperribai, Nazim Kemal Ure, Mehmet Tunçel

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Citations (Scopus)

Abstract

As AI-enabled software systems become more prevalent in smart manufacturing, their role shifts from a reactive to a proactive one that provides context-specific support to machine operators. In the context of an international research project, we develop an AI-based software platform that shall facilitate the collaboration between human operators and manufacturing machines. We conducted 14 structured interviews with stakeholders of the prospective software platform in order to determine the individual relevance of selected quality characteristics for human-AI teaming in smart manufacturing. These characteristics include the ISO 25010:2011 standard for software quality and AI-specific quality characteristics such as trustworthiness, explicability, and auditability. The interviewees rated trustworthiness, functional suitability, reliability, and security as the most important quality characteristics for this context, and portability, compatibility, and maintainability as the least important. Also, we observed agreement regarding the relevance of the quality characteristics among interviewees having the same role. On the other hand, the relevance of each quality characteristics varied depending on the concrete use case of the prospective software platform. The interviewees also were asked about the key success factors related to human-AI teaming in smart manufacturing. They identified improving the production cycle, increasing operator efficiency, reducing scrap, and reducing ergonomic risks as key success criteria. In this paper, we also discuss metrics for measuring the fulfillment of these quality characteristics, which we intend to operationalize and monitor during operation of the prospective software platform.

Original language	English
Title of host publication	Quality of Information and Communications Technology - 15th International Conference, QUATIC 2022, Proceedings
Editors	Antonio Vallecillo, Joost Visser, Ricardo Pérez-Castillo
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	3-17
Number of pages	15
ISBN (Print)	9783031141782
DOIs	https://doi.org/10.1007/978-3-031-14179-9_1
Publication status	Published - 2022
Event	15th International Conference on the Quality of Information and Communications Technology, QUATIC 2022 - Talavera de la Reina, Spain Duration: 12 Sept 2022 → 14 Sept 2022

Publication series

Name	Communications in Computer and Information Science
Volume	1621 CCIS
ISSN (Print)	1865-0929
ISSN (Electronic)	1865-0937

Conference

Conference	15th International Conference on the Quality of Information and Communications Technology, QUATIC 2022
Country/Territory	Spain
City	Talavera de la Reina
Period	12/09/22 → 14/09/22

Bibliographical note

Publisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Funding

Acknowledgements. This project has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under grant agreement number 957402.

Funders	Funder number
Horizon 2020 Framework Programme	957402

Keywords

Auditability
Explicability
Human-AI teaming
Quality characteristics
Smart manufacturing
Trustworthiness

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1007/978-3-031-14179-9_1

Cite this

Haindl, P., Hoch, T., Dominguez, J., Aperribai, J., Ure, N. K., & Tunçel, M. (2022). Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing. In A. Vallecillo, J. Visser, & R. Pérez-Castillo (Eds.), Quality of Information and Communications Technology - 15th International Conference, QUATIC 2022, Proceedings (pp. 3-17). (Communications in Computer and Information Science; Vol. 1621 CCIS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-14179-9_1

Haindl, Philipp ; Hoch, Thomas ; Dominguez, Javier et al. / Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing. Quality of Information and Communications Technology - 15th International Conference, QUATIC 2022, Proceedings. editor / Antonio Vallecillo ; Joost Visser ; Ricardo Pérez-Castillo. Springer Science and Business Media Deutschland GmbH, 2022. pp. 3-17 (Communications in Computer and Information Science).

@inproceedings{430f2d4b61a84986b75e37229f5e909c,

title = "Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing",

abstract = "As AI-enabled software systems become more prevalent in smart manufacturing, their role shifts from a reactive to a proactive one that provides context-specific support to machine operators. In the context of an international research project, we develop an AI-based software platform that shall facilitate the collaboration between human operators and manufacturing machines. We conducted 14 structured interviews with stakeholders of the prospective software platform in order to determine the individual relevance of selected quality characteristics for human-AI teaming in smart manufacturing. These characteristics include the ISO 25010:2011 standard for software quality and AI-specific quality characteristics such as trustworthiness, explicability, and auditability. The interviewees rated trustworthiness, functional suitability, reliability, and security as the most important quality characteristics for this context, and portability, compatibility, and maintainability as the least important. Also, we observed agreement regarding the relevance of the quality characteristics among interviewees having the same role. On the other hand, the relevance of each quality characteristics varied depending on the concrete use case of the prospective software platform. The interviewees also were asked about the key success factors related to human-AI teaming in smart manufacturing. They identified improving the production cycle, increasing operator efficiency, reducing scrap, and reducing ergonomic risks as key success criteria. In this paper, we also discuss metrics for measuring the fulfillment of these quality characteristics, which we intend to operationalize and monitor during operation of the prospective software platform.",

keywords = "Auditability, Explicability, Human-AI teaming, Quality characteristics, Smart manufacturing, Trustworthiness",

author = "Philipp Haindl and Thomas Hoch and Javier Dominguez and Julen Aperribai and Ure, \{Nazim Kemal\} and Mehmet Tun{\c c}el",

note = "Publisher Copyright: {\textcopyright} 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 15th International Conference on the Quality of Information and Communications Technology, QUATIC 2022 ; Conference date: 12-09-2022 Through 14-09-2022",

year = "2022",

doi = "10.1007/978-3-031-14179-9\_1",

language = "English",

isbn = "9783031141782",

series = "Communications in Computer and Information Science",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "3--17",

editor = "Antonio Vallecillo and Joost Visser and Ricardo P{\'e}rez-Castillo",

booktitle = "Quality of Information and Communications Technology - 15th International Conference, QUATIC 2022, Proceedings",

address = "Germany",

}

Haindl, P, Hoch, T, Dominguez, J, Aperribai, J, Ure, NK & Tunçel, M 2022, Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing. in A Vallecillo, J Visser & R Pérez-Castillo (eds), Quality of Information and Communications Technology - 15th International Conference, QUATIC 2022, Proceedings. Communications in Computer and Information Science, vol. 1621 CCIS, Springer Science and Business Media Deutschland GmbH, pp. 3-17, 15th International Conference on the Quality of Information and Communications Technology, QUATIC 2022, Talavera de la Reina, Spain, 12/09/22. https://doi.org/10.1007/978-3-031-14179-9_1

Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing. / Haindl, Philipp; Hoch, Thomas; Dominguez, Javier et al.
Quality of Information and Communications Technology - 15th International Conference, QUATIC 2022, Proceedings. ed. / Antonio Vallecillo; Joost Visser; Ricardo Pérez-Castillo. Springer Science and Business Media Deutschland GmbH, 2022. p. 3-17 (Communications in Computer and Information Science; Vol. 1621 CCIS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing

AU - Haindl, Philipp

AU - Hoch, Thomas

AU - Dominguez, Javier

AU - Aperribai, Julen

AU - Ure, Nazim Kemal

AU - Tunçel, Mehmet

PY - 2022

Y1 - 2022

N2 - As AI-enabled software systems become more prevalent in smart manufacturing, their role shifts from a reactive to a proactive one that provides context-specific support to machine operators. In the context of an international research project, we develop an AI-based software platform that shall facilitate the collaboration between human operators and manufacturing machines. We conducted 14 structured interviews with stakeholders of the prospective software platform in order to determine the individual relevance of selected quality characteristics for human-AI teaming in smart manufacturing. These characteristics include the ISO 25010:2011 standard for software quality and AI-specific quality characteristics such as trustworthiness, explicability, and auditability. The interviewees rated trustworthiness, functional suitability, reliability, and security as the most important quality characteristics for this context, and portability, compatibility, and maintainability as the least important. Also, we observed agreement regarding the relevance of the quality characteristics among interviewees having the same role. On the other hand, the relevance of each quality characteristics varied depending on the concrete use case of the prospective software platform. The interviewees also were asked about the key success factors related to human-AI teaming in smart manufacturing. They identified improving the production cycle, increasing operator efficiency, reducing scrap, and reducing ergonomic risks as key success criteria. In this paper, we also discuss metrics for measuring the fulfillment of these quality characteristics, which we intend to operationalize and monitor during operation of the prospective software platform.

AB - As AI-enabled software systems become more prevalent in smart manufacturing, their role shifts from a reactive to a proactive one that provides context-specific support to machine operators. In the context of an international research project, we develop an AI-based software platform that shall facilitate the collaboration between human operators and manufacturing machines. We conducted 14 structured interviews with stakeholders of the prospective software platform in order to determine the individual relevance of selected quality characteristics for human-AI teaming in smart manufacturing. These characteristics include the ISO 25010:2011 standard for software quality and AI-specific quality characteristics such as trustworthiness, explicability, and auditability. The interviewees rated trustworthiness, functional suitability, reliability, and security as the most important quality characteristics for this context, and portability, compatibility, and maintainability as the least important. Also, we observed agreement regarding the relevance of the quality characteristics among interviewees having the same role. On the other hand, the relevance of each quality characteristics varied depending on the concrete use case of the prospective software platform. The interviewees also were asked about the key success factors related to human-AI teaming in smart manufacturing. They identified improving the production cycle, increasing operator efficiency, reducing scrap, and reducing ergonomic risks as key success criteria. In this paper, we also discuss metrics for measuring the fulfillment of these quality characteristics, which we intend to operationalize and monitor during operation of the prospective software platform.

KW - Auditability

KW - Explicability

KW - Human-AI teaming

KW - Quality characteristics

KW - Smart manufacturing

KW - Trustworthiness

UR - http://www.scopus.com/inward/record.url?scp=85137997504&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-14179-9_1

DO - 10.1007/978-3-031-14179-9_1

M3 - Conference contribution

AN - SCOPUS:85137997504

SN - 9783031141782

T3 - Communications in Computer and Information Science

SP - 3

EP - 17

BT - Quality of Information and Communications Technology - 15th International Conference, QUATIC 2022, Proceedings

A2 - Vallecillo, Antonio

A2 - Visser, Joost

A2 - Pérez-Castillo, Ricardo

PB - Springer Science and Business Media Deutschland GmbH

T2 - 15th International Conference on the Quality of Information and Communications Technology, QUATIC 2022

Y2 - 12 September 2022 through 14 September 2022

ER -

Haindl P, Hoch T, Dominguez J, Aperribai J, Ure NK , Tunçel M. Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing. In Vallecillo A, Visser J, Pérez-Castillo R, editors, Quality of Information and Communications Technology - 15th International Conference, QUATIC 2022, Proceedings. Springer Science and Business Media Deutschland GmbH. 2022. p. 3-17. (Communications in Computer and Information Science). doi: 10.1007/978-3-031-14179-9_1