Techniques and Methods to Evaluate Human-Centered Symbiotic AI Systems

Artificial Intelligence (AI) is transforming many fields, enabling enhanced automated decision-making processes and the development of autonomous systems. To design high-quality AI systems, Human-Computer Interaction (HCI) and AI contaminate each other, creating a symbiosis between humans and AI. I am a second-year PhD student in Computer Science with a fellowship in the Future AI Research (FAIR) project. My research project concerns the evaluation of the quality of Symbiotic AI (SAI) systems and, consequently, the definition of an evaluation framework and metrics to evaluate both the human’s and AI system’s performance. This contribution presents a first set of results considering the main opportunities and challenges in this new scenario.