In the present work, we describe the development of a Facial Expressions Recognition (FER) system able to recognize cognitive emotions in a distance education context. In this case, many research works show that the recognition of basic emotions is not enough and that recognizing emotions more related to the presence/lack of engagement and flow would be more appropriate. Therefore, we developed a FER system able to classify the following cognitive emotions: enthusiasm, interest, surprise, boredom, perplexity, frustration, and the neutral one. After several experiments, we tested which was the best combination of features and the best algorithm for our classification problem. Results show that the combination of Action Units and gaze and a Multiclass Support Vector Machine achieves the best accuracy on the dataset. Results are encouraging and we plan to integrate the system into an e-learning platform to create a more personalized educational environment.

Recognizing Cognitive Emotions in E-Learning Environment

De Carolis B.;D'Errico F.
Methodology
;
Palestra G.
2021-01-01

Abstract

In the present work, we describe the development of a Facial Expressions Recognition (FER) system able to recognize cognitive emotions in a distance education context. In this case, many research works show that the recognition of basic emotions is not enough and that recognizing emotions more related to the presence/lack of engagement and flow would be more appropriate. Therefore, we developed a FER system able to classify the following cognitive emotions: enthusiasm, interest, surprise, boredom, perplexity, frustration, and the neutral one. After several experiments, we tested which was the best combination of features and the best algorithm for our classification problem. Results show that the combination of Action Units and gaze and a Multiclass Support Vector Machine achieves the best accuracy on the dataset. Results are encouraging and we plan to integrate the system into an e-learning platform to create a more personalized educational environment.
2021
9783030674342
9783030674359
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11586/535532
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 8
  • ???jsp.display-item.citation.isi??? ND
social impact