Hybrid affective computing—keyboard, mouse and touch screen: from review to experiment

Kaveh Bakhtiyari, Mona Taghavi, Hafizah Husain

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Emotions play an important role in human interactions. They can be integrated into the computer system to make human–computer interaction (HCI) more effective. Affective computing is an innovative computational modeling and detecting user’s emotions to optimize system responses in HCI. However, there is a trade-off between recognition accuracy and real-time performance in some of the methods such as processing the facial expressions, human voice and body gestures. Other methods lack efficiency and usability in real-world applications such as natural language processing and electroencephalography signals. To accomplish a reliable, usable and high-performance system, this paper proposes an intelligent hybrid approach to recognize users’ emotions by using easily accessible and low computational cost input devices including keyboard, mouse (touch pad: single touch) and touch screen display (single touch). Using the proposed approach, the system is developed and trained in a supervised mode by artificial neural network and support vector machine (SVM) techniques. The result shows an increase in accuracy of 6 % (93.20 %) by SVM in comparison with the currently existing methods. It is a significant contribution to show new directions of future research in emotion recognition, user modeling and emotional intelligence.

Original languageEnglish
Pages (from-to)1277-1296
Number of pages20
JournalNeural Computing and Applications
Volume26
Issue number6
DOIs
Publication statusPublished - 27 Dec 2014

Fingerprint

Touch screens
Support vector machines
Processing
Electroencephalography
Computer systems
Experiments
Display devices
Neural networks
Costs

Keywords

  • Affective computing
  • Human emotion recognition
  • Human–computer interaction (HCI)
  • Keyboard keystroke dynamics
  • Mouse touch pad movement
  • Touch screen monitor

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software

Cite this

Hybrid affective computing—keyboard, mouse and touch screen : from review to experiment. / Bakhtiyari, Kaveh; Taghavi, Mona; Husain, Hafizah.

In: Neural Computing and Applications, Vol. 26, No. 6, 27.12.2014, p. 1277-1296.

Research output: Contribution to journalArticle

Bakhtiyari, Kaveh ; Taghavi, Mona ; Husain, Hafizah. / Hybrid affective computing—keyboard, mouse and touch screen : from review to experiment. In: Neural Computing and Applications. 2014 ; Vol. 26, No. 6. pp. 1277-1296.
@article{7566182fb3014337b502cf356256689f,
title = "Hybrid affective computing—keyboard, mouse and touch screen: from review to experiment",
abstract = "Emotions play an important role in human interactions. They can be integrated into the computer system to make human–computer interaction (HCI) more effective. Affective computing is an innovative computational modeling and detecting user’s emotions to optimize system responses in HCI. However, there is a trade-off between recognition accuracy and real-time performance in some of the methods such as processing the facial expressions, human voice and body gestures. Other methods lack efficiency and usability in real-world applications such as natural language processing and electroencephalography signals. To accomplish a reliable, usable and high-performance system, this paper proposes an intelligent hybrid approach to recognize users’ emotions by using easily accessible and low computational cost input devices including keyboard, mouse (touch pad: single touch) and touch screen display (single touch). Using the proposed approach, the system is developed and trained in a supervised mode by artificial neural network and support vector machine (SVM) techniques. The result shows an increase in accuracy of 6 {\%} (93.20 {\%}) by SVM in comparison with the currently existing methods. It is a significant contribution to show new directions of future research in emotion recognition, user modeling and emotional intelligence.",
keywords = "Affective computing, Human emotion recognition, Human–computer interaction (HCI), Keyboard keystroke dynamics, Mouse touch pad movement, Touch screen monitor",
author = "Kaveh Bakhtiyari and Mona Taghavi and Hafizah Husain",
year = "2014",
month = "12",
day = "27",
doi = "10.1007/s00521-014-1790-y",
language = "English",
volume = "26",
pages = "1277--1296",
journal = "Neural Computing and Applications",
issn = "0941-0643",
publisher = "Springer London",
number = "6",

}

TY - JOUR

T1 - Hybrid affective computing—keyboard, mouse and touch screen

T2 - from review to experiment

AU - Bakhtiyari, Kaveh

AU - Taghavi, Mona

AU - Husain, Hafizah

PY - 2014/12/27

Y1 - 2014/12/27

N2 - Emotions play an important role in human interactions. They can be integrated into the computer system to make human–computer interaction (HCI) more effective. Affective computing is an innovative computational modeling and detecting user’s emotions to optimize system responses in HCI. However, there is a trade-off between recognition accuracy and real-time performance in some of the methods such as processing the facial expressions, human voice and body gestures. Other methods lack efficiency and usability in real-world applications such as natural language processing and electroencephalography signals. To accomplish a reliable, usable and high-performance system, this paper proposes an intelligent hybrid approach to recognize users’ emotions by using easily accessible and low computational cost input devices including keyboard, mouse (touch pad: single touch) and touch screen display (single touch). Using the proposed approach, the system is developed and trained in a supervised mode by artificial neural network and support vector machine (SVM) techniques. The result shows an increase in accuracy of 6 % (93.20 %) by SVM in comparison with the currently existing methods. It is a significant contribution to show new directions of future research in emotion recognition, user modeling and emotional intelligence.

AB - Emotions play an important role in human interactions. They can be integrated into the computer system to make human–computer interaction (HCI) more effective. Affective computing is an innovative computational modeling and detecting user’s emotions to optimize system responses in HCI. However, there is a trade-off between recognition accuracy and real-time performance in some of the methods such as processing the facial expressions, human voice and body gestures. Other methods lack efficiency and usability in real-world applications such as natural language processing and electroencephalography signals. To accomplish a reliable, usable and high-performance system, this paper proposes an intelligent hybrid approach to recognize users’ emotions by using easily accessible and low computational cost input devices including keyboard, mouse (touch pad: single touch) and touch screen display (single touch). Using the proposed approach, the system is developed and trained in a supervised mode by artificial neural network and support vector machine (SVM) techniques. The result shows an increase in accuracy of 6 % (93.20 %) by SVM in comparison with the currently existing methods. It is a significant contribution to show new directions of future research in emotion recognition, user modeling and emotional intelligence.

KW - Affective computing

KW - Human emotion recognition

KW - Human–computer interaction (HCI)

KW - Keyboard keystroke dynamics

KW - Mouse touch pad movement

KW - Touch screen monitor

UR - http://www.scopus.com/inward/record.url?scp=84937966050&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84937966050&partnerID=8YFLogxK

U2 - 10.1007/s00521-014-1790-y

DO - 10.1007/s00521-014-1790-y

M3 - Article

AN - SCOPUS:84937966050

VL - 26

SP - 1277

EP - 1296

JO - Neural Computing and Applications

JF - Neural Computing and Applications

SN - 0941-0643

IS - 6

ER -