TY - JOUR
T1 - LSTM-Based Emotion Detection Using Physiological Signals
T2 - IoT Framework for Healthcare and Distance Learning in COVID-19
AU - Awais, Muhammad
AU - Raza, Mohsin
AU - Singh, Nishant
AU - Bashir, Kiran
AU - Manzoor, Umar
AU - Islam, Saif Ul
AU - Rodrigues, Joel J.P.C.
N1 - Funding Information:
This work was supported in part by the Department of Computer Science, Edge Hill University, U.K.; in part by FCT/MCTES through National Funds and when applicable cofunded EU funds under Project UIDB/50008/2020; and in part by Brazilian National Council for Scientific and Technological Development (CNPq) under Grant 309335/2017-5.
Publisher Copyright:
© 2014 IEEE.
PY - 2021/12/1
Y1 - 2021/12/1
N2 - Human emotions are strongly coupled with physical and mental health of any individual. While emotions exbibit complex physiological and biological phenomenon, yet studies reveal that physiological signals can be used as an indirect measure of emotions. In unprecedented circumstances alike the coronavirus (Covid-19) outbreak, a remote Internet of Things (IoT) enabled solution, coupled with AI can interpret and communicate emotions to serve substantially in healthcare and related fields. This work proposes an integrated IoT framework that enables wireless communication of physiological signals to data processing hub where long short-term memory (LSTM)-based emotion recognition is performed. The proposed framework offers real-time communication and recognition of emotions that enables health monitoring and distance learning support amidst pandemics. In this study, the achieved results are very promising. In the proposed IoT protocols (TS-MAC and R-MAC), ultralow latency of 1 ms is achieved. R-MAC also offers improved reliability in comparison to state of the art. In addition, the proposed deep learning scheme offers high performance (f-score) of 95%. The achieved results in communications and AI match the interdependency requirements of deep learning and IoT frameworks, thus ensuring the suitability of proposed work in distance learning, student engagement, healthcare, emotion support, and general wellbeing.
AB - Human emotions are strongly coupled with physical and mental health of any individual. While emotions exbibit complex physiological and biological phenomenon, yet studies reveal that physiological signals can be used as an indirect measure of emotions. In unprecedented circumstances alike the coronavirus (Covid-19) outbreak, a remote Internet of Things (IoT) enabled solution, coupled with AI can interpret and communicate emotions to serve substantially in healthcare and related fields. This work proposes an integrated IoT framework that enables wireless communication of physiological signals to data processing hub where long short-term memory (LSTM)-based emotion recognition is performed. The proposed framework offers real-time communication and recognition of emotions that enables health monitoring and distance learning support amidst pandemics. In this study, the achieved results are very promising. In the proposed IoT protocols (TS-MAC and R-MAC), ultralow latency of 1 ms is achieved. R-MAC also offers improved reliability in comparison to state of the art. In addition, the proposed deep learning scheme offers high performance (f-score) of 95%. The achieved results in communications and AI match the interdependency requirements of deep learning and IoT frameworks, thus ensuring the suitability of proposed work in distance learning, student engagement, healthcare, emotion support, and general wellbeing.
KW - Artificial intelligence (AI)
KW - coronavirus (Covid-19), human emotion analysis
KW - Internet of Things (IoT)
KW - long short-term memory (LSTM)
KW - wearable physiological signals
UR - http://www.scopus.com/inward/record.url?scp=85097953953&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85097953953&partnerID=8YFLogxK
U2 - 10.1109/JIOT.2020.3044031
DO - 10.1109/JIOT.2020.3044031
M3 - Article (journal)
AN - SCOPUS:85097953953
SN - 2327-4662
VL - 8
SP - 16863
EP - 16871
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
IS - 23
ER -