A Vision-based Transfer Learning Approach for Recognizing Behavioral Symptoms in People with Dementia

Zachary Wharton, Erik Thomas, Bappaditya Debnath, Ardhendu Behera

Research output: Contribution to journalArticleResearchpeer-review

14 Downloads (Pure)

Abstract

With an aging population that continues to grow, dementia is a major global health concern. It is a syndrome in which there is a deterioration in memory, thinking, behavior and the ability to perform activities of daily living. Depression and aggressive behavior are the most upsetting and challenging symptoms of dementia. Automatic recognition of these behaviors would not only be useful to alert family members and caregivers, but also helpful in planning and managing daily activities of people with dementia (PwD). In this work, we propose a vision-based approach that unifies transfer learning and deep convolutional neural network (CNN) for the effective recognition of behavioral symptoms. We also compare the performance of state-of-the-art CNN features with the hand-crafted HOG-feature, as well as their combination using a basic linear SVM. The proposed method is evaluated on a newly created dataset, which is based on the dementia storyline in ITVs Emmerdale episodes. The Alzheimer’s Society has described it as a “realistic portrayal” of the condition to raise awareness of the issues surrounding dementia.
Original languageEnglish
Pages (from-to)1-6
Journal2018 15th IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS) Proceedigs
Early online date14 Feb 2019
DOIs
Publication statusE-pub ahead of print - 14 Feb 2019

Fingerprint

Neural networks
Deterioration
Aging of materials
Health
Data storage equipment
Planning

Keywords

  • Aggressive and depressive behavior recognition
  • Human-robot social interactions
  • Assistive technology for dementia
  • Health and social care
  • Video analysis and recognition
  • Transfer learning
  • Deep learning
  • CNN features

Cite this

@article{e62640729a7245ccac01190d35225184,
title = "A Vision-based Transfer Learning Approach for Recognizing Behavioral Symptoms in People with Dementia",
abstract = "With an aging population that continues to grow, dementia is a major global health concern. It is a syndrome in which there is a deterioration in memory, thinking, behavior and the ability to perform activities of daily living. Depression and aggressive behavior are the most upsetting and challenging symptoms of dementia. Automatic recognition of these behaviors would not only be useful to alert family members and caregivers, but also helpful in planning and managing daily activities of people with dementia (PwD). In this work, we propose a vision-based approach that unifies transfer learning and deep convolutional neural network (CNN) for the effective recognition of behavioral symptoms. We also compare the performance of state-of-the-art CNN features with the hand-crafted HOG-feature, as well as their combination using a basic linear SVM. The proposed method is evaluated on a newly created dataset, which is based on the dementia storyline in ITVs Emmerdale episodes. The Alzheimer’s Society has described it as a “realistic portrayal” of the condition to raise awareness of the issues surrounding dementia.",
keywords = "Aggressive and depressive behavior recognition, Human-robot social interactions, Assistive technology for dementia, Health and social care, Video analysis and recognition, Transfer learning, Deep learning, CNN features",
author = "Zachary Wharton and Erik Thomas and Bappaditya Debnath and Ardhendu Behera",
year = "2019",
month = "2",
day = "14",
doi = "10.1109/AVSS.2018.8639371",
language = "English",
pages = "1--6",
journal = "2018 15th IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS) Proceedigs",
publisher = "Institute of Electrical and Electronics Engineers",

}

A Vision-based Transfer Learning Approach for Recognizing Behavioral Symptoms in People with Dementia. / Wharton, Zachary; Thomas, Erik; Debnath, Bappaditya; Behera, Ardhendu.

In: 2018 15th IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS) Proceedigs, 14.02.2019, p. 1-6.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - A Vision-based Transfer Learning Approach for Recognizing Behavioral Symptoms in People with Dementia

AU - Wharton, Zachary

AU - Thomas, Erik

AU - Debnath, Bappaditya

AU - Behera, Ardhendu

PY - 2019/2/14

Y1 - 2019/2/14

N2 - With an aging population that continues to grow, dementia is a major global health concern. It is a syndrome in which there is a deterioration in memory, thinking, behavior and the ability to perform activities of daily living. Depression and aggressive behavior are the most upsetting and challenging symptoms of dementia. Automatic recognition of these behaviors would not only be useful to alert family members and caregivers, but also helpful in planning and managing daily activities of people with dementia (PwD). In this work, we propose a vision-based approach that unifies transfer learning and deep convolutional neural network (CNN) for the effective recognition of behavioral symptoms. We also compare the performance of state-of-the-art CNN features with the hand-crafted HOG-feature, as well as their combination using a basic linear SVM. The proposed method is evaluated on a newly created dataset, which is based on the dementia storyline in ITVs Emmerdale episodes. The Alzheimer’s Society has described it as a “realistic portrayal” of the condition to raise awareness of the issues surrounding dementia.

AB - With an aging population that continues to grow, dementia is a major global health concern. It is a syndrome in which there is a deterioration in memory, thinking, behavior and the ability to perform activities of daily living. Depression and aggressive behavior are the most upsetting and challenging symptoms of dementia. Automatic recognition of these behaviors would not only be useful to alert family members and caregivers, but also helpful in planning and managing daily activities of people with dementia (PwD). In this work, we propose a vision-based approach that unifies transfer learning and deep convolutional neural network (CNN) for the effective recognition of behavioral symptoms. We also compare the performance of state-of-the-art CNN features with the hand-crafted HOG-feature, as well as their combination using a basic linear SVM. The proposed method is evaluated on a newly created dataset, which is based on the dementia storyline in ITVs Emmerdale episodes. The Alzheimer’s Society has described it as a “realistic portrayal” of the condition to raise awareness of the issues surrounding dementia.

KW - Aggressive and depressive behavior recognition

KW - Human-robot social interactions

KW - Assistive technology for dementia

KW - Health and social care

KW - Video analysis and recognition

KW - Transfer learning

KW - Deep learning

KW - CNN features

UR - https://ieeexplore.ieee.org/xpl/conhome.jsp?punumber=1001307

UR - https://avss2018.org/

U2 - 10.1109/AVSS.2018.8639371

DO - 10.1109/AVSS.2018.8639371

M3 - Article

SP - 1

EP - 6

JO - 2018 15th IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS) Proceedigs

JF - 2018 15th IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS) Proceedigs

ER -