Abstract
Background and Objectives
Declining mental health is a prominent and concerning issue. Affective classification, which employs machine learning on brain signals captured from electroencephalogram (EEG), is a prevalent approach to address this issue. However, many existing studies have adopted a one-size-fits-all approach, where data from multiple individuals are combined to create a single “generic” classification model. This overlooks individual differences and may not accurately capture the unique emotional patterns of each person.
Methods
This study explored the performance of six machine learning algorithms in classifying a benchmark EEG dataset (collected with a MUSE device) for affective research. We replicated the best performing models on the dataset found in the literature and present a comparative analysis of performance between existing studies and our personalised approach. We also adapted another EEG dataset (commonly called DEAP) to validate the personalised approach. Evaluation was based on accuracy and significance test using McNemar statistics. Model runtime was also used as an efficiency metric.
Results
The personalised approach consistently outperformed the generalised method across both datasets. McNemar’s test revealed significant improvements in all but one machine learning algorithm. Notably, the Decision Tree algorithm consistently excelled in the personalised mode, achieving an accuracy improvement of 0.85% (𝑝<0.001) on the MUSE dataset and a 4.30% improvement on the DEAP dataset, which was also statistically significant (𝑝=0.004). Both Decision Tree models were more efficient than their generalised counterpart with 1.270 and 23.020-s efficiency gain on the MUSE and DEAP datasets, respectively.
Conclusions
This research concludes that smaller, personalised models are a far more effective way of conducting affective classification, and this was validated with both small (MUSE) and large (DEAP) datasets consisting of EEG samples from 4 to 32 subjects, respectively.
Declining mental health is a prominent and concerning issue. Affective classification, which employs machine learning on brain signals captured from electroencephalogram (EEG), is a prevalent approach to address this issue. However, many existing studies have adopted a one-size-fits-all approach, where data from multiple individuals are combined to create a single “generic” classification model. This overlooks individual differences and may not accurately capture the unique emotional patterns of each person.
Methods
This study explored the performance of six machine learning algorithms in classifying a benchmark EEG dataset (collected with a MUSE device) for affective research. We replicated the best performing models on the dataset found in the literature and present a comparative analysis of performance between existing studies and our personalised approach. We also adapted another EEG dataset (commonly called DEAP) to validate the personalised approach. Evaluation was based on accuracy and significance test using McNemar statistics. Model runtime was also used as an efficiency metric.
Results
The personalised approach consistently outperformed the generalised method across both datasets. McNemar’s test revealed significant improvements in all but one machine learning algorithm. Notably, the Decision Tree algorithm consistently excelled in the personalised mode, achieving an accuracy improvement of 0.85% (𝑝<0.001) on the MUSE dataset and a 4.30% improvement on the DEAP dataset, which was also statistically significant (𝑝=0.004). Both Decision Tree models were more efficient than their generalised counterpart with 1.270 and 23.020-s efficiency gain on the MUSE and DEAP datasets, respectively.
Conclusions
This research concludes that smaller, personalised models are a far more effective way of conducting affective classification, and this was validated with both small (MUSE) and large (DEAP) datasets consisting of EEG samples from 4 to 32 subjects, respectively.
Original language | English |
---|---|
Pages (from-to) | 1-22 |
Number of pages | 22 |
Journal | Applied Artificial Intelligence |
Volume | 39 |
Issue number | 1 |
Early online date | 16 Jan 2025 |
DOIs | |
Publication status | Published - 19 Jan 2025 |
Keywords
- Artificial Intelligence (AI)
- Design Process
- Text Mining
- generative AI
- Creative Processes
- Design Stages
- Research
- Ideation
- Mock-up
- Production
- Evaluation
- UX Design
- Graphic Design
- Industrial Design
- Fashion Design
- AI Utilization
- NLP (Natural Language Processing)
- Machine Learning
- Data Processing
- Design Automation