Supporting systematic reviews using LDA-based document representations

Yuanhan Mo, Georgios Kontonatsios, Sophia Ananiadou

Research output: Contribution to journalReview articlepeer-review

54 Citations (Scopus)
126 Downloads (Pure)

Abstract

Background: Identifying relevant studies for inclusion in a systematic review (i.e. screening) is a complex, laborious and expensive task. Recently, a number of studies has shown that the use of machine learning and text mining methods to automatically identify relevant studies has the potential to drastically decrease the workload involved in the screening phase. The vast majority of these machine learning methods exploit the same underlying principle, i.e. a study is modelled as a bag-of-words (BOW). Methods: We explore the use of topic modelling methods to derive a more informative representation of studies. We apply Latent Dirichlet allocation (LDA), an unsupervised topic modelling approach, to automatically identify topics in a collection of studies. We then represent each study as a distribution of LDA topics. Additionally, we enrich topics derived using LDA with multi-word terms identified by using an automatic term recognition (ATR) tool. For evaluation purposes, we carry out automatic identification of relevant studies using support vector machine (SVM)-based classifiers that employ both our novel topic-based representation and the BOW representation. Results: Our results show that the SVM classifier is able to identify a greater number of relevant studies when using the LDA representation than the BOW representation. These observations hold for two systematic reviews of the clinical domain and three reviews of the social science domain. Conclusions: A topic-based feature representation of documents outperforms the BOW representation when applied to the task of automatic citation screening. The proposed term-enriched topics are more informative and less ambiguous to systematic reviewers.
Original languageEnglish
Pages (from-to)1-12
JournalSystematic Reviews
Volume4
Issue number172
Early online date26 Nov 2015
DOIs
Publication statusE-pub ahead of print - 26 Nov 2015

Fingerprint

Dive into the research topics of 'Supporting systematic reviews using LDA-based document representations'. Together they form a unique fingerprint.

Cite this