Analysis of the effect of sentiment analysis on extracting adverse drug reactions from tweets and forum posts

Ioannis Korkontzelos, Azadeh Nikfarjam, Matthew Shardlow, Abeed Sarker, Sophia Ananiadou, Graciela H. Gonzalez

Research output: Contribution to journalArticle (journal)peer-review

133 Citations (Scopus)
124 Downloads (Pure)


Objective The abundance of text available in social media and health related forums along with the rich expression of public opinion have recently attracted the interest of the public health community to use these sources for pharmacovigilance. Based on the intuition that patients post about Adverse Drug Reactions (ADRs) expressing negative sentiments, we investigate the effect of sentiment analysis features in locating ADR mentions. Methods We enrich the feature space of a state-of-the-art ADR identification method with sentiment analysis features. Using a corpus of posts from the DailyStrength forum and tweets annotated for ADR and indication mentions, we evaluate the extent to which sentiment analysis features help in locating ADR mentions and distinguishing them from indication mentions. Results Evaluation results show that sentiment analysis features marginally improve ADR identification in tweets and health related forum posts. Adding sentiment analysis features achieved a statistically significant F-measure increase from 72.14% to 73.22% in the Twitter part of an existing corpus using its original train/test split. Using stratified 10 × 10-fold cross-validation, statistically significant F-measure increases were shown in the DailyStrength part of the corpus, from 79.57% to 80.14%, and in the Twitter part of the corpus, from 66.91% to 69.16%. Moreover, sentiment analysis features are shown to reduce the number of ADRs being recognized as indications. Conclusion This study shows that adding sentiment analysis features can marginally improve the performance of even a state-of-the-art ADR identification method. This improvement can be of use to pharmacovigilance practice, due to the rapidly increasing popularity of social media and health forums.
Original languageEnglish
Pages (from-to)148-158
Number of pages11
JournalJournal of Biomedical Informatics
Early online date27 Jun 2016
Publication statusPublished - 1 Aug 2016


  • Adverse drug reactionsSocial mediaSentiment analysisText mining
  • Text mining
  • Sentiment analysis
  • Social media
  • Adverse drug reactions
  • Public Health
  • Social Media
  • Drug-Related Side Effects and Adverse Reactions
  • Humans
  • Internet
  • Pharmacovigilance


Dive into the research topics of 'Analysis of the effect of sentiment analysis on extracting adverse drug reactions from tweets and forum posts'. Together they form a unique fingerprint.

Cite this