Efficient adverse drug event extraction using Twitter sentiment analysis
Yang Peng, Melody Moh, Teng-Sheng Moh · 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · 2016
Extensive clinical trials are required before a drug is placed on the market; yet it is difficult to discover all the side effects for any approved drugs. The United States Food and Drug Administration actively monitors approved medications to identify adverse events. The FDA Adverse Event Reporting System contains a database of adverse drug events (ADE) reported by the healthcare providers and consumers. The pervasive online social networks, such as Twitter, can provide additional information ADE. Concurrently, advancements in social media technology have resulted in the booming of massive public data; the availability of these huge datasets offers numerous research opportunities for extracting ADEs. Towards this purpose, in this paper a simple, effective computation pipeline is proposed, which uses simple drug-related classification and sentiment analysis to extract ADEs on Twitter. The pipeline is described in detail, and is implemented into an automatic process. Experiments are carried out based on 4-months of Twitter data collected. Comparing with an existing pipeline, the new design is able to successfully capture 5 times more valid ADEs, among them 20% are new ADEs. The proposed method may be applied to other areas such as food, beverages, and other daily consumer products for identifying side effects and user opinions.