Adapting Phrase-based Machine Translation to Normalise Medical Terms in Social Media Messages

08/10/2015
by   Nut Limsopatham, et al.
0

Previous studies have shown that health reports in social media, such as DailyStrength and Twitter, have potential for monitoring health conditions (e.g. adverse drug reactions, infectious diseases) in particular communities. However, in order for a machine to understand and make inferences on these health conditions, the ability to recognise when laymen's terms refer to a particular medical concept (i.e. text normalisation) is required. To achieve this, we propose to adapt an existing phrase-based machine translation (MT) technique and a vector representation of words to map between a social media phrase and a medical concept. We evaluate our proposed approach using a collection of phrases from tweets related to adverse drug reactions. Our experimental results show that the combination of a phrase-based MT technique and the similarity between word vector representations outperforms the baselines that apply only either of them by up to 55

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/18/2015

Phrase Based Language Model For Statistical Machine Translation

We consider phrase based Language Models (LM), which generalize the comm...
research
05/23/2020

From Witch's Shot to Music Making Bones – Resources for Medical Laymen to Technical Language and Vice Versa

Many people share information in social media or forums, like food they ...
research
01/21/2015

Phrase Based Language Model for Statistical Machine Translation: Empirical Study

Reordering is a challenge to machine translation (MT) systems. In MT, th...
research
09/10/2021

Euphemistic Phrase Detection by Masked Language Model

It is a well-known approach for fringe groups and organizations to use e...
research
08/15/2023

DS4DH at #SMM4H 2023: Zero-Shot Adverse Drug Events Normalization using Sentence Transformers and Reciprocal-Rank Fusion

This paper outlines the performance evaluation of a system for adverse d...
research
10/26/2019

Using Arabic Tweets to Understand Drug Selling Behaviors

Twitter is a popular platform for e-commerce in the Arab region includin...

Please sign up or login with your details

Forgot password? Click here to reset