Keyphrase Extraction from Disaster-related Tweets

by   Jishnu Ray Chowdhury, et al.

While keyphrase extraction has received considerable attention in recent years, relatively few studies exist on extracting keyphrases from social media platforms such as Twitter, and even fewer for extracting disaster-related keyphrases from such sources. During a disaster, keyphrases can be extremely useful for filtering relevant tweets that can enhance situational awareness. Previously, joint training of two different layers of a stacked Recurrent Neural Network for keyword discovery and keyphrase extraction had been shown to be effective in extracting keyphrases from general Twitter data. We improve the model's performance on both general Twitter data and disaster-related Twitter data by incorporating contextual word embeddings, POS-tags, phonetics, and phonological features. Moreover, we discuss the shortcomings of the often used F1-measure for evaluating the quality of predicted keyphrases with respect to the ground truth annotations. Instead of the F1-measure, we propose the use of embedding-based metrics to better capture the correctness of the predicted keyphrases. In addition, we also present a novel extension of an embedding-based metric. The extension allows one to better control the penalty for the difference in the number of ground-truth and predicted keyphrases


BERT based classification system for detecting rumours on Twitter

The role of social media in opinion formation has far-reaching implicati...

Hit ratio: An Evaluation Metric for Hashtag Recommendation

Hashtag recommendation is a crucial task, especially with an increase of...

Measuring and Detecting Virality on Social Media: The Case of Twitter's Viral Tweets Topic

Social media posts may go viral and reach large numbers of people within...

On Identifying Hashtags in Disaster Twitter Data

Tweet hashtags have the potential to improve the search for information ...

Tracing State-Level Obesity Prevalence from Sentence Embeddings of Tweets: A Feasibility Study

Twitter data has been shown broadly applicable for public health surveil...

Tweets Under the Rubble: Detection of Messages Calling for Help in Earthquake Disaster

The importance of social media is again exposed in the recent tragedy of...

Variation across Scales: Measurement Fidelity under Twitter Data Sampling

A comprehensive understanding of data bias is the cornerstone of mitigat...

Please sign up or login with your details

Forgot password? Click here to reset