When Specialization Helps: Using Pooled Contextualized Embeddings to Detect Chemical and Biomedical Entities in Spanish

10/08/2019

∙

The recognition of pharmacological substances, compounds and proteins is an essential preliminary work for the recognition of relations between chemicals and other biomedically relevant units. In this paper, we describe an approach to Task 1 of the PharmaCoNER Challenge, which involves the recognition of mentions of chemicals and drugs in Spanish medical texts. We train a state-of-the-art BiLSTM-CRF sequence tagger with stacked Pooled Contextualized Embeddings, word and sub-word embeddings using the open-source framework FLAIR. We present a new corpus composed of articles and papers from Spanish health science journals, termed the Spanish Health Corpus, and use it to train domain-specific embeddings which we incorporate in our model training. We achieve a result of 89.76 to improve these results to 90.52

READ FULL TEXT

When Specialization Helps: Using Pooled Contextualized Embeddings to Detect Chemical and Biomedical Entities in Spanish

Evaluating KGR10 Polish word embeddings in the recognition of temporal expressions using BiLSTM-CRF

Word Embeddings for Chemical Patent Natural Language Processing

Domain-Specific Word Embeddings with Structure Prediction

Comparing CNN and LSTM character-level embeddings in BiLSTM-CRF models for chemical and disease named entity recognition

BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger

Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition

Enabling Open-World Specification Mining via Unsupervised Learning

When Specialization Helps: Using Pooled Contextualized Embeddings to Detect Chemical and Biomedical Entities in Spanish

Related Research

Evaluating KGR10 Polish word embeddings in the recognition of temporal expressions using BiLSTM-CRF

Word Embeddings for Chemical Patent Natural Language Processing

Domain-Specific Word Embeddings with Structure Prediction

Comparing CNN and LSTM character-level embeddings in BiLSTM-CRF models for chemical and disease named entity recognition

BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger

Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition

Enabling Open-World Specification Mining via Unsupervised Learning