LemmaTag: Jointly Tagging and Lemmatizing for Morphologically-Rich Languages with BRNNs

08/10/2018
by   Daniel Kondratyuk, et al.
0

We present LemmaTag, a featureless recurrent neural network architecture that jointly generates part-of-speech tags and lemmatizes sentences of languages with complex morphology, using bidirectional RNNs with character-level and word-level embeddings. We demonstrate that both tasks benefit from sharing the encoding part of the network and from using the tagger output as an input to the lemmatizer. We evaluate our model across several morphologically-rich languages, surpassing state-of-the-art accuracy in both part-of-speech tagging and lemmatization in Czech, German, and Arabic.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset