Semi-supervised sequence tagging with bidirectional language models on ShortScience.org

doi.org
sci-hub
scholar.google.com

Semi-supervised sequence tagging with bidirectional language models
Peters, Matthew E. and Ammar, Waleed and Bhagavatula, Chandra and Power, Russell
Association for Computational Linguistics - 2017 via Local Bibsonomy
Keywords: dblp

Summaries/Notes 1

[link] Summary by Marek Rei 6 years ago

The paper proposes integrating a pre-trained language model into a sequence labeling model. The baseline model for sequence labeling is a two-layer LSTM/GRU. They concatenate the hidden states from pre-trained language models onto the output of the first LSTM layer. This provides an improvement on NER and chunking tasks.

https://i.imgur.com/Hso3mL9.png

Your comment:

Write your summary here (You can use $\LaTeX$ and markdown syntax):

Anon Private