상세정보

The lexical ambiguity of words has been successfully clarified by representing words at a sense level instead of a word level.
This is known as word sense representation (WSR).
However, WSR models are typically trained in an unsupervised fashion without any guidance from sense inventories.
Therefore, the number of sense vectors assigned to a word varies from model to model.
This implies that some senses are missed or unnecessarily added.
Moreover, to utilize their sense vectors in natural language processing tasks, we must determine which sense of a word to choose. 
In this paper, we introduce a unified neural model that incorporates WSR into word sense disambiguation (WSD), thereby leveraging the sense inventory. 
We use bidirectional long short-term memory networks to capture the sequential information of contexts effectively.  
To overcome the limitation of size with the labeled dataset, we train our model in a semi-supervised fashion to scale up the size of the dataset by leveraging a large-scale unlabeled dataset.
We evaluate our proposed model on both WSR and WSD tasks. 
The experimental results demonstrate that our model outperforms state-of-the-art on WSR task by 0.27\%, while, on WSD task, by 1.4\% in terms of Spearman's correlation and F1-score, respectively.

1 Introduction 1
2 Preliminary 4
2.1 WordNet 4
2.2 Pseudo Label 5
3 Model Architecture 6
4 Training Process 9
4.1 Training with labeled data 9
4.2 Pseudo label prediction with unlabeled data 10
4.3 Training with labeled and pseudo labeled data 10
5 Performance Evaluation 13
5.1 Datasets 13
5.1.1 Labeled data 13
5.1.2 Unlabeled data 14
5.2 Experimental Settings 14
5.3 WSR evaluation 15
5.4 WSD evaluation 16
6 Model Analysis 18
7 Related Work 21
7.1 WSR 21
7.2 WSD 22
7.3 WSR and WSD 22
8 Conclusion 24
Bibliography 25
Acknowledgement 29