Word Sense Disambiguation based on Maximum Entropy Classifier

doi:10.23940/ijpe.19.05.p26.14911498

Int J Performability Eng ›› 2019, Vol. 15 ›› Issue (5): 1491-1498.doi: 10.23940/ijpe.19.05.p26.14911498

Word Sense Disambiguation based on Maximum Entropy Classifier

Chunxiang Zhang^a, Xuesong Zhou^b, Xueyao Gao^{b, *}, and Bo Yu^a

a School of Software and Microelectronics, Harbin University of Science and Technology, Harbin, 150080, China
b School of Computer Science and Technology, Harbin University of Science and Technology, Harbin, 150080, China

Submitted on ;
Contact: * E-mail address: xueyao_gao@163.com
Supported by:
This work is supported by the National Natural Science Foundation of China (No. 61502124, 60903082), China Postdoctoral Science Foundation Funded Project (No. 2014M560249), Natural Science Foundation of Heilongjiang Province of China (No. F2017014, F2015041, F201420), and Scientific Research Projects of Science and Technology Talents in Harbin University of Science and Technology.

Abstract

Abstract: Word sense disambiguation (WSD) is one of the most important research issues in the field of natural language processing. In this paper, a new method of word sense disambiguation is proposed, in which words and parts of speech (POS) are extracted as discriminative features. At the same time, a maximum entropy classifier is adopted to determine ambiguous words' semantic categories. Training data of SemEval-2007: Task#5 is used to optimize the maximum entropy model. A test corpus is applied to test the performance of the WSD classifier. Experimental results show that the performance of word sense disambiguation is improved after the proposed approach is used.

Key words: word sense disambiguation, natural language processing, discriminative features, maximum entropy classifier, semantic category

Chunxiang Zhang, Xuesong Zhou, Xueyao Gao, and Bo Yu. Word Sense Disambiguation based on Maximum Entropy Classifier [J]. Int J Performability Eng, 2019, 15(5): 1491-1498.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References

[1] Y. Lin, X. Zhu, Z. Zheng, Z. Dou,R. Zhou, “The Individual Identification Method of Wireless Device based on Dimensionality Reduction and Machine Learning,”Journal of Supercomputing, No. 5, pp. 1-18, 2017
[2] Y. Lin, C. Wang, J. X. Wang,Z. Dou, “A Novel Dynamic Spectrum Access Framework based on Reinforcement Learning for Cognitive Radio Sensor Networks,” Sensors, Vol. 16, No. 10, pp. 1-22, 2016
[3] Y. Lin, C. Wang, C. Ma, Z. Dou,X. Ma, “A New Combination Method for Multisensor Conflict Information,” Journal of Supercomputing, Vol. 72, No. 7, pp. 2874-2890, 2016
[4] B. Krawczyk and B. T. McInnes, “Local Ensemble Learning from Imbalanced and Noisy Data for Word Sense Disambiguation,” Pattern Recognition, Vol. 78, No. 1, pp. 103-119, 2018
[5] E. A. Corrêa, A. A. Lopes,D. R. Amancio, “Word Sense Disambiguation: A Complex Network Approach,” Information Sciences, Vol. 442-443, No. 1, pp. 103-113, 2018
[6] S. Vij, A. Jain, D. Tayal,O. Castillo, “Fuzzy Logic for Inculcating Significance of Semantic Relations in Word Sense Disambiguation using a WordNet Graph,” International Journal of Fuzzy Systems, Vol. 20, No. 2, pp. 444-459, 2018
[7] W. Alsaeedan, M. E. B.Menai, and S. Al-Ahmadi, “A Hybrid Genetic-Ant Colony Optimization Algorithm for the Word Sense Disambiguation Problem,” Information Sciences, Vol. 417, No. 1, pp. 20-38, 2017
[8] Y. J. Choi, J. Wiebe,R. Mihalcea, “Coarse-Grained +/- Effect Word Sense Disambiguation for Implicit Sentiment Analysis,” IEEE Transactions on Affective Computing, Vol. 8, No. 4, pp. 471-479, 2017
[9] Y. Gutiérrez, S. Vázquez,A. Montoyo, “Spreading Semantic Information by Word Sense Disambiguation,” Knowledge-based Systems, Vol. 132, No. 1, pp. 47-61, 2017
[10] H. S. Arora, S. Bhingardive,P. Bhattacharyya, “Detecting Most Frequent Sense using Word Embeddings and BabelNet,” inProceedings of the 8th Global WordNet Conference, pp. 22-26, 2016
[11] S. D. K.Sharma, “Hindi Word Sense Disambiguation using Cosine Similarity,” inProceedings of the International Conference on Information and Communication Technology for Sustainable Development, pp. 801-888, 2016
[12] F. M. Cecchini, E. Fersini,E. Messina, “Word Sense Discrimination on Tweets: A Graph-based Approach,” inProceedings of the 7th International Joint Conference on Knowledge Discovery, pp. 138-146, 2015
[13] J. Wang, M. F. Liao, R. F. Hu,S. H. Wang, “The Word Sense Annotation based on Corpus of Teaching Chinese as a Second Language,” inProceedings of the 16th Workshop on Chinese Lexical Semantics Workshop, pp. 234-243, 2015
[14] D. J. Choi, M. Hwang, B. Ko, S. You,P. Kim, “Low Ambiguity First Algorithm: A New Approach to Knowledge-based Word Sense Disambiguation,” inProceedings of the 2nd International Conference on HCI in Business, pp. 565-574, 2015
[15] R. Jose and V. S. Chooralil, “Prediction of Election Result by Enhanced Sentiment Analysis on Twitter Data using Word Sense Disambiguation,” inProceedings of the International Conference on Control, Communication and Computing, pp. 638-641, 2015
[16] X. M. Jiang, L. R. Qiu,Y. Q. Li, “A Tibetan Word Sense Disambiguation Method based on Hownet and Chinese-Tibetan Parallel Corpora,” inProceedings of the International Standard Conference on Trustworthy Computing and Services, pp. 152-159, 2015
[17] J. Y. Duan, Y. Fu,X. Li, “Attribute Knowledge Mining for Chinese Word Sense Disambiguation,” inProceedings of the International Conference on Asian Language Processing, pp. 73-77, 2015
[18] M. A. S.Cabezudo, N. L. S. Palomino, and M. R. Perez, “Improving Subjectivity Detection for Spanish Texts using Subjectivity Word Sense Disambiguation based on Knowledge,” inProceedings of the 41st Latin American Computing Conference, pp. 53-60, 2015

Word Sense Disambiguation based on Maximum Entropy Classifier

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 9

Recommended 0

[1]	Mahima Yadav and Ishan Kumar. Image Processing-Based Transliteration from Hindi to English [J]. Int J Performability Eng, 2023, 19(5): 334-341.
[2]	Yogendra Singh, Rishu Kumar, Soumya Kabdal, and Prashant Upadhyay. YouTube Video Summarizer using NLP: A Review [J]. Int J Performability Eng, 2023, 19(12): 817-823.
[3]	Rushali A. Deshmukh. Naive Bayes and Neural Network Techniques for Marathi Poem Classification into Nine Rasa using Feature Selection [J]. Int J Performability Eng, 2022, 18(9): 626-636.
[4]	Poonam Narang, Ajay Vikram Singh, and Himanshu Monga. Hybrid Metaheuristic Approach for Detection of Fake News on Social Media [J]. Int J Performability Eng, 2022, 18(6): 434-443.
[5]	Mamta Bhamare, and K Ashokkumar. Personality Prediction through Social Media Posts [J]. Int J Performability Eng, 2022, 18(11): 817-825.
[6]	Jiafeng Zhou, Tian Liu, and Lin Zou. Design of Machine Learning Model for Urban Planning and Management Improvement [J]. Int J Performability Eng, 2020, 16(6): 958-967.
[7]	Lele Chen, Song Huang, Jinlei Sun, Zhanwei Hui, and Sen Yang. Bug Report Classification based on Vector Space Model [J]. Int J Performability Eng, 2019, 15(8): 2071-2080.
[8]	Jiafeng Zhou, Tian Liu, and Lin Zou. Artificial Intelligence Approach to Creative Data Manipulation for Optimisation of Livelihood Oriented Urban Planning and Management [J]. Int J Performability Eng, 2019, 15(2): 602-610.
[9]	Xian Zhang, Kerong Ben, and Jie Zeng. Using Cross-Entropy Value of Code for Better Defect Prediction [J]. Int J Performability Eng, 2018, 14(9): 2105-2115.