【英文篇名】 Researches of Part of Speech Tagging for Tibetan Texts Based on Hidden Markov Model
【作者】 苏俊峰; 祁坤钰; 本太;
【作者单位】 西北民族大学中国民族信息技术研究院;
【文献出处】 西北民族大学学报(自然科学版), Journal of Northwest University for Nationalities(Natural Science), 编辑部邮箱 2009年 01期
【关键词】 藏语词性标注; 词性标注集; HMM;
【英文关键词】 Tibetan part of speech tagging; Tagging set; HMM;
【摘要】 针对藏语区别于英语和汉语,分析藏语的构形特征,得到词性标注集.从人工标注的语料中统计词和词性频率以及训练得到二元语法的HMM模型参数,运用Viterbi算法完成基于统计方法的词性标注.
【英文摘要】 After the characteristics of word formation in Tibetan which are different from English and Chinese are analyzed, tagging set on part of speech is obtained. Then from the man-made-corpus,the appearance frequency of words and part of speech frequency are worked out, and HMM’s module parameter of binary grammar is acquired. Through the Viterbi Algorithm, tagging part of speech which is based on the method of statistics is finished. Finally, the tagging is corrected with the application of Tibetan rules.
【基金】 《现代藏语语法信息词典》建设研究,甘肃省社科规划项目,项目编号2007-04
【作者】 苏俊峰; 祁坤钰; 本太;
【作者单位】 西北民族大学中国民族信息技术研究院;
【文献出处】 西北民族大学学报(自然科学版), Journal of Northwest University for Nationalities(Natural Science), 编辑部邮箱 2009年 01期
【关键词】 藏语词性标注; 词性标注集; HMM;
【英文关键词】 Tibetan part of speech tagging; Tagging set; HMM;
【摘要】 针对藏语区别于英语和汉语,分析藏语的构形特征,得到词性标注集.从人工标注的语料中统计词和词性频率以及训练得到二元语法的HMM模型参数,运用Viterbi算法完成基于统计方法的词性标注.
【英文摘要】 After the characteristics of word formation in Tibetan which are different from English and Chinese are analyzed, tagging set on part of speech is obtained. Then from the man-made-corpus,the appearance frequency of words and part of speech frequency are worked out, and HMM’s module parameter of binary grammar is acquired. Through the Viterbi Algorithm, tagging part of speech which is based on the method of statistics is finished. Finally, the tagging is corrected with the application of Tibetan rules.
【基金】 《现代藏语语法信息词典》建设研究,甘肃省社科规划项目,项目编号2007-04