中国科学院新疆理化技术研究所机构知识库
Advanced  
XJIPC OpenIR  > 多语种信息技术研究室  > 期刊论文
题名: Uyghur word segmentation using a combination of rules and statistics
作者: Xue, Huajian; Yang, Yong; Turghun, Osman; Li, Xiao; Zhang, Ronghui
刊名: Advances in Information Sciences and Service Sciences
发表日期: 2011
卷: 3, 期:11
收录类别: EI
英文摘要: Rich morphology of Uyghur produces a large number of words and leads to high out of vocabulary (OOV) rates that can cause many errors in Uyghur natural language processing (NLP). Morphological word segmentation is the very important component to overcome this problem caused by Uyghur morphology. This paper depicts some morphological rules by analyzing the universal structure of Uyghur words and presents a partly supervised word segmentation method. In this method, the suffix corpus was utilized to give all the possible morphological word segmentations, from which the optimal word segmentation is selected by the MAP-based model. In addition, cascaded language model was used to improve the accuracy of word segmentation. The test set composed of 5000 words was collected and segmented by hand. The experiment on this test set was given and experimental results show that the proposed method was more effective.
内容类型: 期刊论文
URI标识: http://ir.xjipc.cas.cn/handle/365002/4160
Appears in Collections:多语种信息技术研究室_期刊论文

Files in This Item:

There are no files associated with this item.


作者单位: Xinjiang Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, China

Recommended Citation:
Xue, Huajian,Yang, Yong,Turghun, Osman,et al. Uyghur word segmentation using a combination of rules and statistics[J]. Advances in Information Sciences and Service Sciences,2011,3(11).
Service
Recommend this item
Sava as my favorate item
Show this item's statistics
Export Endnote File
Google Scholar
Similar articles in Google Scholar
[Xue, Huajian]'s Articles
[Yang, Yong]'s Articles
[Turghun, Osman]'s Articles
CSDL cross search
Similar articles in CSDL Cross Search
[Xue, Huajian]‘s Articles
[Yang, Yong]‘s Articles
[Turghun, Osman]‘s Articles
Related Copyright Policies
Null
Social Bookmarking
Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit
所有评论 (0)
暂无评论
 
评注功能仅针对注册用户开放,请您登录
您对该条目有什么异议,请填写以下表单,管理员会尽快联系您。
内 容:
Email:  *
单位:
验证码:   刷新
您在IR的使用过程中有什么好的想法或者建议可以反馈给我们。
标 题:
 *
内 容:
Email:  *
验证码:   刷新

Items in IR are protected by copyright, with all rights reserved, unless otherwise indicated.

 

 

Valid XHTML 1.0!
Powered by CSpace