XJIPC OpenIR  > 多语种信息技术研究室
A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data
Zhu, HJ (Zhu, Hui-Juan); Zhu, ZW (Zhu, Zheng-Wei); Jiang, TH (Jiang, Tong-Hai); Cheng, L (Cheng, Li); Shi, WL (Shi, Wei-Lei); Zhou, X (Zhou, Xi); Zhao, F (Zhao, Fan); Ma, B (Ma, Bo)
2018
Source PublicationJOURNAL OF SENSORS
ISSN1687-725X
Volume2018Issue:1Pages:1-12
Abstract

In data integration, entity resolution is an important technique to improve data quality. Existing researches typically assume that the target dataset only contain string-type data and use single similarity metric. For larger high-dimensional dataset, redundant information needs to be verified using traditional blocking or windowing techniques. In this work, we propose a novel ER-resolving method using a hybrid approach, including type-based multiblocks, varying window size, and more flexible similarity metrics. In our new ER workflow, we reduce the searching space for entity pairs by the constraint of redundant attributes and matching likelihood. We develop a reference implementation of our proposed approach and validate its performance using real-life dataset from one Internet of Things project. We evaluate the data processing system using five standard metrics including effectiveness, efficiency, accuracy, recall, and precision. Experimental results indicate that the proposed approach could be a promising alternative for entity resolution and could be feasibly applied in real-world data cleaning for large datasets.

DOI10.1155/2018/2094696
Indexed BySCI
WOS IDWOS:000424828300001
Citation statistics
Document Type期刊论文
Identifierhttp://ir.xjipc.cas.cn/handle/365002/5221
Collection多语种信息技术研究室
Corresponding AuthorJiang, TH (Jiang, Tong-Hai)
Affiliation1.Changzhou Univ, Sch Informat Sci & Engn, Changzhou 213164, Peoples R China
2.Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 830011, Peoples R China
3.Xinjiang Lab Minor Speech & Language Informat Pro, Urumqi 830011, Peoples R China
Recommended Citation
GB/T 7714
Zhu, HJ ,Zhu, ZW ,Jiang, TH ,et al. A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data[J]. JOURNAL OF SENSORS,2018,2018(1):1-12.
APA Zhu, HJ .,Zhu, ZW .,Jiang, TH .,Cheng, L .,Shi, WL .,...&Ma, B .(2018).A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data.JOURNAL OF SENSORS,2018(1),1-12.
MLA Zhu, HJ ,et al."A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data".JOURNAL OF SENSORS 2018.1(2018):1-12.
Files in This Item:
File Name/Size DocType Version Access License
A Type-Based Blockin(1592KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Application Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhu, HJ (Zhu, Hui-Juan)]'s Articles
[Zhu, ZW (Zhu, Zheng-Wei)]'s Articles
[Jiang, TH (Jiang, Tong-Hai)]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhu, HJ (Zhu, Hui-Juan)]'s Articles
[Zhu, ZW (Zhu, Zheng-Wei)]'s Articles
[Jiang, TH (Jiang, Tong-Hai)]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhu, HJ (Zhu, Hui-Juan)]'s Articles
[Zhu, ZW (Zhu, Zheng-Wei)]'s Articles
[Jiang, TH (Jiang, Tong-Hai)]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.