首页|基于多方表格数据关联策略的数据补全可视分析方法

基于多方表格数据关联策略的数据补全可视分析方法

扫码查看
原文链接
  • NETL
  • NSTL
  • 万方数据
数据补全是数据治理的一项重要预处理任务,目的是填补不完整的数据.然而,传统的数据补全方法只能通过单张数据表格在一定程度上缓解数据的不完整问题,并未能在补全值的准确性和效率之间达到最佳平衡.本文提出了一种新颖的数据补全可视化分析方法;设计了一套多方表格数据关联策略,采用智能算法识别相似列并在多个表格之间建立列之间的关联关系,然后利用其它表格中的相似数据条目对缺失数据进行初始补全;开发了一个可视分析系统来优化数据补全的候选值.本文中的交互式系统将多方数据补全方法与专家知识相结合,有助于更好地理解数据的关系结构,显著提高了数据补全的准确性和效率,提升了数据治理质量和数据资产内在价值.实验验证和用户调查表明,本文方法支持用户使用领域知识验证判断相关列及相似行.
A visual analysis approach for data imputation via multi-party tabular data correlation strategies
Data imputation is an essential pre-processing task for data governance,aimed at filling in incomplete data.However,conventional data imputation methods can only partly alleviate data incompleteness using isolated tabular data,and they fail to achieve the best balance between accuracy and efficiency.In this paper,we present a novel visual analysis approach for data imputation.We develop a multi-party tabular data association strategy that uses intelligent algorithms to identify similar columns and establish column correlations across multiple tables.Then,we perform the initial imputation of incomplete data using correlated data entries from other tables.Additionally,we develop a visual analysis system to refine data imputation candidates.Our interactive system combines the multi-party data imputation approach with expert knowledge,allowing for a better understanding of the relational structure of the data.This significantly enhances the accuracy and efficiency of data imputation,thereby enhancing the quality of data governance and the intrinsic value of data assets.Experimental validation and user surveys demonstrate that this method supports users in verifying and judging the associated columns and similar rows using their domain knowledge.

Data governanceData incompletenessData imputationData visualizationInteractive visual analysis

朱海洋、韩东明、潘嘉铖、魏雅婷、封颖超杰、翁罗轩、毛科添、邢远凯、闾建树、万邱成、陈为

展开 >

浙江大学计算机辅助设计与图形系统全国重点实验室,中国 杭州市,310058

物产中大数字科技有限公司,中国 杭州市,310020

物产中大金属集团有限公司,中国 杭州市,310005

数据治理 数据不完整 数据补全 数据可视化 交互式可视分析

Key R&D"Pioneer"Tackling Plan Program of Zhejiang Province,Chinathe"Ten Thousand Talents Plan"Science and Technology Innovation Leading Talent Program of Zhejiang Province,ChinaMajor Standardization Pilot Projects for the Digital Economy(Digital Trade Sector)of Zhejiang Province,ChinaNational Natural Science Foundation of China

2023C011192022R52044SJ-BZ/202305362132017

2024

10.1631/FITEE.2300480

信息与电子工程前沿(英文)
浙江大学

信息与电子工程前沿(英文)

CSTPCD
影响因子：0.371
ISSN：2095-9184
年,卷(期)：2024.25(3)
  • 65