首页|空间自回归模型下不完整大数据缺失值插补算法

空间自回归模型下不完整大数据缺失值插补算法

扫码查看
针对不完整大数据因其自身结构具有不规则性,导致在进行缺失值插补时计算量大、插补精度低的问题,提出空间自回归模型下不完整大数据缺失值插补算法.利用迁移学习算法在动态权重下过滤出原始数据中冗余数据,区分异常和正常数据,提取残缺数据,采用最小二乘回归对残缺数据实施修补.将缺失值插补分为3种类型,分别为一阶空间自回归模型插补、空间自回归模型插补和多重插补法.根据实际情况将修补后数据插补到合适的位置,实现不完整大数据缺失值插补.实验结果表明,所提方法具有良好的缺失值插补能力.
Interpolation Algorithm for Missing Values of Incomplete Big Data in Spatial Autoregressive Model
Incomplete big data,due to its irregular structure,has a large amount of computation and low interpolation accuracy when interpolation misses values.Therefore,a missing value interpolation algorithm for incomplete big data based on spatial autoregressive model is proposed.Using a migration learning algorithm to filter out redundant data from the original data under dynamic weights,to distinguish abnormal data from normal data,and to extract incomplete data.Using least square regression to repair the incomplete data.The missing value interpolation is divided into three types,namely,first order spatial autoregressive model interpolation,spatial autoregressive model interpolation,and multiple interpolation.The repaired data is interpolated to the appropriate location according to the actual situation,implementing incomplete big data missing value interpolation.Experimental results show that the proposed method has good interpolation ability for missing values.

transfer learningincomplete big dataimputation of missing valuesspatial regression modeldata correction

刘晓燕、翟建国

展开 >

昆明理工大学信息工程与自动化学院,昆明 650504

迁移学习 不完整大数据 缺失值插补 空间回归模型 数据修正

云南省自然科学基金

202224143456

2024

吉林大学学报(信息科学版)
吉林大学

吉林大学学报(信息科学版)

CSTPCD
影响因子:0.607
ISSN:1671-5896
年,卷(期):2024.42(2)
  • 15