多级转发数据采集任务的关系数据存储方案设计
Design of Relational Data Storage Scheme for Multi-level Forwarding Data Collection Tasks
吕震宇 1王嘉兴 1林永民 1张培培 1夏永滢1
作者信息
- 1. 华北理工大学 经济管理学院,河北 唐山 063210
- 折叠
摘要
针对通用数据采集需要采集动态多样的数据,采集任务需要多级转发,采集到的数据需要逐级审核汇总,同时还要确保不同用户数据间的安全隔离等问题,设计了支持多级转发数据采集任务的关系型数据存储方案.通过为数据采集任务动态构建数据字段以及使用序列化LOB,实现了通用数据采集任务的统一关系型数据存储.借助"自关联表",实现了填表类与追加类两种数据采集方式下数据采集任务的多级转发、追踪与审核汇总.父子任务的状态联动跃迁进一步降低了多级数据采集中状态管理的复杂度.
Abstract
In response to the need to collect dynamic and diverse data for universal data collection,the collection task requires multi-level forwarding,and the collected data needs to be reviewed and summarized level by level.At the same time,it is necessary to ensure the security isolation between different user data,and other issues.A relational data storage scheme that supports multi-level forwarding data collection tasks has been designed.By dynamically constructing data fields for data collection tasks and using serialized LOBs,unified relational data storage for universal data collection tasks has been achieved.By using the"self association table",the data collection task can be forwarded,tracked,and reviewed at any level in two types of data collection methods:filling in tables and adding tables.The state linkage transition of parent-child tasks further reduces the complexity of state management in multi-level data collection.
关键词
数据采集/多级转发/关系型数据库Key words
data collection/multi-level forwarding/relational database引用本文复制引用
基金项目
河北省高等学校人文社会科学研究项目(SD2021049)
出版年
2024
国家科技期刊平台
NSTL
维普
万方数据