给水排水2024,Vol.50Issue(6) :159-163.DOI:10.13789/j.cnki.wwe1964.2022.08.17.0004

基于LSTM的污水处理厂在线数据清洗研究

Research on the WWTP online data cleaning based on LSTM

成志轩 张楠 蒋云鹏
给水排水2024,Vol.50Issue(6) :159-163.DOI:10.13789/j.cnki.wwe1964.2022.08.17.0004

基于LSTM的污水处理厂在线数据清洗研究

Research on the WWTP online data cleaning based on LSTM

成志轩 1张楠 2蒋云鹏1
扫码查看

作者信息

  • 1. 丹华水利环境技术(上海)有限公司,上海 200235
  • 2. 上海市政工程设计研究总院(集团)有限公司,上海 200092
  • 折叠

摘要

污水处理厂工艺仿真技术是实现污水处理厂智慧化管理的重要手段,然而基础在线数据却存在各种缺失、异常等数据质量问题.提出了一种基于LSTM的污水处理厂在线数据清洗方法:首先基于统计学方法进行初步异常检测;再基于业务逻辑辅助界定异常;最后采用LSTM模型对数据异常(含缺失值)所在时刻进行预测并完成替换和清洗.该清洗方法已应用于多处污水处理厂在线系统中,结果表明该方法能有效检测并去除异常数据,保障在线模拟结果稳定可靠.

Abstract

The numerical simulation of wastewater treatment plant(WWTP)is becoming an important method to realize the intelligent management.However,the basic online data has vari-ous data quality problems such as missing and abnormal.In this paper,a method for cleaning the online data of WWTP based on LSTM is proposed.Firstly,preliminary anomaly detection was car-ried out based on statistical method.Then the anomaly is defined,and the anomaly detection results are corrected based on the logical rules in this field.Finally,LSTM model is trained to pre-dict the time of outliers(including missing values)to replace and complete cleaning.This cleaning method has been applied to the online system of several WWTP.The application results show that the method can effectively detect and remove abnormal data.Moreover,ensure the stability and reliability of the online simulation results.

关键词

异常检测/数据清洗/LSTM

Key words

Anomaly detection/Data cleaning/LSTM

引用本文复制引用

出版年

2024
给水排水
亚太建设科技信息研究院,中国建筑设计研究院,中国土木工程学会

给水排水

CSTPCD北大核心
影响因子:0.8
ISSN:1002-8471
段落导航相关论文