首页|基于LSTM的污水处理厂在线数据清洗研究

基于LSTM的污水处理厂在线数据清洗研究

扫码查看
污水处理厂工艺仿真技术是实现污水处理厂智慧化管理的重要手段,然而基础在线数据却存在各种缺失、异常等数据质量问题.提出了一种基于LSTM的污水处理厂在线数据清洗方法:首先基于统计学方法进行初步异常检测;再基于业务逻辑辅助界定异常;最后采用LSTM模型对数据异常(含缺失值)所在时刻进行预测并完成替换和清洗.该清洗方法已应用于多处污水处理厂在线系统中,结果表明该方法能有效检测并去除异常数据,保障在线模拟结果稳定可靠.
Research on the WWTP online data cleaning based on LSTM
The numerical simulation of wastewater treatment plant(WWTP)is becoming an important method to realize the intelligent management.However,the basic online data has vari-ous data quality problems such as missing and abnormal.In this paper,a method for cleaning the online data of WWTP based on LSTM is proposed.Firstly,preliminary anomaly detection was car-ried out based on statistical method.Then the anomaly is defined,and the anomaly detection results are corrected based on the logical rules in this field.Finally,LSTM model is trained to pre-dict the time of outliers(including missing values)to replace and complete cleaning.This cleaning method has been applied to the online system of several WWTP.The application results show that the method can effectively detect and remove abnormal data.Moreover,ensure the stability and reliability of the online simulation results.

Anomaly detectionData cleaningLSTM

成志轩、张楠、蒋云鹏

展开 >

丹华水利环境技术(上海)有限公司,上海 200235

上海市政工程设计研究总院(集团)有限公司,上海 200092

异常检测 数据清洗 LSTM

2024

给水排水
亚太建设科技信息研究院,中国建筑设计研究院,中国土木工程学会

给水排水

CSTPCD北大核心
影响因子:0.8
ISSN:1002-8471
年,卷(期):2024.50(6)