首页|Detecting out-of-distribution samples via variational auto-encoder with reliable uncertainty estimation

Detecting out-of-distribution samples via variational auto-encoder with reliable uncertainty estimation

扫码查看
? 2021 Elsevier LtdVariational autoencoders (VAEs) are influential generative models with rich representation capabilities from the deep neural network architecture and Bayesian method. However, VAE models have a weakness that assign a higher likelihood to out-of-distribution (OOD) inputs than in-distribution (ID) inputs. To address this problem, a reliable uncertainty estimation is considered to be critical for in-depth understanding of OOD inputs. In this study, we propose an improved noise contrastive prior (INCP) to be able to integrate into the encoder of VAEs, called INCPVAE. INCP is scalable, trainable and compatible with VAEs, and it also adopts the merits from the INCP for uncertainty estimation. Experiments on various datasets demonstrate that compared to the standard VAEs, our model is superior in uncertainty estimation for the OOD data and is robust in anomaly detection tasks. The INCPVAE model obtains reliable uncertainty estimation for OOD inputs and solves the OOD problem in VAE models.

Noise contrastive priorOut-of-distribution detectionUncertainty estimationVariational auto-encoder

Ran X.、Xu M.、Mei L.、Xu Q.、Liu Q.

展开 >

Shenzhen Key Laboratory of Smart Healthcare Engineering Department of Biomedical Engineering

Center for Brain Inspired Computing Research Department of Precision Instrument Tsinghua University

China Automotive Engineering Research Institute

School of Artifical Intelligence Electronic and Electrical Engineering School of Artifical

展开 >

2022

Neural Networks

Neural Networks

EISCI
ISSN:0893-6080
年,卷(期):2022.145
  • 8
  • 40