MIWAE: Deep Generative Modelling and Imputation of Incomplete Data

Pierre-Alexandre Mattei, Jes Frellsen

Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review

Abstract

We consider the problem of handling missing data with deep latent variable models (DLVMs). First, we present a simple technique to train DLVMs when the training set contains missing-at-random data. Our approach, called MIWAE, is based on the importance-weighted autoencoder (IWAE), and maximises a potentially tight lower bound of the log-likelihood of the observed data. Compared to the original IWAE, our algorithm does not induce any additional computational overhead due to the missing data. We also develop Monte Carlo techniques for single and multiple imputation using a DLVM trained on an incomplete data set. We illustrate our approach by training a convolutional DLVM on incomplete static binarisations of MNIST. Moreover, on various continuous data sets, we show that MIWAE provides extremely accurate single imputations, and is highly competitive with state-of-the-art methods.
OriginalsprogEngelsk
TitelProceedings of the 36th International Conference on Machine Learning, PMLR
Vol/bind97
Publikationsdato2019
Sider4413-4423
StatusUdgivet - 2019

Emneord

  • Deep latent variable models
  • Missing data
  • Importance-weighted autoencoder
  • Monte Carlo techniques
  • Data imputation

Fingeraftryk

Dyk ned i forskningsemnerne om 'MIWAE: Deep Generative Modelling and Imputation of Incomplete Data'. Sammen danner de et unikt fingeraftryk.

Citationsformater