Probabilistic Inference via Deep Learning

Typical inference approaches that work with high-dimensional visual measurements use hand-engineered image features (e.g. SIFT) that require combinatorial data association, or predict only hidden state mean without considering its uncertainty and multi-modality aspects. We develop a novel approach to infer system hidden state from visual observations via CNN features which are outputs of a CNN classifier. To that end, at pre-deployment stage we use neural networks to learn a generative viewpoint-dependent model of CNN features given the robot pose and approximate this model by a spatially varying Gaussian distribution. Further, at deployment this model is utilized within a Bayesian framework for probabilistic inference, considering a robot localization problem. Our method does not involve data association and provides uncertainty covariance of the final estimation. Moreover, we show empirically that the CNN feature likelihood is unimodal which simplifies the inference task. We test our method in simulated a Unreal Engine environment, where we succeed to retrieve high-level state information from CNN features and produce trajectory estimation with high accuracy. Additionally, we analyze robustness of our approach to different light conditions.

 

Related Publications:

In Proceedings

  • D. Kopitkov and V. Indelman. Bayesian Information Recovery from CNN for Probabilistic Inference. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), October 2018.
    [BibTeX] [PDF] [Slides]
    @inproceedings{Kopitkov18iros,
    author = {D. Kopitkov and V. Indelman},
    title = {Bayesian Information Recovery from CNN for Probabilistic Inference},
    booktitle = "IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)",
    year = 2018,
    month = "October",
    pdf = "http://indelman.github.io/ANPL-Website/Publications/Kopitkov18iros.pdf",
    slides = "http://indelman.github.io/ANPL-Website/Publications/Kopitkov18iros_slides.pdf",
    location = {Madrid, Spain},
    researchtopic = {InfoRecoveryCNN},
    }

Technical Reports

  • D. Kopitkov and V. Indelman. General Probabilistic Surface Optimization and Log Density Estimation. Technical Report, 2019.
    [BibTeX] [ArXiv]
    @TechReport{Kopitkov19arxiv,
    author = {D. Kopitkov and V. Indelman},
    title = {General Probabilistic Surface Optimization and Log Density Estimation},
    year = 2019,
    arxiv = "https://arxiv.org/pdf/1903.10567",
    researchtopic = {deepPDF, InfoRecoveryCNN},
    }

  • D. Kopitkov and V. Indelman. Deep PDF: Probabilistic Surface Optimization and Density Estimation. Technical Report, 2018.
    [BibTeX] [ArXiv]
    @TechReport{Kopitkov18arxiv,
    author = {D. Kopitkov and V. Indelman},
    title = {Deep PDF: Probabilistic Surface Optimization and Density Estimation},
    year = 2018,
    arxiv = "http://arxiv.org/abs/1807.10728",
    researchtopic = {deepPDF, InfoRecoveryCNN},
    }