NP-PROV: Neural Processes with Position-Relevant-Only Variances

Xuesong Wang, Lina Yao, Xianzhi Wang, Feiping Nie, Boualem Benatallah

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Neural Processes (NPs) families encode distributions over functions to a latent representation given a set of context data, and decode posterior mean and variance at unknown locations. Since mean and variance are derived from the same latent space, they may fail on out-of-domain tasks where fluctuations in function values amplify the model uncertainty. We present a new member named Neural Processes with Position-Relevant-Only Variances (NP-PROV). NP-PROV hypothesizes that a target point close to a context point has small uncertainty, regardless of the function value at that position. The resulting approach derives mean and variance from a function-value-related space and a position-related-only latent space separately. Our evaluation on synthetic and real-world datasets reveals that NP-PROV can achieve state-of-the-art likelihood while retaining a bounded variance when drifts exist in the function value.

Original languageEnglish
Title of host publicationWeb Information Systems Engineering - WISE 2021 - 22nd International Conference on Web Information Systems Engineering, WISE 2021, Proceedings
EditorsWenjie Zhang, Lei Zou, Zakaria Maamar, Lu Chen
PublisherSpringer Science and Business Media Deutschland GmbH
Pages129-142
Number of pages14
ISBN (Print)9783030908874
DOIs
StatePublished - 2021
Event22nd International Conference on Web Information Systems Engineering, WISE 2021 - Melbourne, Australia
Duration: 26 Oct 202129 Oct 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13080 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference22nd International Conference on Web Information Systems Engineering, WISE 2021
Country/TerritoryAustralia
CityMelbourne
Period26/10/2129/10/21

Keywords

  • Neural processes
  • Position-relevant-only variance
  • Uncertainty evaluation

Fingerprint

Dive into the research topics of 'NP-PROV: Neural Processes with Position-Relevant-Only Variances'. Together they form a unique fingerprint.

Cite this