Generating Out-of-Distribution Examples via Feature Crossover against Overconfidence Issue

Xiaolong Ma, Peican Zhu, Weilong Peng, Keke Tang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The problem of overconfident predictions on out-of-distribution (OOD) samples poses a significant challenge to the reliability and robustness of deep neural networks (DNNs). The reason for OOD overconfidence issue is that DNNs only learn the features of in-distribution (ID) samples in the training stage, while lacking the supervisory signal of OOD samples. Therefore, we can alleviate this problem by constructing an auxiliary OOD dataset. If the auxiliary OOD dataset belongs to OOD and is close to ID, it can teach the model more OOD knowledge, and further distinguish OOD samples from ID, which is manifested by the model outputting more evenly distributed confidence score for OOD samples. The key to solving this problem lies in how to construct such a high-quality auxiliary OOD dataset. In this paper, we have made preliminary explorations into the fusion of high-level features between samples, and proposed a simple but efficient method of generating OOD samples through feature crossover in the feature space. This method only requires ID data to generate a large number of OOD samples. Experimental results have demonstrated that using our method to construct OOD samples can effectively alleviate the problem of DNNs being overly confident on OOD samples.

Original languageEnglish
Title of host publicationICICN 2023 - 2023 IEEE 11th International Conference on Information, Communication and Networks
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages808-812
Number of pages5
ISBN (Electronic)9798350314014
DOIs
StatePublished - 2023
Event2023 IEEE 11th International Conference on Information, Communication and Networks, ICICN 2023 - Hybrid, Xi'an, China
Duration: 17 Aug 202320 Aug 2023

Publication series

NameICICN 2023 - 2023 IEEE 11th International Conference on Information, Communication and Networks

Conference

Conference2023 IEEE 11th International Conference on Information, Communication and Networks, ICICN 2023
Country/TerritoryChina
CityHybrid, Xi'an
Period17/08/2320/08/23

Keywords

  • deep learning
  • out-of-distribution detection
  • virtual outlier synthesis

Fingerprint

Dive into the research topics of 'Generating Out-of-Distribution Examples via Feature Crossover against Overconfidence Issue'. Together they form a unique fingerprint.

Cite this