Classification of fusing SAR and multispectral image via deep bimodal autoencoders

Jie Geng, Hongyu Wang, Jianchao Fan, Xiaorui Ma

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

9 Scopus citations

Abstract

Classification of multisensor data provides potential advantages over a single sensor in accuracy. In this paper, deep bimodal autoencoders are proposed for classification of fusing synthetic aperture radar (SAR) and multispectral images. The proposed deep network based on autoencoders is trained to discover both independencies of each modality and correlations across the modalities. Specifically, the sparse encoding layers in the front are applied to learn features of each modality, then shared representation layers in the middle are developed to learn fused features of two modalities, finally softmax classifier in the top is adopted for classification. Experimental results demonstrate that the proposed network is able to yield superior classification performance compared with some related networks.

Original languageEnglish
Title of host publication2017 IEEE International Geoscience and Remote Sensing Symposium
Subtitle of host publicationInternational Cooperation for Global Awareness, IGARSS 2017 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages823-826
Number of pages4
ISBN (Electronic)9781509049516
DOIs
StatePublished - 1 Dec 2017
Externally publishedYes
Event37th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2017 - Fort Worth, United States
Duration: 23 Jul 201728 Jul 2017

Publication series

NameInternational Geoscience and Remote Sensing Symposium (IGARSS)
Volume2017-July

Conference

Conference37th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2017
Country/TerritoryUnited States
CityFort Worth
Period23/07/1728/07/17

Keywords

  • Data fusion
  • deep learning
  • image classification
  • multispectral image
  • synthetic aperture radar (SAR) image

Fingerprint

Dive into the research topics of 'Classification of fusing SAR and multispectral image via deep bimodal autoencoders'. Together they form a unique fingerprint.

Cite this