A Joint Convolutional Neural Networks and Context Transfer for Street Scenes Labeling

科研成果: 期刊稿件文章同行评审

123 引用 (Scopus)

摘要

Street scene understanding is an essential task for autonomous driving. One important step toward this direction is scene labeling, which annotates each pixel in the images with a correct class label. Although many approaches have been developed, there are still some weak points. First, many methods are based on the hand-crafted features whose image representation ability is limited. Second, they cannot label foreground objects accurately due to the data set bias. Third, in the refinement stage, the traditional Markov random filed inference is prone to over smoothness. For improving the above problems, this paper proposes a joint method of priori convolutional neural networks at superpixel level (called as 'priori s-CNNs') and soft restricted context transfer. Our contributions are threefold: 1) a priori s-CNNs model that learns priori location information at superpixel level is proposed to describe various objects discriminatingly; 2) a hierarchical data augmentation method is presented to alleviate data set bias in the priori s-CNNs training stage, which improves foreground objects labeling significantly; and 3) a soft restricted MRF energy function is defined to improve the priori s-CNNs model's labeling performance and reduce the over smoothness at the same time. The proposed approach is verified on CamVid data set (11 classes) and SIFT Flow Street data set (16 classes) and achieves a competitive performance.

源语言英语
页(从-至)1457-1470
页数14
期刊IEEE Transactions on Intelligent Transportation Systems
19
5
DOI
出版状态已出版 - 5月 2018

指纹

探究 'A Joint Convolutional Neural Networks and Context Transfer for Street Scenes Labeling' 的科研主题。它们共同构成独一无二的指纹。

引用此