TY - JOUR
T1 - Building a Bridge of Bounding Box Regression Between Oriented and Horizontal Object Detection in Remote Sensing Images
AU - Qian, Xiaoliang
AU - Wu, Baokun
AU - Cheng, Gong
AU - Yao, Xiwen
AU - Wang, Wei
AU - Han, Junwei
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2023
Y1 - 2023
N2 - Oriented object detection (OOD) aims to precisely detect the objects with arbitrary orientation in remote sensing images (RSIs). Up to now, most of the bounding box regression (BBR) losses for OOD are transferred from horizontal object detection (HOD) methods; however, the transferring requires lots of professional knowledge and experiences for designers, and consequently, many excellent BBR losses for HOD have not been transferred to OOD. To accelerate the research progress of BBR loss for OOD, a unified transferring strategy (UTS) is proposed to facilitate the transferring of BBR loss from HOD to OOD. The UTS proposes that the BBR of oriented bounding box (OBB) can be converted into the joint BBR of its horizontal smallest enclosing rectangle (HSER) and two offsets, so the BBR loss in HOD can be easily transferred to OOD using HSER as a bridge (BR). Following the UTS, a BBR loss named rotated-intersection of union (RIoU) loss is designed for OOD by transferring an advanced BBR loss in HOD, which can be considered as an example to show how to transfer. On the basis of RIoU loss, a focal RIoU (FRIoU) loss is proposed to assign larger weights to hard samples in the BBR. The comparisons with other BBR losses show that the RIoU and FRIoU losses can give better performance. The ablation study shows that giving more attention to hard samples in BBR is effective. The comparisons with many advanced methods demonstrate that the combinations of baseline methods and FRIoU loss achieve state-of-the-art (SOTA) performance on the DOTA and DIOR-R datasets.
AB - Oriented object detection (OOD) aims to precisely detect the objects with arbitrary orientation in remote sensing images (RSIs). Up to now, most of the bounding box regression (BBR) losses for OOD are transferred from horizontal object detection (HOD) methods; however, the transferring requires lots of professional knowledge and experiences for designers, and consequently, many excellent BBR losses for HOD have not been transferred to OOD. To accelerate the research progress of BBR loss for OOD, a unified transferring strategy (UTS) is proposed to facilitate the transferring of BBR loss from HOD to OOD. The UTS proposes that the BBR of oriented bounding box (OBB) can be converted into the joint BBR of its horizontal smallest enclosing rectangle (HSER) and two offsets, so the BBR loss in HOD can be easily transferred to OOD using HSER as a bridge (BR). Following the UTS, a BBR loss named rotated-intersection of union (RIoU) loss is designed for OOD by transferring an advanced BBR loss in HOD, which can be considered as an example to show how to transfer. On the basis of RIoU loss, a focal RIoU (FRIoU) loss is proposed to assign larger weights to hard samples in the BBR. The comparisons with other BBR losses show that the RIoU and FRIoU losses can give better performance. The ablation study shows that giving more attention to hard samples in BBR is effective. The comparisons with many advanced methods demonstrate that the combinations of baseline methods and FRIoU loss achieve state-of-the-art (SOTA) performance on the DOTA and DIOR-R datasets.
KW - Bounding box regression (BBR)
KW - focal rotated intersection of union (FRIoU) loss
KW - oriented object detection (OOD)
KW - remote sensing images (RSIs)
KW - unified transferring strategy (UTS)
UR - http://www.scopus.com/inward/record.url?scp=85151341655&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2023.3256373
DO - 10.1109/TGRS.2023.3256373
M3 - 文章
AN - SCOPUS:85151341655
SN - 0196-2892
VL - 61
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5605209
ER -