Aesthetics-Diven Online Summarization to First-Person Tourism Videos

Yiyang Shao; Bin Guo; Yuqi Zhang; Ke Ma; Zhiwen Yu

doi:10.1007/978-981-99-2385-4_24

Aesthetics-Diven Online Summarization to First-Person Tourism Videos

Yiyang Shao, Bin Guo, Yuqi Zhang, Ke Ma, Zhiwen Yu

School of Computer Science

Northwestern Polytechnical University Xian

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Nowadays video blog (vlog) has gradually become popular. In scenarios such as tourism, many vloggers use mobile terminals to record first-person videos, which have redundant information, complex scenes and continuous shots. Such videos bring inconvenience to the creation of vlogs. The technology of video summarization can extract the main information of original videos. However, these works usually rely on large computing resources, which are not applicable for this scene. This paper focuses on artistic video summaries of first-person perspective videos in tourism scenes, and at the same time takes the resource constraints of terminal devices into account. And we propose an aesthetics-driven online summarization method of the first-person tourism video. In the first stage, the model uses Canny operator and HoG features to quickly generate summaries online. And in the second stage, it further extracts video segments based on the aesthetics like color and symmetry of images. The results of experiments show that this method can effectively carry out video summarization and aesthetic processing, and the prototype based on the method was implemented with an APP.

Original language	English
Title of host publication	Computer Supported Cooperative Work and Social Computing - 17th CCF Conference, ChineseCSCW 2022, Revised Selected Papers
Editors	Yuqing Sun, Tun Lu, Yinzhang Guo, Xiaoxia Song, Hongfei Fan, Dongning Liu, Liping Gao, Bowen Du
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	326-336
Number of pages	11
ISBN (Print)	9789819923847
DOIs	https://doi.org/10.1007/978-981-99-2385-4_24
State	Published - 2023
Event	17th CCF Conference on Computer Supported Cooperative Work and Social Computing, ChineseCSCW 2022 - Taiyuan, China Duration: 25 Nov 2022 → 27 Nov 2022

Publication series

Name	Communications in Computer and Information Science
Volume	1682 CCIS
ISSN (Print)	1865-0929
ISSN (Electronic)	1865-0937

Conference

Conference	17th CCF Conference on Computer Supported Cooperative Work and Social Computing, ChineseCSCW 2022
Country/Territory	China
City	Taiyuan
Period	25/11/22 → 27/11/22

Keywords

Aesthetics extraction
First person view
Mobile Computing
Video summarization

Access to Document

10.1007/978-981-99-2385-4_24

Cite this

Shao, Y., Guo, B., Zhang, Y., Ma, K., & Yu, Z. (2023). Aesthetics-Diven Online Summarization to First-Person Tourism Videos. In Y. Sun, T. Lu, Y. Guo, X. Song, H. Fan, D. Liu, L. Gao, & B. Du (Eds.), Computer Supported Cooperative Work and Social Computing - 17th CCF Conference, ChineseCSCW 2022, Revised Selected Papers (pp. 326-336). (Communications in Computer and Information Science; Vol. 1682 CCIS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-981-99-2385-4_24

Shao, Yiyang ; Guo, Bin ; Zhang, Yuqi et al. / Aesthetics-Diven Online Summarization to First-Person Tourism Videos. Computer Supported Cooperative Work and Social Computing - 17th CCF Conference, ChineseCSCW 2022, Revised Selected Papers. editor / Yuqing Sun ; Tun Lu ; Yinzhang Guo ; Xiaoxia Song ; Hongfei Fan ; Dongning Liu ; Liping Gao ; Bowen Du. Springer Science and Business Media Deutschland GmbH, 2023. pp. 326-336 (Communications in Computer and Information Science).

@inproceedings{3db3b325e42a46b8a85b4dbb7f891d8c,

title = "Aesthetics-Diven Online Summarization to First-Person Tourism Videos",

abstract = "Nowadays video blog (vlog) has gradually become popular. In scenarios such as tourism, many vloggers use mobile terminals to record first-person videos, which have redundant information, complex scenes and continuous shots. Such videos bring inconvenience to the creation of vlogs. The technology of video summarization can extract the main information of original videos. However, these works usually rely on large computing resources, which are not applicable for this scene. This paper focuses on artistic video summaries of first-person perspective videos in tourism scenes, and at the same time takes the resource constraints of terminal devices into account. And we propose an aesthetics-driven online summarization method of the first-person tourism video. In the first stage, the model uses Canny operator and HoG features to quickly generate summaries online. And in the second stage, it further extracts video segments based on the aesthetics like color and symmetry of images. The results of experiments show that this method can effectively carry out video summarization and aesthetic processing, and the prototype based on the method was implemented with an APP.",

keywords = "Aesthetics extraction, First person view, Mobile Computing, Video summarization",

author = "Yiyang Shao and Bin Guo and Yuqi Zhang and Ke Ma and Zhiwen Yu",

note = "Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.; 17th CCF Conference on Computer Supported Cooperative Work and Social Computing, ChineseCSCW 2022 ; Conference date: 25-11-2022 Through 27-11-2022",

year = "2023",

doi = "10.1007/978-981-99-2385-4_24",

language = "英语",

isbn = "9789819923847",

series = "Communications in Computer and Information Science",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "326--336",

editor = "Yuqing Sun and Tun Lu and Yinzhang Guo and Xiaoxia Song and Hongfei Fan and Dongning Liu and Liping Gao and Bowen Du",

booktitle = "Computer Supported Cooperative Work and Social Computing - 17th CCF Conference, ChineseCSCW 2022, Revised Selected Papers",

}

Shao, Y, Guo, B, Zhang, Y, Ma, K & Yu, Z 2023, Aesthetics-Diven Online Summarization to First-Person Tourism Videos. in Y Sun, T Lu, Y Guo, X Song, H Fan, D Liu, L Gao & B Du (eds), Computer Supported Cooperative Work and Social Computing - 17th CCF Conference, ChineseCSCW 2022, Revised Selected Papers. Communications in Computer and Information Science, vol. 1682 CCIS, Springer Science and Business Media Deutschland GmbH, pp. 326-336, 17th CCF Conference on Computer Supported Cooperative Work and Social Computing, ChineseCSCW 2022, Taiyuan, China, 25/11/22. https://doi.org/10.1007/978-981-99-2385-4_24

Aesthetics-Diven Online Summarization to First-Person Tourism Videos. / Shao, Yiyang; Guo, Bin; Zhang, Yuqi et al.
Computer Supported Cooperative Work and Social Computing - 17th CCF Conference, ChineseCSCW 2022, Revised Selected Papers. ed. / Yuqing Sun; Tun Lu; Yinzhang Guo; Xiaoxia Song; Hongfei Fan; Dongning Liu; Liping Gao; Bowen Du. Springer Science and Business Media Deutschland GmbH, 2023. p. 326-336 (Communications in Computer and Information Science; Vol. 1682 CCIS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Aesthetics-Diven Online Summarization to First-Person Tourism Videos

AU - Shao, Yiyang

AU - Guo, Bin

AU - Zhang, Yuqi

AU - Ma, Ke

AU - Yu, Zhiwen

PY - 2023

Y1 - 2023

N2 - Nowadays video blog (vlog) has gradually become popular. In scenarios such as tourism, many vloggers use mobile terminals to record first-person videos, which have redundant information, complex scenes and continuous shots. Such videos bring inconvenience to the creation of vlogs. The technology of video summarization can extract the main information of original videos. However, these works usually rely on large computing resources, which are not applicable for this scene. This paper focuses on artistic video summaries of first-person perspective videos in tourism scenes, and at the same time takes the resource constraints of terminal devices into account. And we propose an aesthetics-driven online summarization method of the first-person tourism video. In the first stage, the model uses Canny operator and HoG features to quickly generate summaries online. And in the second stage, it further extracts video segments based on the aesthetics like color and symmetry of images. The results of experiments show that this method can effectively carry out video summarization and aesthetic processing, and the prototype based on the method was implemented with an APP.

AB - Nowadays video blog (vlog) has gradually become popular. In scenarios such as tourism, many vloggers use mobile terminals to record first-person videos, which have redundant information, complex scenes and continuous shots. Such videos bring inconvenience to the creation of vlogs. The technology of video summarization can extract the main information of original videos. However, these works usually rely on large computing resources, which are not applicable for this scene. This paper focuses on artistic video summaries of first-person perspective videos in tourism scenes, and at the same time takes the resource constraints of terminal devices into account. And we propose an aesthetics-driven online summarization method of the first-person tourism video. In the first stage, the model uses Canny operator and HoG features to quickly generate summaries online. And in the second stage, it further extracts video segments based on the aesthetics like color and symmetry of images. The results of experiments show that this method can effectively carry out video summarization and aesthetic processing, and the prototype based on the method was implemented with an APP.

KW - Aesthetics extraction

KW - First person view

KW - Mobile Computing

KW - Video summarization

UR - http://www.scopus.com/inward/record.url?scp=85161169217&partnerID=8YFLogxK

U2 - 10.1007/978-981-99-2385-4_24

DO - 10.1007/978-981-99-2385-4_24

M3 - 会议稿件

AN - SCOPUS:85161169217

SN - 9789819923847

T3 - Communications in Computer and Information Science

SP - 326

EP - 336

BT - Computer Supported Cooperative Work and Social Computing - 17th CCF Conference, ChineseCSCW 2022, Revised Selected Papers

A2 - Sun, Yuqing

A2 - Lu, Tun

A2 - Guo, Yinzhang

A2 - Song, Xiaoxia

A2 - Fan, Hongfei

A2 - Liu, Dongning

A2 - Gao, Liping

A2 - Du, Bowen

PB - Springer Science and Business Media Deutschland GmbH

T2 - 17th CCF Conference on Computer Supported Cooperative Work and Social Computing, ChineseCSCW 2022

Y2 - 25 November 2022 through 27 November 2022

ER -

Shao Y, Guo B, Zhang Y, Ma K, Yu Z. Aesthetics-Diven Online Summarization to First-Person Tourism Videos. In Sun Y, Lu T, Guo Y, Song X, Fan H, Liu D, Gao L, Du B, editors, Computer Supported Cooperative Work and Social Computing - 17th CCF Conference, ChineseCSCW 2022, Revised Selected Papers. Springer Science and Business Media Deutschland GmbH. 2023. p. 326-336. (Communications in Computer and Information Science). doi: 10.1007/978-981-99-2385-4_24