跳到主要导航 跳到搜索 跳到主要内容

Exploring auditory network composition during free listening to audio excerpts via group-wise sparse representation

  • Northwestern Polytechnical University Xian
  • University of Georgia
  • Shaanxi Normal University

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

1 引用 (Scopus)

摘要

With the growing number of audio excerpts through various media and distribution channels, advanced audio analysis approaches have received significant interest in the multimedia field. However, current audio analysis approaches are still far from satisfactory due to the semantic gaps between the low-level acoustic features and high-level semantics perceived by human brain. In order to alleviate the problem, this paper propose a novel computational framework to bridge acoustic features with high-level semantic features derived from functional magnetic resonance imaging (fMRI) signals which record the brain's response during free listening to music/speech excerpts, and to explore the brain auditory network composition of acoustic features for different types of music/speech excerpts. Specifically, we identify meaningful brain networks and corresponding brain activities representing high-level semantic features via a novel group-wise sparse representation of whole brain fMRI signals. Then we associate the brain activities with specific low-level acoustic features and analyze the auditory network composition of acoustic features for different types of music/speech excerpts. Experimental results demonstrate that multiple acoustic features are involved in the brain auditory networks during free listening to music/speech excerpts. Meanwhile, there is considerable variability of auditory network composition of acoustic features for different types of music/speech. Our results provide new insights of how to narrow the semantic gaps in audio content analysis.

源语言英语
主期刊名2016 IEEE International Conference on Multimedia and Expo, ICME 2016
出版商IEEE Computer Society
ISBN(电子版)9781467372589
DOI
出版状态已出版 - 25 8月 2016
活动2016 IEEE International Conference on Multimedia and Expo, ICME 2016 - Seattle, 美国
期限: 11 7月 2016 → 15 7月 2016

丛书

姓名Proceedings - IEEE International Conference on Multimedia and Expo
卷2016-August
ISSN(印刷版)1945-7871
ISSN(电子版)1945-788X

会议

会议2016 IEEE International Conference on Multimedia and Expo, ICME 2016
国家/地区美国
市Seattle
时期11/07/16 → 15/07/16

学术指纹

探究 'Exploring auditory network composition during free listening to audio excerpts via group-wise sparse representation' 的科研主题。它们共同构成独一无二的学术指纹。

引用此