Bridging Natruralistic Stimuli, Eye Movement And Brain Activity Via Cca And Locality Preserving Projection

Changhe Li, Jiaxing Gao, Zhibin He, Songyao Zhang, Yaonai Wei, Lei Du, Lei Guo, Junwei Han, Shu Zhang, Tuo Zhang

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Naturalistic stimuli provide more life-like multimodal inputs and promise to investigate brain activity and cognition. Many studies have succeeded in bridging multimedia features and semantics derived from brain responses. In this naturalistic stimulus paradigm, eye movement was widely used as a behavior measurement, which was also demonstrated to closely related to cognitive processes of individuals. However, there lacks an integrative work to bridge these three modalities ranging from low-level multimedia feature, high-level brain semantics, to human behavior. In this work, we adopted the canonical correlation analysis (CCA) method with the locality preserving projection (LPP) to correlate functional MRI based brain responses to multimedia features under the guidance of eye movement types. Canonical correlation was estimated between brain responses and multimedia features while the LPP constraint is used to preserve the temporal relationship by maximizing the discrimination between time points which have different eye movement types. Brain regions identified by our method exhibit a gradient on the cortex, and both selected brain regions and multimedia features have higher distinguishing ability among eye movement types than other unselected ones, suggestive of the validity of the method.

源语言英语
主期刊名ISBI 2022 - Proceedings
主期刊副标题2022 IEEE International Symposium on Biomedical Imaging
出版商IEEE Computer Society
ISBN(电子版)9781665429238
DOI
出版状态已出版 - 2022
活动19th IEEE International Symposium on Biomedical Imaging, ISBI 2022 - Kolkata, 印度
期限: 28 3月 202231 3月 2022

出版系列

姓名Proceedings - International Symposium on Biomedical Imaging
2022-March
ISSN(印刷版)1945-7928
ISSN(电子版)1945-8452

会议

会议19th IEEE International Symposium on Biomedical Imaging, ISBI 2022
国家/地区印度
Kolkata
时期28/03/2231/03/22

指纹

探究 'Bridging Natruralistic Stimuli, Eye Movement And Brain Activity Via Cca And Locality Preserving Projection' 的科研主题。它们共同构成独一无二的指纹。

引用此