Inferring human interactions in meetings: A multimodal approach

Zhiwen Yu, Zhiyong Yu, Yusa Ko, Xingshe Zhou, Yuichi Nakamura

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

9 Scopus citations

Abstract

Social dynamics, such as human interaction is important for understanding how a conclusion was reached in a meeting and determining whether the meeting was well organized. In this paper, a multimodal approach is proposed to infer human semantic interactions in meeting discussions. The human interaction, such as proposing an idea, giving comments, expressing a positive opinion, etc., implies user role, attitude, or intention toward a topic. Our approach infers human interactions based on a variety of audiovisual and high-level features, e.g., gestures, attention, speech tone, speaking time, interaction occasion, and information about the previous interaction. Four different inference models including Support Vector Machine (SVM), Bayesian Net, Naïve Bayes, and Decision Tree are selected and compared in human interaction recognition. Our experimental results show that SVM outperforms other inference models, we can successfully infer human interactions with a recognition rate around 80%, and our multimodal approach achieves robust and reliable results by leveraging on the characteristics of each single modality.

Original languageEnglish
Title of host publicationUbiquitous Intelligence and Computing - 6th International Conference, UIC 2009, Proceedings
Pages14-24
Number of pages11
DOIs
StatePublished - 2009
Event6th International Conference on Ubiquitous Intelligence and Computing, UIC 2009 - Brisbane, QLD, Australia
Duration: 7 Jul 20099 Jul 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5585 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference6th International Conference on Ubiquitous Intelligence and Computing, UIC 2009
Country/TerritoryAustralia
CityBrisbane, QLD
Period7/07/099/07/09

Keywords

  • Human interaction
  • Multimodal recognition
  • Smart meeting

Fingerprint

Dive into the research topics of 'Inferring human interactions in meetings: A multimodal approach'. Together they form a unique fingerprint.

Cite this