Lip temporal pattern analysis for automatic visual speech recognition

Lei Xie, Xiuli Cai, Zhonghua Fu, Dongmei Jiang, Rongchun Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

Original languageEnglish
Title of host publication2004 7th International Conference on Signal Processing Proceedings, ICSP
Pages706-709
Number of pages4
StatePublished - 2004
Event2004 7th International Conference on Signal Processing Proceedings, ICSP - Beijing, China
Duration: 31 Aug 20044 Sep 2004

Publication series

Name2004 7th International Conference on Signal Processing Proceedings, ICSP

Conference

Conference2004 7th International Conference on Signal Processing Proceedings, ICSP
Country/TerritoryChina
CityBeijing
Period31/08/044/09/04

Keywords

  • Feature extraction
  • Lip temporal pattern
  • Lipreading
  • Visual speech recognition

Fingerprint

Dive into the research topics of 'Lip temporal pattern analysis for automatic visual speech recognition'. Together they form a unique fingerprint.

Cite this