Lip temporal pattern analysis for automatic visual speech recognition

Lei Xie; Xiuli Cai; Zhonghua Fu; Dongmei Jiang; Rongchun Zhao

Lip temporal pattern analysis for automatic visual speech recognition

Lei Xie
, Xiuli Cai
, Zhonghua Fu
, Dongmei Jiang
, Rongchun Zhao

School of Computer Science

Northwestern Polytechnical University Xian

Research output: Contribution to conference › Paper › peer-review

2 Scopus citations

Abstract

This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

Original language	English
Pages	703-706
Number of pages	4
State	Published - 2004
Event	2004 7th International Conference on Signal Processing Proceedings (ICSP'04) - Beijing, China Duration: 31 Aug 2004 → 4 Sep 2004

Conference

Conference	2004 7th International Conference on Signal Processing Proceedings (ICSP'04)
Country/Territory	China
City	Beijing
Period	31/08/04 → 4/09/04

Keywords

Feature extraction
Lip temporal pattern
Lipreading
Visual speech recognition

Cite this

@conference{4dfa717115b94c0c8ec16708864fc171,

title = "Lip temporal pattern analysis for automatic visual speech recognition",

abstract = "This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.",

keywords = "Feature extraction, Lip temporal pattern, Lipreading, Visual speech recognition",

author = "Lei Xie and Xiuli Cai and Zhonghua Fu and Dongmei Jiang and Rongchun Zhao",

year = "2004",

language = "英语",

pages = "703--706",

note = "2004 7th International Conference on Signal Processing Proceedings (ICSP'04) ; Conference date: 31-08-2004 Through 04-09-2004",

}

TY - CONF

T1 - Lip temporal pattern analysis for automatic visual speech recognition

AU - Xie, Lei

AU - Cai, Xiuli

AU - Fu, Zhonghua

AU - Jiang, Dongmei

AU - Zhao, Rongchun

PY - 2004

Y1 - 2004

N2 - This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

AB - This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

KW - Feature extraction

KW - Lip temporal pattern

KW - Lipreading

KW - Visual speech recognition

UR - https://www.scopus.com/pages/publications/7744230766

M3 - 论文

AN - SCOPUS:7744230766

SP - 703

EP - 706

T2 - 2004 7th International Conference on Signal Processing Proceedings (ICSP'04)

Y2 - 31 August 2004 through 4 September 2004

ER -

Lip temporal pattern analysis for automatic visual speech recognition

Abstract

Conference

Keywords

Other files and links

Fingerprint

Cite this