Lip temporal pattern analysis for automatic visual speech recognition

Lei Xie; Xiuli Cai; Zhonghua Fu; Dongmei Jiang; Rongchun Zhao

Lip temporal pattern analysis for automatic visual speech recognition

Lei Xie, Xiuli Cai, Zhonghua Fu, Dongmei Jiang, Rongchun Zhao

School of Computer Science

Northwestern Polytechnical University Xian

Research output: Contribution to conference › Paper › peer-review

2 Scopus citations

Abstract

This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

Original language	English
Pages	703-706
Number of pages	4
State	Published - 2004
Event	2004 7th International Conference on Signal Processing Proceedings (ICSP'04) - Beijing, China Duration: 31 Aug 2004 → 4 Sep 2004

Conference

Conference	2004 7th International Conference on Signal Processing Proceedings (ICSP'04)
Country/Territory	China
City	Beijing
Period	31/08/04 → 4/09/04

Keywords

Feature extraction
Lip temporal pattern
Lipreading
Visual speech recognition

Cite this

@conference{4dfa717115b94c0c8ec16708864fc171,

title = "Lip temporal pattern analysis for automatic visual speech recognition",

abstract = "This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.",

keywords = "Feature extraction, Lip temporal pattern, Lipreading, Visual speech recognition",

author = "Lei Xie and Xiuli Cai and Zhonghua Fu and Dongmei Jiang and Rongchun Zhao",

year = "2004",

language = "英语",

pages = "703--706",

note = "2004 7th International Conference on Signal Processing Proceedings (ICSP'04) ; Conference date: 31-08-2004 Through 04-09-2004",

}

TY - CONF

T1 - Lip temporal pattern analysis for automatic visual speech recognition

AU - Xie, Lei

AU - Cai, Xiuli

AU - Fu, Zhonghua

AU - Jiang, Dongmei

AU - Zhao, Rongchun

PY - 2004

Y1 - 2004

N2 - This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

AB - This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

KW - Feature extraction

KW - Lip temporal pattern

KW - Lipreading

KW - Visual speech recognition

UR - http://www.scopus.com/inward/record.url?scp=7744230766&partnerID=8YFLogxK

M3 - 论文

AN - SCOPUS:7744230766

SP - 703

EP - 706

T2 - 2004 7th International Conference on Signal Processing Proceedings (ICSP'04)

Y2 - 31 August 2004 through 4 September 2004

ER -

Lip temporal pattern analysis for automatic visual speech recognition

Abstract

Conference

Keywords

Other files and links

Fingerprint

Cite this