Lip temporal pattern analysis for automatic visual speech recognition

Lei Xie; Xiuli Cai; Zhonghua Fu; Dongmei Jiang; Rongchun Zhao

Lip temporal pattern analysis for automatic visual speech recognition

Lei Xie, Xiuli Cai, Zhonghua Fu, Dongmei Jiang, Rongchun Zhao

计算机学院

Northwestern Polytechnical University Xian

科研成果: 会议稿件 › 论文 › 同行评审

2 引用（Scopus）

摘要

This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

源语言	英语
页	703-706
页数	4
出版状态	已出版 - 2004
活动	2004 7th International Conference on Signal Processing Proceedings (ICSP'04) - Beijing, 中国期限: 31 8月 2004 → 4 9月 2004

会议

会议	2004 7th International Conference on Signal Processing Proceedings (ICSP'04)
国家/地区	中国
市	Beijing
时期	31/08/04 → 4/09/04

其它文件与链接

链接到 Scopus 的出版物

引用此

@conference{4dfa717115b94c0c8ec16708864fc171,

title = "Lip temporal pattern analysis for automatic visual speech recognition",

abstract = "This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.",

keywords = "Feature extraction, Lip temporal pattern, Lipreading, Visual speech recognition",

author = "Lei Xie and Xiuli Cai and Zhonghua Fu and Dongmei Jiang and Rongchun Zhao",

year = "2004",

language = "英语",

pages = "703--706",

note = "2004 7th International Conference on Signal Processing Proceedings (ICSP'04) ; Conference date: 31-08-2004 Through 04-09-2004",

}

TY - CONF

T1 - Lip temporal pattern analysis for automatic visual speech recognition

AU - Xie, Lei

AU - Cai, Xiuli

AU - Fu, Zhonghua

AU - Jiang, Dongmei

AU - Zhao, Rongchun

PY - 2004

Y1 - 2004

N2 - This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

AB - This paper presents a novel approach to processing temporal lip motion information for dynamic visual feature extraction in visual speech recognition. The long-time Lip TempoRAl Patterns (LipTRAPs) of visual phonemes are introduced to analyze the nature of lip shape changes when uttering speech. A dynamic visual feature is also proposed based on the LipTRAPs. Visual speech recognition experiments on a connected-digits task show that the LipTRAP feature can yield significant WRR improvments than conventional delta features.

KW - Feature extraction

KW - Lip temporal pattern

KW - Lipreading

KW - Visual speech recognition

UR - http://www.scopus.com/inward/record.url?scp=7744230766&partnerID=8YFLogxK

M3 - 论文

AN - SCOPUS:7744230766

SP - 703

EP - 706

T2 - 2004 7th International Conference on Signal Processing Proceedings (ICSP'04)

Y2 - 31 August 2004 through 4 September 2004

ER -

Lip temporal pattern analysis for automatic visual speech recognition

摘要

会议

其它文件与链接

指纹

引用此