Speech and auditory interfaces for ubiquitous, immersive and personalized applications

Lei Xie; Wenhuai Zhao; Xiangzeng Zhou; Xiaohai Tian; Bingfeng Li; Naicai Sun; Yali Zhao; Yanning Zhang

doi:10.1109/UIC-ATC.2010.59

Speech and auditory interfaces for ubiquitous, immersive and personalized applications

Lei Xie
, Wenhuai Zhao
, Xiangzeng Zhou
, Xiaohai Tian
, Bingfeng Li
, Naicai Sun
, Yali Zhao
, Yanning Zhang

School of Computer Science

Northwestern Polytechnical University Xian

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

In this demonstration, we introduce our recent progress on speech and auditory technologies for potential ubiquitous, immersive and personalized applications. The first demo shows an intelligent spoken question answering system, which enables users to interact with a talking avatar via natural speech dialogues. The prototype system demonstrates our latest development on automatic speech recognition, keyword spotting, personalized text-to-speech synthesis and visual speech synthesis. The second demo exhibits a virtual concert with immersive audio effects. Through our virtual auditory technology, wearing simple earphones, listeners are able to experience immersive concert audio effects from an ordinary music file. We believe the technologies shown in the two demos can be easily deployed in many significant applications.

Original language	English
Title of host publication	Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010
Pages	503-505
Number of pages	3
DOIs	https://doi.org/10.1109/UIC-ATC.2010.59
State	Published - 2010
Event	Symposia and Workshops Held in Conjunction with the 7th International Conference on Ubiquitous Intelligence and Computing, UIC 2010 and the 7th International Conference on Autonomic and Trusted Computing, ATC 2010 - Xi'an, China Duration: 26 Oct 2010 → 29 Oct 2010

Publication series

Name	Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010

Conference

Conference	Symposia and Workshops Held in Conjunction with the 7th International Conference on Ubiquitous Intelligence and Computing, UIC 2010 and the 7th International Conference on Autonomic and Trusted Computing, ATC 2010
Country/Territory	China
City	Xi'an
Period	26/10/10 → 29/10/10

Keywords

Head related transfer functions
Human-computer interaction
Keyword spotting
Question answering
Speech recognition
Speech synthesis
Spoken dialogue system
Talking face
Virtual auditory
Visual speech synthesis

Access to Document

10.1109/UIC-ATC.2010.59

Cite this

Xie, L., Zhao, W., Zhou, X., Tian, X., Li, B., Sun, N., Zhao, Y., & Zhang, Y. (2010). Speech and auditory interfaces for ubiquitous, immersive and personalized applications. In Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010 (pp. 503-505). Article 5667124 (Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010). https://doi.org/10.1109/UIC-ATC.2010.59

Xie, Lei ; Zhao, Wenhuai ; Zhou, Xiangzeng et al. / Speech and auditory interfaces for ubiquitous, immersive and personalized applications. Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010. 2010. pp. 503-505 (Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010).

@inproceedings{5359c019e480479dabd83439157961ad,

title = "Speech and auditory interfaces for ubiquitous, immersive and personalized applications",

abstract = "In this demonstration, we introduce our recent progress on speech and auditory technologies for potential ubiquitous, immersive and personalized applications. The first demo shows an intelligent spoken question answering system, which enables users to interact with a talking avatar via natural speech dialogues. The prototype system demonstrates our latest development on automatic speech recognition, keyword spotting, personalized text-to-speech synthesis and visual speech synthesis. The second demo exhibits a virtual concert with immersive audio effects. Through our virtual auditory technology, wearing simple earphones, listeners are able to experience immersive concert audio effects from an ordinary music file. We believe the technologies shown in the two demos can be easily deployed in many significant applications.",

keywords = "Head related transfer functions, Human-computer interaction, Keyword spotting, Question answering, Speech recognition, Speech synthesis, Spoken dialogue system, Talking face, Virtual auditory, Visual speech synthesis",

author = "Lei Xie and Wenhuai Zhao and Xiangzeng Zhou and Xiaohai Tian and Bingfeng Li and Naicai Sun and Yali Zhao and Yanning Zhang",

year = "2010",

doi = "10.1109/UIC-ATC.2010.59",

language = "英语",

isbn = "9780769542720",

series = "Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010",

pages = "503--505",

booktitle = "Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010",

note = "Symposia and Workshops Held in Conjunction with the 7th International Conference on Ubiquitous Intelligence and Computing, UIC 2010 and the 7th International Conference on Autonomic and Trusted Computing, ATC 2010 ; Conference date: 26-10-2010 Through 29-10-2010",

}

Xie, L, Zhao, W, Zhou, X, Tian, X, Li, B, Sun, N, Zhao, Y & Zhang, Y 2010, Speech and auditory interfaces for ubiquitous, immersive and personalized applications. in Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010., 5667124, Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010, pp. 503-505, Symposia and Workshops Held in Conjunction with the 7th International Conference on Ubiquitous Intelligence and Computing, UIC 2010 and the 7th International Conference on Autonomic and Trusted Computing, ATC 2010, Xi'an, China, 26/10/10. https://doi.org/10.1109/UIC-ATC.2010.59

Speech and auditory interfaces for ubiquitous, immersive and personalized applications. / Xie, Lei; Zhao, Wenhuai; Zhou, Xiangzeng et al.
Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010. 2010. p. 503-505 5667124 (Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Speech and auditory interfaces for ubiquitous, immersive and personalized applications

AU - Xie, Lei

AU - Zhao, Wenhuai

AU - Zhou, Xiangzeng

AU - Tian, Xiaohai

AU - Li, Bingfeng

AU - Sun, Naicai

AU - Zhao, Yali

AU - Zhang, Yanning

PY - 2010

Y1 - 2010

N2 - In this demonstration, we introduce our recent progress on speech and auditory technologies for potential ubiquitous, immersive and personalized applications. The first demo shows an intelligent spoken question answering system, which enables users to interact with a talking avatar via natural speech dialogues. The prototype system demonstrates our latest development on automatic speech recognition, keyword spotting, personalized text-to-speech synthesis and visual speech synthesis. The second demo exhibits a virtual concert with immersive audio effects. Through our virtual auditory technology, wearing simple earphones, listeners are able to experience immersive concert audio effects from an ordinary music file. We believe the technologies shown in the two demos can be easily deployed in many significant applications.

AB - In this demonstration, we introduce our recent progress on speech and auditory technologies for potential ubiquitous, immersive and personalized applications. The first demo shows an intelligent spoken question answering system, which enables users to interact with a talking avatar via natural speech dialogues. The prototype system demonstrates our latest development on automatic speech recognition, keyword spotting, personalized text-to-speech synthesis and visual speech synthesis. The second demo exhibits a virtual concert with immersive audio effects. Through our virtual auditory technology, wearing simple earphones, listeners are able to experience immersive concert audio effects from an ordinary music file. We believe the technologies shown in the two demos can be easily deployed in many significant applications.

KW - Head related transfer functions

KW - Human-computer interaction

KW - Keyword spotting

KW - Question answering

KW - Speech recognition

KW - Speech synthesis

KW - Spoken dialogue system

KW - Talking face

KW - Virtual auditory

KW - Visual speech synthesis

UR - https://www.scopus.com/pages/publications/78651450538

U2 - 10.1109/UIC-ATC.2010.59

DO - 10.1109/UIC-ATC.2010.59

M3 - 会议稿件

AN - SCOPUS:78651450538

SN - 9780769542720

T3 - Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010

SP - 503

EP - 505

BT - Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010

T2 - Symposia and Workshops Held in Conjunction with the 7th International Conference on Ubiquitous Intelligence and Computing, UIC 2010 and the 7th International Conference on Autonomic and Trusted Computing, ATC 2010

Y2 - 26 October 2010 through 29 October 2010

ER -

Xie L, Zhao W, Zhou X, Tian X, Li B, Sun N et al. Speech and auditory interfaces for ubiquitous, immersive and personalized applications. In Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010. 2010. p. 503-505. 5667124. (Proceedings - Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing in Conjunction with the UIC 2010 and ATC 2010 Conferences, UIC-ATC 2010). doi: 10.1109/UIC-ATC.2010.59

Speech and auditory interfaces for ubiquitous, immersive and personalized applications

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this