Feature selection for pose invariant lip biometrics

Adrian Pass; Jianguo Zhang; Darryl Stewart

Feature selection for pose invariant lip biometrics

Adrian Pass, Jianguo Zhang, Darryl Stewart

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

For the first time in this paper we present results showing the effect of out of plane speaker head pose variation on a lip based speaker verification system. Using appearance DCT based features, we adopt a Mutual Information analysis technique to highlight the class discriminant DCT components most robust to changes in out of plane pose. Experiments are conducted using the initial phase of a new multi view Audio-Visual database designed for research and development of pose-invariant speech and speaker recognition. We show that verification performance can be improved by substituting higher order horizontal DCT components for vertical, particularly in the case of a train/test pose angle mismatch. We further show that the best performance can be achieved by combining this alternative feature selection with multi view training, reporting a relative 45% Equal Error Rate reduction over a common energy based selection. © 2010 ISCA.

Original language	English
Title of host publication	11th Annual Conference of the International Speech Communication Association 2010 (INTERSPEECH 2010)
Subtitle of host publication	Proceedings
Publisher	International Speech Communication Association
Pages	1165-1168
Number of pages	4
Volume	2
ISBN (Print)	9781617821233
Publication status	Published - 2010
Event	11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All - International Conference Hall Makuhari Messe International Convention Complex , Makuhari, Chiba, Japan Duration: 26 Sept 2010 → 30 Sept 2010 http://mine.t.u-tokyo.ac.jp/is2010/index.html

Conference

Conference	11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All
Abbreviated title	INTERSPEECH 2010
Country/Territory	Japan
City	Makuhari, Chiba
Period	26/09/10 → 30/09/10
Internet address	http://mine.t.u-tokyo.ac.jp/is2010/index.html

Access to Document

1 Citations
1 Paper

Feature selection for pose invariant lip biometrics
Pass, A., Zhang, J. & Stewart, D., 28 Sept 2010.
Research output: Contribution to conference › Paper

1 Participation in conference

11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All
Zhang, J. (Participant)
28 Sept 2010
Activity: Participating in or organising an event types › Participation in conference

Cite this

Pass, A., Zhang, J., & Stewart, D. (2010). Feature selection for pose invariant lip biometrics. In 11th Annual Conference of the International Speech Communication Association 2010 (INTERSPEECH 2010): Proceedings (Vol. 2, pp. 1165-1168). International Speech Communication Association . http://www.scopus.com/record/display.url?eid=2-s2.0-79959845515&origin=resultslist&sort=plf-f&src=s&st1=Feature+Selection+for+Pose+Invariant+Lip+Biometrics&sid=519CA88E287E53F3338E63F77B2DF5B5.fM4vPBipdL1BpirDq5Cw%3a160&sot=b&sdt=b&sl=66&s=TITLE-ABS-KEY%28Feature+Selection+for+Pose+Invariant+Lip+Biometrics%29&relpos=0&relpos=0&citeCnt=0&searchTerm=TITLE-ABS-KEY%28Feature+Selection+for+Pose+Invariant+Lip+Biometrics%29

@inproceedings{082411c0aa8b43989e2fba736c0697af,

title = "Feature selection for pose invariant lip biometrics",

abstract = "For the first time in this paper we present results showing the effect of out of plane speaker head pose variation on a lip based speaker verification system. Using appearance DCT based features, we adopt a Mutual Information analysis technique to highlight the class discriminant DCT components most robust to changes in out of plane pose. Experiments are conducted using the initial phase of a new multi view Audio-Visual database designed for research and development of pose-invariant speech and speaker recognition. We show that verification performance can be improved by substituting higher order horizontal DCT components for vertical, particularly in the case of a train/test pose angle mismatch. We further show that the best performance can be achieved by combining this alternative feature selection with multi view training, reporting a relative 45\% Equal Error Rate reduction over a common energy based selection. {\textcopyright} 2010 ISCA.",

author = "Adrian Pass and Jianguo Zhang and Darryl Stewart",

year = "2010",

language = "English",

isbn = "9781617821233",

volume = "2",

pages = "1165--1168",

booktitle = "11th Annual Conference of the International Speech Communication Association 2010 (INTERSPEECH 2010)",

publisher = "International Speech Communication Association ",

note = "11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All, INTERSPEECH 2010 ; Conference date: 26-09-2010 Through 30-09-2010",

url = "http://mine.t.u-tokyo.ac.jp/is2010/index.html",

}

Pass, A, Zhang, J & Stewart, D 2010, Feature selection for pose invariant lip biometrics. in 11th Annual Conference of the International Speech Communication Association 2010 (INTERSPEECH 2010): Proceedings. vol. 2, International Speech Communication Association , pp. 1165-1168, 11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All, Makuhari, Chiba, Japan, 26/09/10. <http://www.scopus.com/record/display.url?eid=2-s2.0-79959845515&origin=resultslist&sort=plf-f&src=s&st1=Feature+Selection+for+Pose+Invariant+Lip+Biometrics&sid=519CA88E287E53F3338E63F77B2DF5B5.fM4vPBipdL1BpirDq5Cw%3a160&sot=b&sdt=b&sl=66&s=TITLE-ABS-KEY%28Feature+Selection+for+Pose+Invariant+Lip+Biometrics%29&relpos=0&relpos=0&citeCnt=0&searchTerm=TITLE-ABS-KEY%28Feature+Selection+for+Pose+Invariant+Lip+Biometrics%29>

Feature selection for pose invariant lip biometrics. / Pass, Adrian; Zhang, Jianguo; Stewart, Darryl.
11th Annual Conference of the International Speech Communication Association 2010 (INTERSPEECH 2010): Proceedings. Vol. 2 International Speech Communication Association , 2010. p. 1165-1168.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Feature selection for pose invariant lip biometrics

AU - Pass, Adrian

AU - Zhang, Jianguo

AU - Stewart, Darryl

PY - 2010

Y1 - 2010

N2 - For the first time in this paper we present results showing the effect of out of plane speaker head pose variation on a lip based speaker verification system. Using appearance DCT based features, we adopt a Mutual Information analysis technique to highlight the class discriminant DCT components most robust to changes in out of plane pose. Experiments are conducted using the initial phase of a new multi view Audio-Visual database designed for research and development of pose-invariant speech and speaker recognition. We show that verification performance can be improved by substituting higher order horizontal DCT components for vertical, particularly in the case of a train/test pose angle mismatch. We further show that the best performance can be achieved by combining this alternative feature selection with multi view training, reporting a relative 45% Equal Error Rate reduction over a common energy based selection. © 2010 ISCA.

AB - For the first time in this paper we present results showing the effect of out of plane speaker head pose variation on a lip based speaker verification system. Using appearance DCT based features, we adopt a Mutual Information analysis technique to highlight the class discriminant DCT components most robust to changes in out of plane pose. Experiments are conducted using the initial phase of a new multi view Audio-Visual database designed for research and development of pose-invariant speech and speaker recognition. We show that verification performance can be improved by substituting higher order horizontal DCT components for vertical, particularly in the case of a train/test pose angle mismatch. We further show that the best performance can be achieved by combining this alternative feature selection with multi view training, reporting a relative 45% Equal Error Rate reduction over a common energy based selection. © 2010 ISCA.

M3 - Conference contribution

SN - 9781617821233

VL - 2

SP - 1165

EP - 1168

BT - 11th Annual Conference of the International Speech Communication Association 2010 (INTERSPEECH 2010)

PB - International Speech Communication Association

T2 - 11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All

Y2 - 26 September 2010 through 30 September 2010

ER -

Feature selection for pose invariant lip biometrics

Abstract

Conference

Access to Document

Fingerprint

Research output

Feature selection for pose invariant lip biometrics

Activities

11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All

Cite this