MirrorMirror: A Mobile Application to Improve Speechreading Acquisition

Benjamin Gorman, David Flatla

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Many people around the world have difficulties in day-to-day conversation due to hearing loss. Hearing aids often fail to offer enough benefits and have low adoption rates. However, people with hearing loss find that speechreading can improve their understanding during conversation, but speechreading is a challenging skill to learn. Speechreading classes can improve acquisition, however there are a limited number of classes available and students can only practice effectively when attending class. To address this, we conducted a postal survey with 59 speechreading students to understand students’ perspectives on practicing. Using our findings, we developed an Android application called MirrorMirror – a new Speechreading Acquisition Tool (SAT) that allows students to practice their speechreading by recording and watching videos of people they frequently speak with. We evaluated MirrorMirror through three case studies with speechreading students and found that they could effectively target their speechreading practice on people, words and situations they encounter during daily conversations.
LanguageEnglish
Title of host publicationProceedings of the 2018 CHI Conference on Human Factors in Computing Systems
Place of PublicationNew York
PublisherAssociation for Computing Machinery
Pages1-12
Number of pages12
ISBN (Electronic)9781450356206
DOIs
Publication statusPublished - 21 Apr 2018
EventCHI 2018 - Montreal, Canada
Duration: 21 Apr 201826 Apr 2018
https://chi2018.acm.org/

Conference

ConferenceCHI 2018
CountryCanada
CityMontreal
Period21/04/1826/04/18
Internet address

Fingerprint

conversation
student
recording
video

Keywords

  • Speechreading
  • Hearing loss
  • Lipreading
  • Accessibility

Cite this

Gorman, B., & Flatla, D. (2018). MirrorMirror: A Mobile Application to Improve Speechreading Acquisition. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1-12). [Paper 26] New York: Association for Computing Machinery. https://doi.org/10.1145/3173574.3173600
Gorman, Benjamin ; Flatla, David. / MirrorMirror : A Mobile Application to Improve Speechreading Acquisition. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. New York : Association for Computing Machinery, 2018. pp. 1-12
@inproceedings{cb2d6741759f450d915c4b85b8ded6b8,
title = "MirrorMirror: A Mobile Application to Improve Speechreading Acquisition",
abstract = "Many people around the world have difficulties in day-to-day conversation due to hearing loss. Hearing aids often fail to offer enough benefits and have low adoption rates. However, people with hearing loss find that speechreading can improve their understanding during conversation, but speechreading is a challenging skill to learn. Speechreading classes can improve acquisition, however there are a limited number of classes available and students can only practice effectively when attending class. To address this, we conducted a postal survey with 59 speechreading students to understand students’ perspectives on practicing. Using our findings, we developed an Android application called MirrorMirror – a new Speechreading Acquisition Tool (SAT) that allows students to practice their speechreading by recording and watching videos of people they frequently speak with. We evaluated MirrorMirror through three case studies with speechreading students and found that they could effectively target their speechreading practice on people, words and situations they encounter during daily conversations.",
keywords = "Speechreading, Hearing loss, Lipreading, Accessibility",
author = "Benjamin Gorman and David Flatla",
note = "This work was completed during the first author’s Ph.D that was funded by the EPSRC Doctoral Training Partnership.",
year = "2018",
month = "4",
day = "21",
doi = "10.1145/3173574.3173600",
language = "English",
pages = "1--12",
booktitle = "Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems",
publisher = "Association for Computing Machinery",

}

Gorman, B & Flatla, D 2018, MirrorMirror: A Mobile Application to Improve Speechreading Acquisition. in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems., Paper 26, Association for Computing Machinery, New York, pp. 1-12, CHI 2018, Montreal, Canada, 21/04/18. https://doi.org/10.1145/3173574.3173600

MirrorMirror : A Mobile Application to Improve Speechreading Acquisition. / Gorman, Benjamin; Flatla, David.

Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. New York : Association for Computing Machinery, 2018. p. 1-12 Paper 26.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - MirrorMirror

T2 - A Mobile Application to Improve Speechreading Acquisition

AU - Gorman, Benjamin

AU - Flatla, David

N1 - This work was completed during the first author’s Ph.D that was funded by the EPSRC Doctoral Training Partnership.

PY - 2018/4/21

Y1 - 2018/4/21

N2 - Many people around the world have difficulties in day-to-day conversation due to hearing loss. Hearing aids often fail to offer enough benefits and have low adoption rates. However, people with hearing loss find that speechreading can improve their understanding during conversation, but speechreading is a challenging skill to learn. Speechreading classes can improve acquisition, however there are a limited number of classes available and students can only practice effectively when attending class. To address this, we conducted a postal survey with 59 speechreading students to understand students’ perspectives on practicing. Using our findings, we developed an Android application called MirrorMirror – a new Speechreading Acquisition Tool (SAT) that allows students to practice their speechreading by recording and watching videos of people they frequently speak with. We evaluated MirrorMirror through three case studies with speechreading students and found that they could effectively target their speechreading practice on people, words and situations they encounter during daily conversations.

AB - Many people around the world have difficulties in day-to-day conversation due to hearing loss. Hearing aids often fail to offer enough benefits and have low adoption rates. However, people with hearing loss find that speechreading can improve their understanding during conversation, but speechreading is a challenging skill to learn. Speechreading classes can improve acquisition, however there are a limited number of classes available and students can only practice effectively when attending class. To address this, we conducted a postal survey with 59 speechreading students to understand students’ perspectives on practicing. Using our findings, we developed an Android application called MirrorMirror – a new Speechreading Acquisition Tool (SAT) that allows students to practice their speechreading by recording and watching videos of people they frequently speak with. We evaluated MirrorMirror through three case studies with speechreading students and found that they could effectively target their speechreading practice on people, words and situations they encounter during daily conversations.

KW - Speechreading

KW - Hearing loss

KW - Lipreading

KW - Accessibility

U2 - 10.1145/3173574.3173600

DO - 10.1145/3173574.3173600

M3 - Conference contribution

SP - 1

EP - 12

BT - Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

CY - New York

ER -

Gorman B, Flatla D. MirrorMirror: A Mobile Application to Improve Speechreading Acquisition. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery. 2018. p. 1-12. Paper 26 https://doi.org/10.1145/3173574.3173600