MirrorMirror: A Mobile Application to Improve Speechreading Acquisition

Benjamin Gorman; David Flatla

doi:10.1145/3173574.3173600

MirrorMirror: A Mobile Application to Improve Speechreading Acquisition

Benjamin Gorman, David Flatla

Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

5 Citations (Scopus)

205 Downloads (Pure)

Abstract

Many people around the world have difficulties in day-to-day conversation due to hearing loss. Hearing aids often fail to offer enough benefits and have low adoption rates. However, people with hearing loss find that speechreading can improve their understanding during conversation, but speechreading is a challenging skill to learn. Speechreading classes can improve acquisition, however there are a limited number of classes available and students can only practice effectively when attending class. To address this, we conducted a postal survey with 59 speechreading students to understand students’ perspectives on practicing. Using our findings, we developed an Android application called MirrorMirror – a new Speechreading Acquisition Tool (SAT) that allows students to practice their speechreading by recording and watching videos of people they frequently speak with. We evaluated MirrorMirror through three case studies with speechreading students and found that they could effectively target their speechreading practice on people, words and situations they encounter during daily conversations.

Original language	English
Title of host publication	Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
Place of Publication	New York
Publisher	Association for Computing Machinery
Pages	1-12
Number of pages	12
Volume	2018-April
ISBN (Electronic)	9781450356206, 9781450356213
DOIs	https://doi.org/10.1145/3173574.3173600
Publication status	Published - 21 Apr 2018
Event	CHI 2018 - Montreal, Canada Duration: 21 Apr 2018 → 26 Apr 2018 https://chi2018.acm.org/

Conference

Conference	CHI 2018
Country/Territory	Canada
City	Montreal
Period	21/04/18 → 26/04/18
Internet address	https://chi2018.acm.org/

Keywords

Accessibility
Hearing loss
Lipreading
Speechreading

ASJC Scopus subject areas

Human-Computer Interaction
Computer Graphics and Computer-Aided Design
Software

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1145/3173574.3173600Licence: CC BY-NC-SA

Final published version
© 2018 Copyright held by the owner/author(s) This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.
Final published version, 1.47 MBLicence: CC BY-NC-SA

Cite this

@inproceedings{cb2d6741759f450d915c4b85b8ded6b8,

title = "MirrorMirror: A Mobile Application to Improve Speechreading Acquisition",

abstract = "Many people around the world have difficulties in day-to-day conversation due to hearing loss. Hearing aids often fail to offer enough benefits and have low adoption rates. However, people with hearing loss find that speechreading can improve their understanding during conversation, but speechreading is a challenging skill to learn. Speechreading classes can improve acquisition, however there are a limited number of classes available and students can only practice effectively when attending class. To address this, we conducted a postal survey with 59 speechreading students to understand students{\textquoteright} perspectives on practicing. Using our findings, we developed an Android application called MirrorMirror – a new Speechreading Acquisition Tool (SAT) that allows students to practice their speechreading by recording and watching videos of people they frequently speak with. We evaluated MirrorMirror through three case studies with speechreading students and found that they could effectively target their speechreading practice on people, words and situations they encounter during daily conversations.",

keywords = "Accessibility, Hearing loss, Lipreading, Speechreading",

author = "Benjamin Gorman and David Flatla",

note = "This work was completed during the first author{\textquoteright}s Ph.D that was funded by the EPSRC Doctoral Training Partnership.; CHI 2018 ; Conference date: 21-04-2018 Through 26-04-2018",

year = "2018",

month = apr,

day = "21",

doi = "10.1145/3173574.3173600",

language = "English",

volume = "2018-April",

pages = "1--12",

booktitle = "Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery",

url = "https://chi2018.acm.org/",

}

TY - GEN

T1 - MirrorMirror

T2 - CHI 2018

AU - Gorman, Benjamin

AU - Flatla, David

N1 - This work was completed during the first author’s Ph.D that was funded by the EPSRC Doctoral Training Partnership.

PY - 2018/4/21

Y1 - 2018/4/21

N2 - Many people around the world have difficulties in day-to-day conversation due to hearing loss. Hearing aids often fail to offer enough benefits and have low adoption rates. However, people with hearing loss find that speechreading can improve their understanding during conversation, but speechreading is a challenging skill to learn. Speechreading classes can improve acquisition, however there are a limited number of classes available and students can only practice effectively when attending class. To address this, we conducted a postal survey with 59 speechreading students to understand students’ perspectives on practicing. Using our findings, we developed an Android application called MirrorMirror – a new Speechreading Acquisition Tool (SAT) that allows students to practice their speechreading by recording and watching videos of people they frequently speak with. We evaluated MirrorMirror through three case studies with speechreading students and found that they could effectively target their speechreading practice on people, words and situations they encounter during daily conversations.

AB - Many people around the world have difficulties in day-to-day conversation due to hearing loss. Hearing aids often fail to offer enough benefits and have low adoption rates. However, people with hearing loss find that speechreading can improve their understanding during conversation, but speechreading is a challenging skill to learn. Speechreading classes can improve acquisition, however there are a limited number of classes available and students can only practice effectively when attending class. To address this, we conducted a postal survey with 59 speechreading students to understand students’ perspectives on practicing. Using our findings, we developed an Android application called MirrorMirror – a new Speechreading Acquisition Tool (SAT) that allows students to practice their speechreading by recording and watching videos of people they frequently speak with. We evaluated MirrorMirror through three case studies with speechreading students and found that they could effectively target their speechreading practice on people, words and situations they encounter during daily conversations.

KW - Accessibility

KW - Hearing loss

KW - Lipreading

KW - Speechreading

UR - http://www.scopus.com/inward/record.url?scp=85046956025&partnerID=8YFLogxK

U2 - 10.1145/3173574.3173600

DO - 10.1145/3173574.3173600

M3 - Conference contribution

VL - 2018-April

SP - 1

EP - 12

BT - Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

CY - New York

Y2 - 21 April 2018 through 26 April 2018

ER -

MirrorMirror: A Mobile Application to Improve Speechreading Acquisition

Abstract

Conference

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Other files and links

Fingerprint

A Framework for Speechreading Acquisition Tools

Cite this

MirrorMirror: A Mobile Application to Improve Speechreading Acquisition

Abstract

Conference

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Other files and links

Fingerprint

Student theses

A Framework for Speechreading Acquisition Tools

Cite this