ACE-LP: Augmenting Communication using Environmental Data to drive Language Prediction

Rolf Black, Per Ola Kristensson, Stephen McKenna, Jianguo Zhang, Annalu Waller

Research output: Contribution to conferencePoster

Abstract

Nonspeaking disabled people who use Speech Generating Devices (SGDs) communicate an average of between 8 and 12 words per minute (wpm) compared to typical adult speech of 150-190 wpm. For some, e.g., Prof Stephen Hawking who relies on a single switch access, rates fall to 1-2 wpm. The ACE-LP project aims to develop a communication system for nonspeaking people which will improve on the speed of communication by automatically populating the system with appropriate conversational items within an adaptive interface that provides control over timing and delivery whilst minimising physical and cognitive load. To achieve this, we will, for the first time, combine probabilistic language prediction with contextual data from sources such as video, audio and positional sensors, supplemented with user profiles and past experience, to present appropriate conversational information within an interface that adapts to the needs of users. The ACE-LP project is in its very early stages and with this poster we will introduce our idea to seek discussion with and feedback from a specialist audience to inform our research and design.
Original languageEnglish
Number of pages3
Publication statusPublished - 6 Aug 2016
Event17th Biennial International Society for Augmentative and Augmentative Communication Conference: Bringing us Together - Harbor Westin Conference Center, Toronto, Canada
Duration: 6 Aug 201613 Aug 2016
Conference number: 17
https://www.isaac-online.org/conference/modules/request.php?module=oc_program&action=program.php&p=program

Conference

Conference17th Biennial International Society for Augmentative and Augmentative Communication Conference
Abbreviated titleISAAC 2016
CountryCanada
CityToronto
Period6/08/1613/08/16
Internet address

    Fingerprint

Keywords

  • Augmentative and alternative communication

Cite this

Black, R., Kristensson, P. O., McKenna, S., Zhang, J., & Waller, A. (2016). ACE-LP: Augmenting Communication using Environmental Data to drive Language Prediction. Poster session presented at 17th Biennial International Society for Augmentative and Augmentative Communication Conference, Toronto, Canada.