ACE-LP: Augmenting Communication using Environmental Data to drive Language Prediction

Rolf Black, Per Ola Kristensson, Jianguo Zhang, Annalu Waller, Sophia Bano, Zulqarnain Rashid, Christopher Norrie

Research output: Contribution to conferencePoster

Abstract

Nonspeaking disabled people who use Voice Output Communication Aids (VOCAs) speak an average of between 8 and 12 words per minute (wpm) compared to typical adult speech of 150-190 wpm 1. For some, e.g., Prof Stephen Hawking who relies on a single switch access, rates fall to 1-2 wpm 2. Several research projects have demonstrated the potential of conversational language models to increase communication rates for personal narrative. However, system using these models require hand scripted paragraphs and training users to remember the existence and location of these 3. Other systems use data-to-text sentence generators to populate a narrative ontology with conversational
topics 4,5. The ACE-LP project which started in early 2016 aims to develop a communication system for nonspeaking people which will improve on the speed of communication by automatically populating the system with appropriate conversational items within an adaptive interface that provides control over timing and delivery whilst minimising physical and cognitive load. To achieve this, we will combine probabilistic language prediction with contextual data from sources such as video, audio and positional sensors, supplemented with user profiles and past experience. The ACE-LP project is in its very early stages and with this poster we will introduce our idea to seek discussion with and feedback from a specialist audience to inform our research and design.

Conference

ConferenceCommunication Matters - CM2016 National Conference
Abbreviated titleCM2016
CountryUnited Kingdom
CityLeeds
Period11/09/1613/09/16

Fingerprint

Communication
Ontology
Communication systems
Switches
Feedback
Sensors

Cite this

Black, R., Kristensson, P. O., Zhang, J., Waller, A., Bano, S., Rashid, Z., & Norrie, C. (2016). ACE-LP: Augmenting Communication using Environmental Data to drive Language Prediction. Poster session presented at Communication Matters - CM2016 National Conference, Leeds, United Kingdom.
Black, Rolf ; Kristensson, Per Ola ; Zhang, Jianguo ; Waller, Annalu ; Bano, Sophia ; Rashid, Zulqarnain ; Norrie, Christopher. / ACE-LP : Augmenting Communication using Environmental Data to drive Language Prediction. Poster session presented at Communication Matters - CM2016 National Conference, Leeds, United Kingdom.1 p.
@conference{f21d8ab77caf4a4fa3179b1cbefe8ccc,
title = "ACE-LP: Augmenting Communication using Environmental Data to drive Language Prediction",
abstract = "Nonspeaking disabled people who use Voice Output Communication Aids (VOCAs) speak an average of between 8 and 12 words per minute (wpm) compared to typical adult speech of 150-190 wpm 1. For some, e.g., Prof Stephen Hawking who relies on a single switch access, rates fall to 1-2 wpm 2. Several research projects have demonstrated the potential of conversational language models to increase communication rates for personal narrative. However, system using these models require hand scripted paragraphs and training users to remember the existence and location of these 3. Other systems use data-to-text sentence generators to populate a narrative ontology with conversationaltopics 4,5. The ACE-LP project which started in early 2016 aims to develop a communication system for nonspeaking people which will improve on the speed of communication by automatically populating the system with appropriate conversational items within an adaptive interface that provides control over timing and delivery whilst minimising physical and cognitive load. To achieve this, we will combine probabilistic language prediction with contextual data from sources such as video, audio and positional sensors, supplemented with user profiles and past experience. The ACE-LP project is in its very early stages and with this poster we will introduce our idea to seek discussion with and feedback from a specialist audience to inform our research and design.",
author = "Rolf Black and Kristensson, {Per Ola} and Jianguo Zhang and Annalu Waller and Sophia Bano and Zulqarnain Rashid and Christopher Norrie",
year = "2016",
month = "9",
day = "11",
language = "English",
note = "Communication Matters - CM2016 National Conference, CM2016 ; Conference date: 11-09-2016 Through 13-09-2016",

}

Black, R, Kristensson, PO, Zhang, J, Waller, A, Bano, S, Rashid, Z & Norrie, C 2016, 'ACE-LP: Augmenting Communication using Environmental Data to drive Language Prediction' Communication Matters - CM2016 National Conference, Leeds, United Kingdom, 11/09/16 - 13/09/16, .

ACE-LP : Augmenting Communication using Environmental Data to drive Language Prediction. / Black, Rolf; Kristensson, Per Ola; Zhang, Jianguo; Waller, Annalu; Bano, Sophia; Rashid, Zulqarnain; Norrie, Christopher.

2016. Poster session presented at Communication Matters - CM2016 National Conference, Leeds, United Kingdom.

Research output: Contribution to conferencePoster

TY - CONF

T1 - ACE-LP

T2 - Augmenting Communication using Environmental Data to drive Language Prediction

AU - Black, Rolf

AU - Kristensson, Per Ola

AU - Zhang, Jianguo

AU - Waller, Annalu

AU - Bano, Sophia

AU - Rashid, Zulqarnain

AU - Norrie, Christopher

PY - 2016/9/11

Y1 - 2016/9/11

N2 - Nonspeaking disabled people who use Voice Output Communication Aids (VOCAs) speak an average of between 8 and 12 words per minute (wpm) compared to typical adult speech of 150-190 wpm 1. For some, e.g., Prof Stephen Hawking who relies on a single switch access, rates fall to 1-2 wpm 2. Several research projects have demonstrated the potential of conversational language models to increase communication rates for personal narrative. However, system using these models require hand scripted paragraphs and training users to remember the existence and location of these 3. Other systems use data-to-text sentence generators to populate a narrative ontology with conversationaltopics 4,5. The ACE-LP project which started in early 2016 aims to develop a communication system for nonspeaking people which will improve on the speed of communication by automatically populating the system with appropriate conversational items within an adaptive interface that provides control over timing and delivery whilst minimising physical and cognitive load. To achieve this, we will combine probabilistic language prediction with contextual data from sources such as video, audio and positional sensors, supplemented with user profiles and past experience. The ACE-LP project is in its very early stages and with this poster we will introduce our idea to seek discussion with and feedback from a specialist audience to inform our research and design.

AB - Nonspeaking disabled people who use Voice Output Communication Aids (VOCAs) speak an average of between 8 and 12 words per minute (wpm) compared to typical adult speech of 150-190 wpm 1. For some, e.g., Prof Stephen Hawking who relies on a single switch access, rates fall to 1-2 wpm 2. Several research projects have demonstrated the potential of conversational language models to increase communication rates for personal narrative. However, system using these models require hand scripted paragraphs and training users to remember the existence and location of these 3. Other systems use data-to-text sentence generators to populate a narrative ontology with conversationaltopics 4,5. The ACE-LP project which started in early 2016 aims to develop a communication system for nonspeaking people which will improve on the speed of communication by automatically populating the system with appropriate conversational items within an adaptive interface that provides control over timing and delivery whilst minimising physical and cognitive load. To achieve this, we will combine probabilistic language prediction with contextual data from sources such as video, audio and positional sensors, supplemented with user profiles and past experience. The ACE-LP project is in its very early stages and with this poster we will introduce our idea to seek discussion with and feedback from a specialist audience to inform our research and design.

M3 - Poster

ER -

Black R, Kristensson PO, Zhang J, Waller A, Bano S, Rashid Z et al. ACE-LP: Augmenting Communication using Environmental Data to drive Language Prediction. 2016. Poster session presented at Communication Matters - CM2016 National Conference, Leeds, United Kingdom.