Further Development of the PhonicStick: the application of phonic-based acceleration methods to the speaking joystick

Ha Trinh, Annalu Waller, Rolf Black, Ehud Reiter

    Research output: Contribution to conferencePaper

    236 Downloads (Pure)

    Abstract

    The PhonicStick is a novel Augmentative and Alternative Communication joystick-like device which enables individuals with severe speech and physical disorders to access forty-two sounds (i.e. phonics) and blend the sounds together to create spoken words. The device aims to allow the users to select phonics and produce speech without the need for a visual interface. One of the problems with the current prototype of the PhonicStick is that the phonic entry is relatively slow and may involve many physical movements which will cause great difficulties for users with poor hand function. Therefore, in this research we are investigating whether natural language processing (NLP) technology can be utilized to facilitate the phonic retrieval and word creation processes. Our goal is to develop a set of phonic-based NLP acceleration methods, such as phonic disambiguation and phonic prediction, which will reduce the user effort required to select the target phonics and improve the speed of producing words. This paper will discuss the challenges of applying such methods to the PhonicStick and report on the current state of the development of the proposed techniques. The presentation will also include a live demonstration of the latest prototype of the PhonicStick.
    Original languageEnglish
    Number of pages4
    Publication statusPublished - Jul 2010
    Event14th Biennial Conference of the International Society of Augmentative and Alternative Communication: Communicating Worlds - Barcelona, Spain
    Duration: 24 Jul 201029 Jul 2010

    Conference

    Conference14th Biennial Conference of the International Society of Augmentative and Alternative Communication: Communicating Worlds
    Abbreviated titleISAAC 2010
    Country/TerritorySpain
    CityBarcelona
    Period24/07/1029/07/10

    Fingerprint

    Dive into the research topics of 'Further Development of the PhonicStick: the application of phonic-based acceleration methods to the speaking joystick'. Together they form a unique fingerprint.

    Cite this