A mobile phone based personal narrative system

Rolf Black, Annalu Waller, Nava Tintarev, Ehud Reiter, Joseph Reddington

    Research output: Chapter in Book/Report/Conference proceedingOther chapter contribution

    4 Citations (Scopus)

    Abstract

    Currently available commercial Augmentative and Alternative Communication (AAC) technology makes little use of computing power to improve the access to words and phrases for personal narrative, an essential part of social interaction. In this paper, we describe the development and evaluation of a mobile phone application to enable data collection for a personal narrative system for children with severe speech and physical impairments (SSPI). Based on user feedback from the previous project "How was School today?" we developed a modular system where school staff can use a mobile phone to track interaction with people and objects and user location at school. The phone also allows taking digital photographs and recording voice message sets by both school staff and parents/carers at home. These sets can be played back by the child for immediate narrative sharing similar to established AAC device interaction using sequential voice recorders. The mobile phone sends all the gathered data to a remote server. The data can then be used for automatic narrative generation on the child's PC based communication aid. Early results from the ongoing evaluation of the application in a special school with two participants and school staff show that staff were able to track interactions, record voice messages and take photographs. Location tracking was less successful, but was supplemented by timetable information. The participating children were able to play back voice messages and show photographs on the mobile phone for interactive narrative sharing using both direct and switch activated playback options.
    Original languageEnglish
    Title of host publicationASSETS'11
    Subtitle of host publicationproceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. 24-26 October 2011, Dundee, United Kingdom
    Place of PublicationNew York
    PublisherAssociation for Computing Machinery
    Pages171-178
    Number of pages8
    ISBN (Electronic)9781450309202
    ISBN (Print)9781450309196
    DOIs
    Publication statusPublished - 2011

    Fingerprint

    Mobile phones
    Communication
    Servers
    Switches
    Feedback

    Keywords

    • Augmentative and alternative communication
    • Personal narrative
    • Language development
    • Accessibility
    • Assistive technology
    • Disability
    • Cerebral palsy
    • Mobile phone application
    • Voice output communication aid
    • Speech Generating Device
    • User centred design
    • AAC
    • VOCA
    • SGD

    Cite this

    Black, R., Waller, A., Tintarev, N., Reiter, E., & Reddington, J. (2011). A mobile phone based personal narrative system. In ASSETS'11: proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. 24-26 October 2011, Dundee, United Kingdom (pp. 171-178). New York: Association for Computing Machinery. https://doi.org/10.1145/2049536.2049568
    Black, Rolf ; Waller, Annalu ; Tintarev, Nava ; Reiter, Ehud ; Reddington, Joseph. / A mobile phone based personal narrative system. ASSETS'11: proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. 24-26 October 2011, Dundee, United Kingdom. New York : Association for Computing Machinery, 2011. pp. 171-178
    @inbook{5e54020a64fd46c5beb645ea3eb36854,
    title = "A mobile phone based personal narrative system",
    abstract = "Currently available commercial Augmentative and Alternative Communication (AAC) technology makes little use of computing power to improve the access to words and phrases for personal narrative, an essential part of social interaction. In this paper, we describe the development and evaluation of a mobile phone application to enable data collection for a personal narrative system for children with severe speech and physical impairments (SSPI). Based on user feedback from the previous project {"}How was School today?{"} we developed a modular system where school staff can use a mobile phone to track interaction with people and objects and user location at school. The phone also allows taking digital photographs and recording voice message sets by both school staff and parents/carers at home. These sets can be played back by the child for immediate narrative sharing similar to established AAC device interaction using sequential voice recorders. The mobile phone sends all the gathered data to a remote server. The data can then be used for automatic narrative generation on the child's PC based communication aid. Early results from the ongoing evaluation of the application in a special school with two participants and school staff show that staff were able to track interactions, record voice messages and take photographs. Location tracking was less successful, but was supplemented by timetable information. The participating children were able to play back voice messages and show photographs on the mobile phone for interactive narrative sharing using both direct and switch activated playback options.",
    keywords = "Augmentative and alternative communication, Personal narrative, Language development, Accessibility, Assistive technology, Disability, Cerebral palsy, Mobile phone application, Voice output communication aid, Speech Generating Device, User centred design, AAC, VOCA, SGD",
    author = "Rolf Black and Annalu Waller and Nava Tintarev and Ehud Reiter and Joseph Reddington",
    year = "2011",
    doi = "10.1145/2049536.2049568",
    language = "English",
    isbn = "9781450309196",
    pages = "171--178",
    booktitle = "ASSETS'11",
    publisher = "Association for Computing Machinery",

    }

    Black, R, Waller, A, Tintarev, N, Reiter, E & Reddington, J 2011, A mobile phone based personal narrative system. in ASSETS'11: proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. 24-26 October 2011, Dundee, United Kingdom. Association for Computing Machinery, New York, pp. 171-178. https://doi.org/10.1145/2049536.2049568

    A mobile phone based personal narrative system. / Black, Rolf; Waller, Annalu; Tintarev, Nava; Reiter, Ehud; Reddington, Joseph.

    ASSETS'11: proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. 24-26 October 2011, Dundee, United Kingdom. New York : Association for Computing Machinery, 2011. p. 171-178.

    Research output: Chapter in Book/Report/Conference proceedingOther chapter contribution

    TY - CHAP

    T1 - A mobile phone based personal narrative system

    AU - Black, Rolf

    AU - Waller, Annalu

    AU - Tintarev, Nava

    AU - Reiter, Ehud

    AU - Reddington, Joseph

    PY - 2011

    Y1 - 2011

    N2 - Currently available commercial Augmentative and Alternative Communication (AAC) technology makes little use of computing power to improve the access to words and phrases for personal narrative, an essential part of social interaction. In this paper, we describe the development and evaluation of a mobile phone application to enable data collection for a personal narrative system for children with severe speech and physical impairments (SSPI). Based on user feedback from the previous project "How was School today?" we developed a modular system where school staff can use a mobile phone to track interaction with people and objects and user location at school. The phone also allows taking digital photographs and recording voice message sets by both school staff and parents/carers at home. These sets can be played back by the child for immediate narrative sharing similar to established AAC device interaction using sequential voice recorders. The mobile phone sends all the gathered data to a remote server. The data can then be used for automatic narrative generation on the child's PC based communication aid. Early results from the ongoing evaluation of the application in a special school with two participants and school staff show that staff were able to track interactions, record voice messages and take photographs. Location tracking was less successful, but was supplemented by timetable information. The participating children were able to play back voice messages and show photographs on the mobile phone for interactive narrative sharing using both direct and switch activated playback options.

    AB - Currently available commercial Augmentative and Alternative Communication (AAC) technology makes little use of computing power to improve the access to words and phrases for personal narrative, an essential part of social interaction. In this paper, we describe the development and evaluation of a mobile phone application to enable data collection for a personal narrative system for children with severe speech and physical impairments (SSPI). Based on user feedback from the previous project "How was School today?" we developed a modular system where school staff can use a mobile phone to track interaction with people and objects and user location at school. The phone also allows taking digital photographs and recording voice message sets by both school staff and parents/carers at home. These sets can be played back by the child for immediate narrative sharing similar to established AAC device interaction using sequential voice recorders. The mobile phone sends all the gathered data to a remote server. The data can then be used for automatic narrative generation on the child's PC based communication aid. Early results from the ongoing evaluation of the application in a special school with two participants and school staff show that staff were able to track interactions, record voice messages and take photographs. Location tracking was less successful, but was supplemented by timetable information. The participating children were able to play back voice messages and show photographs on the mobile phone for interactive narrative sharing using both direct and switch activated playback options.

    KW - Augmentative and alternative communication

    KW - Personal narrative

    KW - Language development

    KW - Accessibility

    KW - Assistive technology

    KW - Disability

    KW - Cerebral palsy

    KW - Mobile phone application

    KW - Voice output communication aid

    KW - Speech Generating Device

    KW - User centred design

    KW - AAC

    KW - VOCA

    KW - SGD

    UR - http://www.scopus.com/inward/record.url?scp=81855222576&partnerID=8YFLogxK

    U2 - 10.1145/2049536.2049568

    DO - 10.1145/2049536.2049568

    M3 - Other chapter contribution

    SN - 9781450309196

    SP - 171

    EP - 178

    BT - ASSETS'11

    PB - Association for Computing Machinery

    CY - New York

    ER -

    Black R, Waller A, Tintarev N, Reiter E, Reddington J. A mobile phone based personal narrative system. In ASSETS'11: proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. 24-26 October 2011, Dundee, United Kingdom. New York: Association for Computing Machinery. 2011. p. 171-178 https://doi.org/10.1145/2049536.2049568