A mobile phone based personal narrative system. / Black, Rolf; Waller, Annalu; Tintarev, Nava; Reiter, Ehud; Reddington, Joseph.
ASSETS'11: proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. 24-26 October 2011, Dundee, United Kingdom. New York : Association for Computing Machinery, 2011. p. 171-178.Research output: Chapter in Book/Report/Conference proceeding › Other chapter contribution
}
TY - CHAP
T1 - A mobile phone based personal narrative system
AU - Black,Rolf
AU - Waller,Annalu
AU - Tintarev,Nava
AU - Reiter,Ehud
AU - Reddington,Joseph
PY - 2011
Y1 - 2011
N2 - Currently available commercial Augmentative and Alternative Communication (AAC) technology makes little use of computing power to improve the access to words and phrases for personal narrative, an essential part of social interaction. In this paper, we describe the development and evaluation of a mobile phone application to enable data collection for a personal narrative system for children with severe speech and physical impairments (SSPI). Based on user feedback from the previous project "How was School today?" we developed a modular system where school staff can use a mobile phone to track interaction with people and objects and user location at school. The phone also allows taking digital photographs and recording voice message sets by both school staff and parents/carers at home. These sets can be played back by the child for immediate narrative sharing similar to established AAC device interaction using sequential voice recorders. The mobile phone sends all the gathered data to a remote server. The data can then be used for automatic narrative generation on the child's PC based communication aid. Early results from the ongoing evaluation of the application in a special school with two participants and school staff show that staff were able to track interactions, record voice messages and take photographs. Location tracking was less successful, but was supplemented by timetable information. The participating children were able to play back voice messages and show photographs on the mobile phone for interactive narrative sharing using both direct and switch activated playback options. © 2011 ACM.
AB - Currently available commercial Augmentative and Alternative Communication (AAC) technology makes little use of computing power to improve the access to words and phrases for personal narrative, an essential part of social interaction. In this paper, we describe the development and evaluation of a mobile phone application to enable data collection for a personal narrative system for children with severe speech and physical impairments (SSPI). Based on user feedback from the previous project "How was School today?" we developed a modular system where school staff can use a mobile phone to track interaction with people and objects and user location at school. The phone also allows taking digital photographs and recording voice message sets by both school staff and parents/carers at home. These sets can be played back by the child for immediate narrative sharing similar to established AAC device interaction using sequential voice recorders. The mobile phone sends all the gathered data to a remote server. The data can then be used for automatic narrative generation on the child's PC based communication aid. Early results from the ongoing evaluation of the application in a special school with two participants and school staff show that staff were able to track interactions, record voice messages and take photographs. Location tracking was less successful, but was supplemented by timetable information. The participating children were able to play back voice messages and show photographs on the mobile phone for interactive narrative sharing using both direct and switch activated playback options. © 2011 ACM.
KW - Augmentative and alternative communication
KW - Personal narrative
KW - Language development
KW - Accessibility
KW - Assistive technology
KW - Disability
KW - Cerebral palsy
KW - Mobile phone application
KW - Voice output communication aid
KW - Speech Generating Device
KW - User centred design
KW - AAC
KW - VOCA
KW - SGD
UR - http://www.scopus.com/inward/record.url?scp=81855222576&partnerID=8YFLogxK
U2 - 10.1145/2049536.2049568
DO - 10.1145/2049536.2049568
M3 - Other chapter contribution
SN - 9781450309196
SP - 171
EP - 178
BT - ASSETS'11
PB - Association for Computing Machinery
ER -