Personal storytelling: Using Natural Language Generation for children with complex communication needs, in the wild...

Nava Tintarev (Lead / Corresponding author), Ehud Reiter, Rolf Black, Annalu Waller, Joe Reddington

Research output: Contribution to journalArticle

11 Citations (Scopus)
251 Downloads (Pure)

Abstract

This paper describes a Natural Language Generation system (NLG), How was School Today? that automatically creates a personal narrative from sensor data and other media (photos and audio). It can be used by children with complex communication needs in schools to support interactive narrative about personal experiences. The robustness of story generation to missing data was identified as a key area for improvement in a feasibility study of the system at a first special needs school. This paper therefore suggests three possible methods for generating stories from unstructured data: clustering by voice recording, by location, or by time. Clustering based on voice recordings resulted in stories that were perceived as most easy to read, and to make most sense, by parents in a quantitative evaluation. This method was implemented in the live system, which was developed and evaluated iteratively at a second special needs school with children with different usage profiles. Open challenges and possibilities for NLG in augmented and alternative communication are also discussed.

Original languageEnglish
Pages (from-to)1-16
Number of pages16
JournalInternational Journal of Human Computer Studies
Volume92-93
Early online date16 Apr 2016
DOIs
Publication statusPublished - 1 Aug 2016

Keywords

  • Assistive technology
  • Augmented and alternative communication
  • Communication aids
  • Natural Language Generation
  • User-centered design

Fingerprint Dive into the research topics of 'Personal storytelling: Using Natural Language Generation for children with complex communication needs, in the wild...'. Together they form a unique fingerprint.

  • Profiles

    No photo of Annalu Waller

    Waller, Annalu

    • Computing - Professor & Personal Chair of Human Communication Technologies

    Person: Academic

    Cite this