Mental Workload and Language Production in Non-Native Speaker IPA Interaction

Yunhan Wu; Justin Edwards; Orla Cooney; Anna Bleakley; Philip R. Doyle; Leigh Clark; Daniel Rough; Benjamin R. Cowan

doi:10.1145/3405755.3406118

Mental Workload and Language Production in Non-Native Speaker IPA Interaction

Yunhan Wu, Justin Edwards, Orla Cooney, Anna Bleakley, Philip R. Doyle, Leigh Clark, Daniel Rough, Benjamin R. Cowan

Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

20 Citations (Scopus)

478 Downloads (Pure)

Abstract

Through smartphones and smart speakers, intelligent personal assistants (IPAs) have made speech a common interaction modality. With linguistic coverage and varying functionality levels, many speakers engage with IPAs using a non-native language. This may impact mental workload and patterns of language production used by non-native speakers. We present a mixed-design experiment, where native (L1) and non-native (L2) English speakers completed tasks with IPAs via smartphones and smart speakers. We found significantly higher mental workload for L2 speakers in IPA interactions. Contrary to our hypotheses, we found no significant differences between L1 and L2 speakers in number of turns, lexical complexity, diversity, or lexical adaptation when encountering errors. These findings are discussed in relation to language production and processing load increases for L2 speakers in IPA interaction

Original language	English
Title of host publication	CUI '20
Subtitle of host publication	Proceedings of the 2nd Conference on Conversational User Interfaces
Publisher	Association for Computing Machinery (ACM)
Pages	1-8
Number of pages	8
ISBN (Electronic)	9781450375443
DOIs	https://doi.org/10.1145/3405755.3406118
Publication status	Published - 22 Jul 2020

Publication series

Name	ACM International Conference Proceeding Series

Keywords

intelligent personal assistants
non-native language speakers
speech interface
voice user interface

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Vision and Pattern Recognition
Computer Networks and Communications

Access to Document

10.1145/3405755.3406118

Final Published VersionFinal published version, 954 KB

Cite this

Wu, Y., Edwards, J., Cooney, O., Bleakley, A., Doyle, P. R., Clark, L., Rough, D., & Cowan, B. R. (2020). Mental Workload and Language Production in Non-Native Speaker IPA Interaction. In CUI '20: Proceedings of the 2nd Conference on Conversational User Interfaces (pp. 1-8). Article 3 (ACM International Conference Proceeding Series). Association for Computing Machinery (ACM). https://doi.org/10.1145/3405755.3406118

@inproceedings{e7ce8993945848e692824bc1f85d24a0,

title = "Mental Workload and Language Production in Non-Native Speaker IPA Interaction",

abstract = "Through smartphones and smart speakers, intelligent personal assistants (IPAs) have made speech a common interaction modality. With linguistic coverage and varying functionality levels, many speakers engage with IPAs using a non-native language. This may impact mental workload and patterns of language production used by non-native speakers. We present a mixed-design experiment, where native (L1) and non-native (L2) English speakers completed tasks with IPAs via smartphones and smart speakers. We found significantly higher mental workload for L2 speakers in IPA interactions. Contrary to our hypotheses, we found no significant differences between L1 and L2 speakers in number of turns, lexical complexity, diversity, or lexical adaptation when encountering errors. These findings are discussed in relation to language production and processing load increases for L2 speakers in IPA interaction",

keywords = "intelligent personal assistants, non-native language speakers, speech interface, voice user interface",

author = "Yunhan Wu and Justin Edwards and Orla Cooney and Anna Bleakley and Doyle, {Philip R.} and Leigh Clark and Daniel Rough and Cowan, {Benjamin R.}",

note = "Funding Information: This work was conducted with the financial support of the UCD China Scholarship Council (CSC) Scheme grant No. 201908300016, Science Foundation Ireland ADAPT Centre under Grant No. 13/RC/2106 and the Science Foundation Ireland Centre for Research Training in Digitally-Enhanced Reality (D-REAL) under Grant No. 18/CRT/6224. Publisher Copyright: {\textcopyright} 2020 Owner/Author. Copyright: Copyright 2020 Elsevier B.V., All rights reserved.",

year = "2020",

month = jul,

day = "22",

doi = "10.1145/3405755.3406118",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery (ACM)",

pages = "1--8",

booktitle = "CUI '20",

address = "United States",

}

Wu, Y, Edwards, J, Cooney, O, Bleakley, A, Doyle, PR, Clark, L, Rough, D & Cowan, BR 2020, Mental Workload and Language Production in Non-Native Speaker IPA Interaction. in CUI '20: Proceedings of the 2nd Conference on Conversational User Interfaces., 3, ACM International Conference Proceeding Series, Association for Computing Machinery (ACM), pp. 1-8. https://doi.org/10.1145/3405755.3406118

Mental Workload and Language Production in Non-Native Speaker IPA Interaction. / Wu, Yunhan; Edwards, Justin; Cooney, Orla et al.
CUI '20: Proceedings of the 2nd Conference on Conversational User Interfaces. Association for Computing Machinery (ACM), 2020. p. 1-8 3 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Mental Workload and Language Production in Non-Native Speaker IPA Interaction

AU - Wu, Yunhan

AU - Edwards, Justin

AU - Cooney, Orla

AU - Bleakley, Anna

AU - Doyle, Philip R.

AU - Clark, Leigh

AU - Rough, Daniel

AU - Cowan, Benjamin R.

N1 - Funding Information: This work was conducted with the financial support of the UCD China Scholarship Council (CSC) Scheme grant No. 201908300016, Science Foundation Ireland ADAPT Centre under Grant No. 13/RC/2106 and the Science Foundation Ireland Centre for Research Training in Digitally-Enhanced Reality (D-REAL) under Grant No. 18/CRT/6224. Publisher Copyright: © 2020 Owner/Author. Copyright: Copyright 2020 Elsevier B.V., All rights reserved.

PY - 2020/7/22

Y1 - 2020/7/22

N2 - Through smartphones and smart speakers, intelligent personal assistants (IPAs) have made speech a common interaction modality. With linguistic coverage and varying functionality levels, many speakers engage with IPAs using a non-native language. This may impact mental workload and patterns of language production used by non-native speakers. We present a mixed-design experiment, where native (L1) and non-native (L2) English speakers completed tasks with IPAs via smartphones and smart speakers. We found significantly higher mental workload for L2 speakers in IPA interactions. Contrary to our hypotheses, we found no significant differences between L1 and L2 speakers in number of turns, lexical complexity, diversity, or lexical adaptation when encountering errors. These findings are discussed in relation to language production and processing load increases for L2 speakers in IPA interaction

AB - Through smartphones and smart speakers, intelligent personal assistants (IPAs) have made speech a common interaction modality. With linguistic coverage and varying functionality levels, many speakers engage with IPAs using a non-native language. This may impact mental workload and patterns of language production used by non-native speakers. We present a mixed-design experiment, where native (L1) and non-native (L2) English speakers completed tasks with IPAs via smartphones and smart speakers. We found significantly higher mental workload for L2 speakers in IPA interactions. Contrary to our hypotheses, we found no significant differences between L1 and L2 speakers in number of turns, lexical complexity, diversity, or lexical adaptation when encountering errors. These findings are discussed in relation to language production and processing load increases for L2 speakers in IPA interaction

KW - intelligent personal assistants

KW - non-native language speakers

KW - speech interface

KW - voice user interface

UR - http://www.scopus.com/inward/record.url?scp=85090163594&partnerID=8YFLogxK

U2 - 10.1145/3405755.3406118

DO - 10.1145/3405755.3406118

M3 - Conference contribution

T3 - ACM International Conference Proceeding Series

SP - 1

EP - 8

BT - CUI '20

PB - Association for Computing Machinery (ACM)

ER -

Mental Workload and Language Production in Non-Native Speaker IPA Interaction

Abstract

Publication series

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this