Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis

Yunhan Wu; Martin Porcheron; Philip R. Doyle; Justin Edwards; Daniel Rough; Orla Cooney; Anna Bleakley; Leigh Clark; Benjamin R. Cowan

doi:10.1145/3543829.3543839

Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis

Yunhan Wu, Martin Porcheron, Philip R. Doyle, Justin Edwards, Daniel Rough, Orla Cooney, Anna Bleakley, Leigh Clark, Benjamin R. Cowan

Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

6 Citations (Scopus)

61 Downloads (Pure)

Abstract

Intelligent Personal Assistants (IPAs) are limited in the languages they support, meaning many people are left to interact using a non-native language. Yet, we know little about how people interact with IPAs in this way. Through a conversation analysis (CA) perspective, we examine native (L1) and non-native (L2) English speaker interactions with Google Assistant, comparing how both user groups produce IPA commands. Our work shows that L1 and L2 speakers similarly used pauses, partial or complete repetition, and hyper-Articulation when constructing commands. However, L2 speakers tended to experience issues in lexical access, syntactic construction and pronunciation, resulting in the use of code-mixing, increased pause lengths and off-Task rehearsal to help generate commands. We consider reasons for such effects, whilst exploring ways to design IPA interaction to ensure it is sensitive to L2 challenges in command production.

Original language	English
Title of host publication	CUI '22
Subtitle of host publication	Proceedings of the 4th International Conference on Conversational User Interfaces
Editors	Martin Halvey, Mary Ellen Foster, Jeff Dalton
Place of Publication	New York
Publisher	Association for Computing Machinery (ACM)
Number of pages	12
ISBN (Electronic)	9781450397391
DOIs	https://doi.org/10.1145/3543829.3543839
Publication status	Published - 15 Sept 2022
Event	4th International Conference on Conversational User Interfaces, CUI 2022 - Glasgow, United Kingdom Duration: 26 Jul 2022 → 28 Jul 2022

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	4th International Conference on Conversational User Interfaces, CUI 2022
Country/Territory	United Kingdom
City	Glasgow
Period	26/07/22 → 28/07/22

Keywords

Intelligent personal assistants
Non-native speakers
Speech interface
Voice user interface

ASJC Scopus subject areas

Human-Computer Interaction
Computer Networks and Communications
Computer Vision and Pattern Recognition
Software

Access to Document

10.1145/3543829.3543839Licence: CC BY

Final published versionFinal published version, 1.44 MBLicence: CC BY

Cite this

Wu, Y., Porcheron, M., Doyle, P. R., Edwards, J., Rough, D., Cooney, O., Bleakley, A., Clark, L., & Cowan, B. R. (2022). Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis. In M. Halvey, M. E. Foster, & J. Dalton (Eds.), CUI '22: Proceedings of the 4th International Conference on Conversational User Interfaces Article 10 (ACM International Conference Proceeding Series). Association for Computing Machinery (ACM). https://doi.org/10.1145/3543829.3543839

Wu, Yunhan ; Porcheron, Martin ; Doyle, Philip R. et al. / Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis. CUI '22: Proceedings of the 4th International Conference on Conversational User Interfaces. editor / Martin Halvey ; Mary Ellen Foster ; Jeff Dalton. New York : Association for Computing Machinery (ACM), 2022. (ACM International Conference Proceeding Series).

@inproceedings{bf3c5caf60e14af296b9bfe38779d1dd,

title = "Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis",

abstract = "Intelligent Personal Assistants (IPAs) are limited in the languages they support, meaning many people are left to interact using a non-native language. Yet, we know little about how people interact with IPAs in this way. Through a conversation analysis (CA) perspective, we examine native (L1) and non-native (L2) English speaker interactions with Google Assistant, comparing how both user groups produce IPA commands. Our work shows that L1 and L2 speakers similarly used pauses, partial or complete repetition, and hyper-Articulation when constructing commands. However, L2 speakers tended to experience issues in lexical access, syntactic construction and pronunciation, resulting in the use of code-mixing, increased pause lengths and off-Task rehearsal to help generate commands. We consider reasons for such effects, whilst exploring ways to design IPA interaction to ensure it is sensitive to L2 challenges in command production.",

keywords = "Intelligent personal assistants, Non-native speakers, Speech interface, Voice user interface",

author = "Yunhan Wu and Martin Porcheron and Doyle, {Philip R.} and Justin Edwards and Daniel Rough and Orla Cooney and Anna Bleakley and Leigh Clark and Cowan, {Benjamin R.}",

note = "Funding Information: This work was conducted with the financial support of the UCD China Scholarship Council (CSC) Scheme grant No. 201908300016, Science Foundation Ireland ADAPT Centre under Grant No. 13/RC/2106 and the Science Foundation Ireland Centre for Research Training in Digitally-Enhanced Reality (D-REAL) under Grant No. 18/CRT/6224. Publisher Copyright: {\textcopyright} 2022 Owner/Author.; 4th International Conference on Conversational User Interfaces, CUI 2022 ; Conference date: 26-07-2022 Through 28-07-2022",

year = "2022",

month = sep,

day = "15",

doi = "10.1145/3543829.3543839",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery (ACM)",

editor = "Martin Halvey and Foster, {Mary Ellen} and Dalton, {Jeff }",

booktitle = "CUI '22",

address = "United States",

}

Wu, Y, Porcheron, M, Doyle, PR, Edwards, J, Rough, D, Cooney, O, Bleakley, A, Clark, L & Cowan, BR 2022, Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis. in M Halvey, ME Foster & J Dalton (eds), CUI '22: Proceedings of the 4th International Conference on Conversational User Interfaces., 10, ACM International Conference Proceeding Series, Association for Computing Machinery (ACM), New York, 4th International Conference on Conversational User Interfaces, CUI 2022, Glasgow, United Kingdom, 26/07/22. https://doi.org/10.1145/3543829.3543839

Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis. / Wu, Yunhan; Porcheron, Martin; Doyle, Philip R. et al.
CUI '22: Proceedings of the 4th International Conference on Conversational User Interfaces. ed. / Martin Halvey; Mary Ellen Foster; Jeff Dalton. New York: Association for Computing Machinery (ACM), 2022. 10 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis

AU - Wu, Yunhan

AU - Porcheron, Martin

AU - Doyle, Philip R.

AU - Edwards, Justin

AU - Rough, Daniel

AU - Cooney, Orla

AU - Bleakley, Anna

AU - Clark, Leigh

AU - Cowan, Benjamin R.

N1 - Funding Information: This work was conducted with the financial support of the UCD China Scholarship Council (CSC) Scheme grant No. 201908300016, Science Foundation Ireland ADAPT Centre under Grant No. 13/RC/2106 and the Science Foundation Ireland Centre for Research Training in Digitally-Enhanced Reality (D-REAL) under Grant No. 18/CRT/6224. Publisher Copyright: © 2022 Owner/Author.

PY - 2022/9/15

Y1 - 2022/9/15

N2 - Intelligent Personal Assistants (IPAs) are limited in the languages they support, meaning many people are left to interact using a non-native language. Yet, we know little about how people interact with IPAs in this way. Through a conversation analysis (CA) perspective, we examine native (L1) and non-native (L2) English speaker interactions with Google Assistant, comparing how both user groups produce IPA commands. Our work shows that L1 and L2 speakers similarly used pauses, partial or complete repetition, and hyper-Articulation when constructing commands. However, L2 speakers tended to experience issues in lexical access, syntactic construction and pronunciation, resulting in the use of code-mixing, increased pause lengths and off-Task rehearsal to help generate commands. We consider reasons for such effects, whilst exploring ways to design IPA interaction to ensure it is sensitive to L2 challenges in command production.

AB - Intelligent Personal Assistants (IPAs) are limited in the languages they support, meaning many people are left to interact using a non-native language. Yet, we know little about how people interact with IPAs in this way. Through a conversation analysis (CA) perspective, we examine native (L1) and non-native (L2) English speaker interactions with Google Assistant, comparing how both user groups produce IPA commands. Our work shows that L1 and L2 speakers similarly used pauses, partial or complete repetition, and hyper-Articulation when constructing commands. However, L2 speakers tended to experience issues in lexical access, syntactic construction and pronunciation, resulting in the use of code-mixing, increased pause lengths and off-Task rehearsal to help generate commands. We consider reasons for such effects, whilst exploring ways to design IPA interaction to ensure it is sensitive to L2 challenges in command production.

KW - Intelligent personal assistants

KW - Non-native speakers

KW - Speech interface

KW - Voice user interface

UR - http://www.scopus.com/inward/record.url?scp=85139244447&partnerID=8YFLogxK

U2 - 10.1145/3543829.3543839

DO - 10.1145/3543829.3543839

M3 - Conference contribution

AN - SCOPUS:85139244447

T3 - ACM International Conference Proceeding Series

BT - CUI '22

A2 - Halvey, Martin

A2 - Foster, Mary Ellen

A2 - Dalton, Jeff

PB - Association for Computing Machinery (ACM)

CY - New York

T2 - 4th International Conference on Conversational User Interfaces, CUI 2022

Y2 - 26 July 2022 through 28 July 2022

ER -

Wu Y, Porcheron M, Doyle PR, Edwards J, Rough D, Cooney O et al. Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis. In Halvey M, Foster ME, Dalton J, editors, CUI '22: Proceedings of the 4th International Conference on Conversational User Interfaces. New York: Association for Computing Machinery (ACM). 2022. 10. (ACM International Conference Proceeding Series). doi: 10.1145/3543829.3543839

Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

4th International Conference on Conversational User Interfaces, CUI 2022

Cite this

Comparing Command Construction in Native and Non-Native Speaker IPA Interaction through Conversation Analysis

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Activities

4th International Conference on Conversational User Interfaces, CUI 2022

Cite this