Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild

Can Liu; Enrico Costanza; Wendy Mackay; Hamed S. Alavi; Shumin Zhai; Wendy Moncur

doi:10.1145/3290607.3311744

Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild

Can Liu, Enrico Costanza, Wendy Mackay, Hamed S. Alavi, Shumin Zhai, Wendy Moncur

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

311 Downloads (Pure)

Abstract

As an interdisciplinary field, CHI embraces multiple research methods, ranging from controlled lab experiments to field studies in homes and communities. While quantitative research in the lab emphasizes the scientific rigor of hypothesis testing; qualitative research in the wild focuses on the understanding of the context of technologies in use, and each type of research has a correspondingly different kind of impact. This panel invites researchers with varied backgrounds to talk about the tensions and trade-offs between research in the lab and in the wild, with respect to scientific rigor, real-world relevance and impact. The goal is to enhance mutual understanding among researchers with diverse goals, values and practices within the CHI community.

Original language	English
Title of host publication	CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
Place of Publication	New York
Publisher	Association for Computing Machinery (ACM)
Number of pages	6
ISBN (Electronic)	9781450359719
ISBN (Print)	9781450359719, 978145035971
DOIs	https://doi.org/10.1145/3290607.3311744
Publication status	Published - 2 May 2019
Event	CHI 2019: Weaving the Threads of CHI - Glasgow, United Kingdom Duration: 4 May 2019 → 9 May 2019 https://chi2019.acm.org/

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	CHI 2019
Country/Territory	United Kingdom
City	Glasgow
Period	4/05/19 → 9/05/19
Internet address	https://chi2019.acm.org/

Keywords

Impact
Research in the lab
Research in the wild
Research methods
Research paradigm
Trade-off

ASJC Scopus subject areas

Human-Computer Interaction
Computer Graphics and Computer-Aided Design
Software

Access to Document

10.1145/3290607.3311744

Author Accepted Manuscript
© AAM, 2019. This is the author’s version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in CHI'19 Extended Abstracts. Association for Computing Machinery (ACM), New York, CHI 2019, Glasgow, United Kingdom, 4/05/19. https://doi.org/10.1145/3290607.3311744
Accepted author manuscript, 631 KB

Cite this

Liu, C., Costanza, E., Mackay, W., Alavi, H. S., Zhai, S., & Moncur, W. (2019). Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild. In CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems Article 3311744 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery (ACM). https://doi.org/10.1145/3290607.3311744

Liu, Can ; Costanza, Enrico ; Mackay, Wendy et al. / Rigor, Relevance and Impact : The Tensions and Trade-Offs Between Research in the Lab and in the Wild. CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. New York : Association for Computing Machinery (ACM), 2019. (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{05d2fc0880aa427f83cb85b55599f59e,

title = "Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild",

abstract = "As an interdisciplinary field, CHI embraces multiple research methods, ranging from controlled lab experiments to field studies in homes and communities. While quantitative research in the lab emphasizes the scientific rigor of hypothesis testing; qualitative research in the wild focuses on the understanding of the context of technologies in use, and each type of research has a correspondingly different kind of impact. This panel invites researchers with varied backgrounds to talk about the tensions and trade-offs between research in the lab and in the wild, with respect to scientific rigor, real-world relevance and impact. The goal is to enhance mutual understanding among researchers with diverse goals, values and practices within the CHI community.",

keywords = "Impact, Research in the lab, Research in the wild, Research methods, Research paradigm, Trade-off",

author = "Can Liu and Enrico Costanza and Wendy Mackay and Alavi, {Hamed S.} and Shumin Zhai and Wendy Moncur",

year = "2019",

month = may,

day = "2",

doi = "10.1145/3290607.3311744",

language = "English",

isbn = "9781450359719",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery (ACM)",

booktitle = "CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems",

address = "United States",

note = "CHI 2019 : Weaving the Threads of CHI ; Conference date: 04-05-2019 Through 09-05-2019",

url = "https://chi2019.acm.org/",

}

Liu, C, Costanza, E, Mackay, W, Alavi, HS, Zhai, S & Moncur, W 2019, Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild. in CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems., 3311744, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery (ACM), New York, CHI 2019, Glasgow, United Kingdom, 4/05/19. https://doi.org/10.1145/3290607.3311744

Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild. / Liu, Can; Costanza, Enrico; Mackay, Wendy et al.
CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery (ACM), 2019. 3311744 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Rigor, Relevance and Impact

T2 - CHI 2019

AU - Liu, Can

AU - Costanza, Enrico

AU - Mackay, Wendy

AU - Alavi, Hamed S.

AU - Zhai, Shumin

AU - Moncur, Wendy

PY - 2019/5/2

Y1 - 2019/5/2

N2 - As an interdisciplinary field, CHI embraces multiple research methods, ranging from controlled lab experiments to field studies in homes and communities. While quantitative research in the lab emphasizes the scientific rigor of hypothesis testing; qualitative research in the wild focuses on the understanding of the context of technologies in use, and each type of research has a correspondingly different kind of impact. This panel invites researchers with varied backgrounds to talk about the tensions and trade-offs between research in the lab and in the wild, with respect to scientific rigor, real-world relevance and impact. The goal is to enhance mutual understanding among researchers with diverse goals, values and practices within the CHI community.

AB - As an interdisciplinary field, CHI embraces multiple research methods, ranging from controlled lab experiments to field studies in homes and communities. While quantitative research in the lab emphasizes the scientific rigor of hypothesis testing; qualitative research in the wild focuses on the understanding of the context of technologies in use, and each type of research has a correspondingly different kind of impact. This panel invites researchers with varied backgrounds to talk about the tensions and trade-offs between research in the lab and in the wild, with respect to scientific rigor, real-world relevance and impact. The goal is to enhance mutual understanding among researchers with diverse goals, values and practices within the CHI community.

KW - Impact

KW - Research in the lab

KW - Research in the wild

KW - Research methods

KW - Research paradigm

KW - Trade-off

UR - http://www.scopus.com/inward/record.url?scp=85067314117&partnerID=8YFLogxK

U2 - 10.1145/3290607.3311744

DO - 10.1145/3290607.3311744

M3 - Conference contribution

SN - 9781450359719

SN - 978145035971

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery (ACM)

CY - New York

Y2 - 4 May 2019 through 9 May 2019

ER -

Liu C, Costanza E, Mackay W, Alavi HS, Zhai S, Moncur W. Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild. In CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery (ACM). 2019. 3311744. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3290607.3311744

Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cumulative Revelations of Personal Data ( Edinburgh University Strathclyde University Northumbria University)