Rigor, Relevance and Impact

The Tensions and Trade-Offs Between Research in the Lab and in the Wild

Can Liu, Enrico Costanza, Wendy Mackay, Hamed S. Alavi, Shumin Zhai, Wendy Moncur

Research output: Chapter in Book/Report/Conference proceedingConference contribution

48 Downloads (Pure)

Abstract

As an interdisciplinary field, CHI embraces multiple research methods, ranging from controlled lab experiments to field studies in homes and communities. While quantitative research in the lab emphasizes the scientific rigor of hypothesis testing; qualitative research in the wild focuses on the understanding of the context of technologies in use, and each type of research has a correspondingly different kind of impact. This panel invites researchers with varied backgrounds to talk about the tensions and trade-offs between research in the lab and in the wild, with respect to scientific rigor, real-world relevance and impact. The goal is to enhance mutual understanding among researchers with diverse goals, values and practices within the CHI community.
Original languageEnglish
Title of host publicationCHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Number of pages6
ISBN (Electronic)9781450359719
ISBN (Print)9781450359719, 978145035971
DOIs
Publication statusPublished - 2 May 2019
EventCHI 2019: Weaving the Threads of CHI - Glasgow, United Kingdom
Duration: 4 May 20199 May 2019
https://chi2019.acm.org/

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

ConferenceCHI 2019
CountryUnited Kingdom
CityGlasgow
Period4/05/199/05/19
Internet address

Fingerprint

hypothesis testing
quantitative research
community
research method
qualitative research
experiment
Values

Keywords

  • Impact
  • Research in the lab
  • Research in the wild
  • Research methods
  • Research paradigm
  • Trade-off

Cite this

Liu, C., Costanza, E., Mackay, W., Alavi, H. S., Zhai, S., & Moncur, W. (2019). Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild. In CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Conference on Human Factors in Computing Systems - Proceedings). New York: Association for Computing Machinery (ACM). https://doi.org/10.1145/3290607.3311744
Liu, Can ; Costanza, Enrico ; Mackay, Wendy ; Alavi, Hamed S. ; Zhai, Shumin ; Moncur, Wendy. / Rigor, Relevance and Impact : The Tensions and Trade-Offs Between Research in the Lab and in the Wild. CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. New York : Association for Computing Machinery (ACM), 2019. (Conference on Human Factors in Computing Systems - Proceedings).
@inproceedings{05d2fc0880aa427f83cb85b55599f59e,
title = "Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild",
abstract = "As an interdisciplinary field, CHI embraces multiple research methods, ranging from controlled lab experiments to field studies in homes and communities. While quantitative research in the lab emphasizes the scientific rigor of hypothesis testing; qualitative research in the wild focuses on the understanding of the context of technologies in use, and each type of research has a correspondingly different kind of impact. This panel invites researchers with varied backgrounds to talk about the tensions and trade-offs between research in the lab and in the wild, with respect to scientific rigor, real-world relevance and impact. The goal is to enhance mutual understanding among researchers with diverse goals, values and practices within the CHI community.",
keywords = "Impact, Research in the lab, Research in the wild, Research methods, Research paradigm, Trade-off",
author = "Can Liu and Enrico Costanza and Wendy Mackay and Alavi, {Hamed S.} and Shumin Zhai and Wendy Moncur",
year = "2019",
month = "5",
day = "2",
doi = "10.1145/3290607.3311744",
language = "English",
isbn = "9781450359719",
series = "Conference on Human Factors in Computing Systems - Proceedings",
publisher = "Association for Computing Machinery (ACM)",
booktitle = "CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems",
address = "United States",

}

Liu, C, Costanza, E, Mackay, W, Alavi, HS, Zhai, S & Moncur, W 2019, Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild. in CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery (ACM), New York, CHI 2019, Glasgow, United Kingdom, 4/05/19. https://doi.org/10.1145/3290607.3311744

Rigor, Relevance and Impact : The Tensions and Trade-Offs Between Research in the Lab and in the Wild. / Liu, Can; Costanza, Enrico; Mackay, Wendy; Alavi, Hamed S.; Zhai, Shumin; Moncur, Wendy.

CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. New York : Association for Computing Machinery (ACM), 2019. (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Rigor, Relevance and Impact

T2 - The Tensions and Trade-Offs Between Research in the Lab and in the Wild

AU - Liu, Can

AU - Costanza, Enrico

AU - Mackay, Wendy

AU - Alavi, Hamed S.

AU - Zhai, Shumin

AU - Moncur, Wendy

PY - 2019/5/2

Y1 - 2019/5/2

N2 - As an interdisciplinary field, CHI embraces multiple research methods, ranging from controlled lab experiments to field studies in homes and communities. While quantitative research in the lab emphasizes the scientific rigor of hypothesis testing; qualitative research in the wild focuses on the understanding of the context of technologies in use, and each type of research has a correspondingly different kind of impact. This panel invites researchers with varied backgrounds to talk about the tensions and trade-offs between research in the lab and in the wild, with respect to scientific rigor, real-world relevance and impact. The goal is to enhance mutual understanding among researchers with diverse goals, values and practices within the CHI community.

AB - As an interdisciplinary field, CHI embraces multiple research methods, ranging from controlled lab experiments to field studies in homes and communities. While quantitative research in the lab emphasizes the scientific rigor of hypothesis testing; qualitative research in the wild focuses on the understanding of the context of technologies in use, and each type of research has a correspondingly different kind of impact. This panel invites researchers with varied backgrounds to talk about the tensions and trade-offs between research in the lab and in the wild, with respect to scientific rigor, real-world relevance and impact. The goal is to enhance mutual understanding among researchers with diverse goals, values and practices within the CHI community.

KW - Impact

KW - Research in the lab

KW - Research in the wild

KW - Research methods

KW - Research paradigm

KW - Trade-off

UR - http://www.scopus.com/inward/record.url?scp=85067314117&partnerID=8YFLogxK

U2 - 10.1145/3290607.3311744

DO - 10.1145/3290607.3311744

M3 - Conference contribution

SN - 9781450359719

SN - 978145035971

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery (ACM)

CY - New York

ER -

Liu C, Costanza E, Mackay W, Alavi HS, Zhai S, Moncur W. Rigor, Relevance and Impact: The Tensions and Trade-Offs Between Research in the Lab and in the Wild. In CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery (ACM). 2019. (Conference on Human Factors in Computing Systems - Proceedings). https://doi.org/10.1145/3290607.3311744