A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals

Mark Snaith; Nicholas Conway; Tessa Beinema; Dominic De Franco; Alison Pease; Reshmashree Kantharaju; Mathilde Janier; Gerwin Huizing; Catherine Pelachaud; Harm op den Akker

doi:10.1007/s10579-020-09526-0

A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals

Mark Snaith (Lead / Corresponding author), Nicholas Conway, Tessa Beinema, Dominic De Franco, Alison Pease, Reshmashree Kantharaju, Mathilde Janier, Gerwin Huizing, Catherine Pelachaud, Harm op den Akker

Research output: Contribution to journal › Article › peer-review

7 Citations (Scopus)

103 Downloads (Pure)

Abstract

Language resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related to recording real medical consultations. Rarer still are resources that involve more than one healthcare professional in consultation with a patient, despite many chronic conditions requiring multiple areas of expertise for effective treatment. In this paper, we present the design, construction and output of the Patient Consultation Corpus, a multimodal corpus of simulated consultations between a patient portrayed by an actor, and at least two healthcare professionals with different areas of expertise. As well as the transcribed text from each consultation, the corpus also contains audio and video where for each consultation: the audio consists of individual tracks for each participant, allowing for clear identification of speakers; the video consists of two framings for each participant—upper-body and face—allowing for close analysis of behaviours and gestures. Having presented the design and construction of the corpus, we then go on to briefly describe how the multi-modal nature of the corpus allows it to be analysed from several different perspectives.

Original language	English
Pages (from-to)	1077-1092
Number of pages	16
Journal	Language Resources and Evaluation
Volume	55
Early online date	2 Apr 2021
DOIs	https://doi.org/10.1007/s10579-020-09526-0
Publication status	Published - Dec 2021

Keywords

Coaching styles
Health coaching
Healthcare dialogue
Healthcare simulation
Multi-party dialogue and argumentation in healthcare
Multimodal corpus
Non-verbal behaviours

ASJC Scopus subject areas

Language and Linguistics
Education
Linguistics and Language
Library and Information Sciences

Access to Document

10.1007/s10579-020-09526-0Licence: CC BY

Final Published VersionFinal published version, 0.99 MBLicence: CC BY

Cite this

@article{a7e668eaf5634a3eaf573980b880f7fe,

title = "A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals",

abstract = "Language resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related to recording real medical consultations. Rarer still are resources that involve more than one healthcare professional in consultation with a patient, despite many chronic conditions requiring multiple areas of expertise for effective treatment. In this paper, we present the design, construction and output of the Patient Consultation Corpus, a multimodal corpus of simulated consultations between a patient portrayed by an actor, and at least two healthcare professionals with different areas of expertise. As well as the transcribed text from each consultation, the corpus also contains audio and video where for each consultation: the audio consists of individual tracks for each participant, allowing for clear identification of speakers; the video consists of two framings for each participant—upper-body and face—allowing for close analysis of behaviours and gestures. Having presented the design and construction of the corpus, we then go on to briefly describe how the multi-modal nature of the corpus allows it to be analysed from several different perspectives.",

keywords = "Coaching styles, Health coaching, Healthcare dialogue, Healthcare simulation, Multi-party dialogue and argumentation in healthcare, Multimodal corpus, Non-verbal behaviours",

author = "Mark Snaith and Nicholas Conway and Tessa Beinema and {De Franco}, Dominic and Alison Pease and Reshmashree Kantharaju and Mathilde Janier and Gerwin Huizing and Catherine Pelachaud and {op den Akker}, Harm",

note = "Funding Information: This work was supported by the European Union{\textquoteright}s Horizon 2020 Research and Innovation Programme under Grant Agreement #769553. Publisher Copyright: {\textcopyright} 2021, The Author(s).",

year = "2021",

month = dec,

doi = "10.1007/s10579-020-09526-0",

language = "English",

volume = "55",

pages = "1077--1092",

journal = "Language Resources and Evaluation",

issn = "1574-020X",

publisher = "Springer Verlag",

}

TY - JOUR

T1 - A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals

AU - Snaith, Mark

AU - Conway, Nicholas

AU - Beinema, Tessa

AU - De Franco, Dominic

AU - Pease, Alison

AU - Kantharaju, Reshmashree

AU - Janier, Mathilde

AU - Huizing, Gerwin

AU - Pelachaud, Catherine

AU - op den Akker, Harm

PY - 2021/12

Y1 - 2021/12

N2 - Language resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related to recording real medical consultations. Rarer still are resources that involve more than one healthcare professional in consultation with a patient, despite many chronic conditions requiring multiple areas of expertise for effective treatment. In this paper, we present the design, construction and output of the Patient Consultation Corpus, a multimodal corpus of simulated consultations between a patient portrayed by an actor, and at least two healthcare professionals with different areas of expertise. As well as the transcribed text from each consultation, the corpus also contains audio and video where for each consultation: the audio consists of individual tracks for each participant, allowing for clear identification of speakers; the video consists of two framings for each participant—upper-body and face—allowing for close analysis of behaviours and gestures. Having presented the design and construction of the corpus, we then go on to briefly describe how the multi-modal nature of the corpus allows it to be analysed from several different perspectives.

AB - Language resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related to recording real medical consultations. Rarer still are resources that involve more than one healthcare professional in consultation with a patient, despite many chronic conditions requiring multiple areas of expertise for effective treatment. In this paper, we present the design, construction and output of the Patient Consultation Corpus, a multimodal corpus of simulated consultations between a patient portrayed by an actor, and at least two healthcare professionals with different areas of expertise. As well as the transcribed text from each consultation, the corpus also contains audio and video where for each consultation: the audio consists of individual tracks for each participant, allowing for clear identification of speakers; the video consists of two framings for each participant—upper-body and face—allowing for close analysis of behaviours and gestures. Having presented the design and construction of the corpus, we then go on to briefly describe how the multi-modal nature of the corpus allows it to be analysed from several different perspectives.

KW - Coaching styles

KW - Health coaching

KW - Healthcare dialogue

KW - Healthcare simulation

KW - Multi-party dialogue and argumentation in healthcare

KW - Multimodal corpus

KW - Non-verbal behaviours

UR - http://www.scopus.com/inward/record.url?scp=85103613763&partnerID=8YFLogxK

U2 - 10.1007/s10579-020-09526-0

DO - 10.1007/s10579-020-09526-0

M3 - Article

AN - SCOPUS:85103613763

SN - 1574-020X

VL - 55

SP - 1077

EP - 1092

JO - Language Resources and Evaluation

JF - Language Resources and Evaluation

ER -

A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Council of Coaches: COUCH (joint with University of Twente, Roessingh Research and Development BV, Danish Board of Technology Foundation, University of Pierre and Marie Curie, Polytechnic University of Valencia, Innovation Sprint)

Cite this

A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Projects

Council of Coaches: COUCH (joint with University of Twente, Roessingh Research and Development BV, Danish Board of Technology Foundation, University of Pierre and Marie Curie, Polytechnic University of Valencia, Innovation Sprint)

Cite this