A decision tree for annotating argumentation scheme corpora

John Lawrence; Jacky Visser; Douglas Walton; Chris Reed

A decision tree for annotating argumentation scheme corpora

John Lawrence, Jacky Visser, Douglas Walton, Chris Reed

Computing

Research output: Contribution to conference › Paper › peer-review

153 Downloads (Pure)

Abstract

Quantitative approaches, necessary for e.g. computationallinguistic methods such as argument mining, require large annotated corpora of argumentative discourse. Publicly available corpora of argumentation schemes often only cover a small selection of example schemes and suffer from low
inter-annotator agreement. To address this, we present a heuristic decision tree for the classification of Walton's toplevel taxonomy of 60 schemes. An annotation study on 505 arguments resulted in a 97% classification covering 38 schemes (Cohen’s κ 0.723).

Original language	English
Pages	97-114
Publication status	Published - 2020
Event	3rd European Conference on Argumentation: Reason to Dissent - University of Groningen, Groningen, Netherlands Duration: 24 Jun 2019 → 27 Feb 2021 http://ecargument.org

Conference

Conference	3rd European Conference on Argumentation
Country/Territory	Netherlands
City	Groningen
Period	24/06/19 → 27/02/21
Internet address	http://ecargument.org

Access to Document

Final Published VersionFinal published version, 1.04 MB

Cite this

@conference{0540b38bef0e4d289ab625e2e4457c34,

title = "A decision tree for annotating argumentation scheme corpora",

abstract = "Quantitative approaches, necessary for e.g. computationallinguistic methods such as argument mining, require large annotated corpora of argumentative discourse. Publicly available corpora of argumentation schemes often only cover a small selection of example schemes and suffer from lowinter-annotator agreement. To address this, we present a heuristic decision tree for the classification of Walton's toplevel taxonomy of 60 schemes. An annotation study on 505 arguments resulted in a 97% classification covering 38 schemes (Cohen{\textquoteright}s κ 0.723). ",

author = "John Lawrence and Jacky Visser and Douglas Walton and Chris Reed",

year = "2020",

language = "English",

pages = "97--114",

note = "3rd European Conference on Argumentation : Reason to Dissent ; Conference date: 24-06-2019 Through 27-02-2021",

url = "http://ecargument.org",

}

TY - CONF

T1 - A decision tree for annotating argumentation scheme corpora

AU - Lawrence, John

AU - Visser, Jacky

AU - Walton, Douglas

AU - Reed, Chris

PY - 2020

Y1 - 2020

N2 - Quantitative approaches, necessary for e.g. computationallinguistic methods such as argument mining, require large annotated corpora of argumentative discourse. Publicly available corpora of argumentation schemes often only cover a small selection of example schemes and suffer from lowinter-annotator agreement. To address this, we present a heuristic decision tree for the classification of Walton's toplevel taxonomy of 60 schemes. An annotation study on 505 arguments resulted in a 97% classification covering 38 schemes (Cohen’s κ 0.723).

AB - Quantitative approaches, necessary for e.g. computationallinguistic methods such as argument mining, require large annotated corpora of argumentative discourse. Publicly available corpora of argumentation schemes often only cover a small selection of example schemes and suffer from lowinter-annotator agreement. To address this, we present a heuristic decision tree for the classification of Walton's toplevel taxonomy of 60 schemes. An annotation study on 505 arguments resulted in a 97% classification covering 38 schemes (Cohen’s κ 0.723).

UR - http://ecargument.org/

M3 - Paper

SP - 97

EP - 114

T2 - 3rd European Conference on Argumentation

Y2 - 24 June 2019 through 27 February 2021

ER -

A decision tree for annotating argumentation scheme corpora

Abstract

Conference

Access to Document

Other files and links

Fingerprint

Cite this