Abstract
It is known from large-scale crowd experimentation that some people are innately better at analysing complex situations and making justified predictions – the so-called ‘superforecasters’. Surprisingly, however, there has to date been no work exploring the role played by the reasoning in those justifications. Bag-of-words analyses might tell us something, but the real value lies in understanding what features of reasoning and argumentation lead to better forecasts – both in providing an objective measure for argument quality, and even more importantly, in providing guidance on how to improve forecasting performance. The work presented here covers the creation of a unique dataset of such prediction rationales, the structure of which naturally lends itself to partially automated annotation which in turn is used as the basis for subsequent manual enhancement that provides a uniquely fine-grained and close characterisation of the structure of argumentation, with potential impact on forecasting domains from intelligence analysis to investment decision-making.
Original language | English |
---|---|
Title of host publication | Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) |
Place of Publication | Torino, Italy |
Publisher | European Language Resources Association (ELRA) |
Pages | 7395-7405 |
Publication status | Published - May 2024 |
Event | The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation - Lingotto Conference Centre, Torino, Italy Duration: 22 May 2024 → 24 May 2024 https://lrec-coling-2024.org/ |
Conference
Conference | The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation |
---|---|
Abbreviated title | LREC-COLING 2024 |
Country/Territory | Italy |
City | Torino |
Period | 22/05/24 → 24/05/24 |
Internet address |
Keywords
- forecasting
- argumentation
- corpus