Towards Standardization of Quantitative Retinal Vascular Parameters: Comparison of SIVA and VAMPIRE Measurements in the Lothian Birth Cohort 1936

Sarah McGrory, Adele M. Taylor, Enrico Pellegrini, Lucia Ballerini, Mirna Kirin, Fergus N. Doubal, Joanna M. Wardlaw, Alex S. F. Doney, Baljean Dhillon, John M. Starr, Emanuele Trucco, Ian J. Deary (Lead / Corresponding author), Thomas J. MacGillivray

Research output: Contribution to journalArticle

9 Citations (Scopus)
119 Downloads (Pure)

Abstract

Purpose: Semiautomated software applications derive quantitative retinal vascular parameters from fundus camera images. However, the extent of agreement between measurements from different applications is unclear. We evaluate the agreement between retinal measures from two software applications, the Singapore "I" Vessel Assessment (SIVA) and the Vessel Assessment and Measurement Platform for Images of the Retina (VAMPIRE), and examine respective associations between retinal and systemic outcomes.

Method: Fundus camera images from 665 Lothian Birth Cohort 1936 participants were analyzed with SIVA and VAMPIRE. Intraclass correlation coefficients (ICC) and Bland-Altman plots assessed agreement between retinal parameters: measurements of vessel width, fractal dimension, and tortuosity. Retinal-systemic variable associations were assessed with Pearson's correlation, and intersoftware correlation magnitude differences were examined with Williams's test.

Results: ICC values indicated poor to limited agreement for all retinal parameters (0.159-0.410). Bland-Altman plots revealed proportional bias in the majority, and systematic bias in all measurements. SIVA and VAMPIRE measurements were associated most consistently with systemic variables relating to blood pressure (SIVAr's from -0.122 to -0.183; VAMPIREr's from -0.078 to -0.177). Williams's tests indicated significant differences in the magnitude of association between retinal and systemic variables for 7 of 77 comparisons (P< 0.05).

Conclusions: Agreement between two common software applications was poor. Further studies are required to determine whether associations with systemic variables are software-dependent.

Translational Relevance: Standardization of the measurement of retinal vascular parameters is warranted to ensure that they are reliable and application-independent. This would be an important step towards realizing the potential of the retina as a source of imaging-derived biomarkers that are clinically useful.

Original languageEnglish
Article number12
Pages (from-to)1-17
Number of pages17
JournalTranslational Vision Science and Technology
Volume7
Issue number2
Early online date23 Mar 2018
DOIs
Publication statusPublished - Mar 2018

Fingerprint

Retinal Vessels
Singapore
Standardization
Retina
Software
Parturition
Application programs
Retinaldehyde
Fractals
Biomarkers
Cameras
Blood Pressure
Blood pressure
Fractal dimension
Association reactions
Imaging techniques

Keywords

  • Retina
  • Retinal image analysis
  • Retinal microvasculature

Cite this

McGrory, Sarah ; Taylor, Adele M. ; Pellegrini, Enrico ; Ballerini, Lucia ; Kirin, Mirna ; Doubal, Fergus N. ; Wardlaw, Joanna M. ; Doney, Alex S. F. ; Dhillon, Baljean ; Starr, John M. ; Trucco, Emanuele ; Deary, Ian J. ; MacGillivray, Thomas J. / Towards Standardization of Quantitative Retinal Vascular Parameters : Comparison of SIVA and VAMPIRE Measurements in the Lothian Birth Cohort 1936. In: Translational Vision Science and Technology. 2018 ; Vol. 7, No. 2. pp. 1-17.
@article{924a8380bc604c0dbf9e1da17b253001,
title = "Towards Standardization of Quantitative Retinal Vascular Parameters: Comparison of SIVA and VAMPIRE Measurements in the Lothian Birth Cohort 1936",
abstract = "Purpose: Semiautomated software applications derive quantitative retinal vascular parameters from fundus camera images. However, the extent of agreement between measurements from different applications is unclear. We evaluate the agreement between retinal measures from two software applications, the Singapore {"}I{"} Vessel Assessment (SIVA) and the Vessel Assessment and Measurement Platform for Images of the Retina (VAMPIRE), and examine respective associations between retinal and systemic outcomes.Method: Fundus camera images from 665 Lothian Birth Cohort 1936 participants were analyzed with SIVA and VAMPIRE. Intraclass correlation coefficients (ICC) and Bland-Altman plots assessed agreement between retinal parameters: measurements of vessel width, fractal dimension, and tortuosity. Retinal-systemic variable associations were assessed with Pearson's correlation, and intersoftware correlation magnitude differences were examined with Williams's test.Results: ICC values indicated poor to limited agreement for all retinal parameters (0.159-0.410). Bland-Altman plots revealed proportional bias in the majority, and systematic bias in all measurements. SIVA and VAMPIRE measurements were associated most consistently with systemic variables relating to blood pressure (SIVAr's from -0.122 to -0.183; VAMPIREr's from -0.078 to -0.177). Williams's tests indicated significant differences in the magnitude of association between retinal and systemic variables for 7 of 77 comparisons (P< 0.05).Conclusions: Agreement between two common software applications was poor. Further studies are required to determine whether associations with systemic variables are software-dependent.Translational Relevance: Standardization of the measurement of retinal vascular parameters is warranted to ensure that they are reliable and application-independent. This would be an important step towards realizing the potential of the retina as a source of imaging-derived biomarkers that are clinically useful.",
keywords = "Retina, Retinal image analysis, Retinal microvasculature",
author = "Sarah McGrory and Taylor, {Adele M.} and Enrico Pellegrini and Lucia Ballerini and Mirna Kirin and Doubal, {Fergus N.} and Wardlaw, {Joanna M.} and Doney, {Alex S. F.} and Baljean Dhillon and Starr, {John M.} and Emanuele Trucco and Deary, {Ian J.} and MacGillivray, {Thomas J.}",
note = "We thank the LBC1936 participants, and the research assistants who contributed to the study. LBC1936 data collection was supported by Age UK (Disconnected Mind project). Support from NHS Lothian R&D, and Edinburgh Imaging and the Edinburgh Clinical Research Facility at the University of Edinburgh is gratefully acknowledged. FD is funded by a NRS clinician fellowship and by a Stroke Association/Garfield Weston Foundation lectureship. The work was undertaken in The University of Edinburgh Centre for Cognitive Ageing and Cognitive Epidemiology, which is supported by funding from BBSRC and the Medical Research Council (MRC) as part of the cross council Lifelong Health and Wellbeing Initiative (MR/K026992/1). This work was partially supported by EPSRC project EP/M005976/1 “Multimodal retinal biomarkers for vascular dementia”.",
year = "2018",
month = "3",
doi = "10.1167/tvst.7.2.12",
language = "English",
volume = "7",
pages = "1--17",
journal = "Translational Vision Science and Technology",
issn = "2164-2591",
publisher = "Association for Research in Vision and Ophthalmology",
number = "2",

}

Towards Standardization of Quantitative Retinal Vascular Parameters : Comparison of SIVA and VAMPIRE Measurements in the Lothian Birth Cohort 1936. / McGrory, Sarah; Taylor, Adele M.; Pellegrini, Enrico; Ballerini, Lucia; Kirin, Mirna; Doubal, Fergus N.; Wardlaw, Joanna M.; Doney, Alex S. F.; Dhillon, Baljean; Starr, John M.; Trucco, Emanuele; Deary, Ian J. (Lead / Corresponding author); MacGillivray, Thomas J.

In: Translational Vision Science and Technology, Vol. 7, No. 2, 12, 03.2018, p. 1-17.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Towards Standardization of Quantitative Retinal Vascular Parameters

T2 - Comparison of SIVA and VAMPIRE Measurements in the Lothian Birth Cohort 1936

AU - McGrory, Sarah

AU - Taylor, Adele M.

AU - Pellegrini, Enrico

AU - Ballerini, Lucia

AU - Kirin, Mirna

AU - Doubal, Fergus N.

AU - Wardlaw, Joanna M.

AU - Doney, Alex S. F.

AU - Dhillon, Baljean

AU - Starr, John M.

AU - Trucco, Emanuele

AU - Deary, Ian J.

AU - MacGillivray, Thomas J.

N1 - We thank the LBC1936 participants, and the research assistants who contributed to the study. LBC1936 data collection was supported by Age UK (Disconnected Mind project). Support from NHS Lothian R&D, and Edinburgh Imaging and the Edinburgh Clinical Research Facility at the University of Edinburgh is gratefully acknowledged. FD is funded by a NRS clinician fellowship and by a Stroke Association/Garfield Weston Foundation lectureship. The work was undertaken in The University of Edinburgh Centre for Cognitive Ageing and Cognitive Epidemiology, which is supported by funding from BBSRC and the Medical Research Council (MRC) as part of the cross council Lifelong Health and Wellbeing Initiative (MR/K026992/1). This work was partially supported by EPSRC project EP/M005976/1 “Multimodal retinal biomarkers for vascular dementia”.

PY - 2018/3

Y1 - 2018/3

N2 - Purpose: Semiautomated software applications derive quantitative retinal vascular parameters from fundus camera images. However, the extent of agreement between measurements from different applications is unclear. We evaluate the agreement between retinal measures from two software applications, the Singapore "I" Vessel Assessment (SIVA) and the Vessel Assessment and Measurement Platform for Images of the Retina (VAMPIRE), and examine respective associations between retinal and systemic outcomes.Method: Fundus camera images from 665 Lothian Birth Cohort 1936 participants were analyzed with SIVA and VAMPIRE. Intraclass correlation coefficients (ICC) and Bland-Altman plots assessed agreement between retinal parameters: measurements of vessel width, fractal dimension, and tortuosity. Retinal-systemic variable associations were assessed with Pearson's correlation, and intersoftware correlation magnitude differences were examined with Williams's test.Results: ICC values indicated poor to limited agreement for all retinal parameters (0.159-0.410). Bland-Altman plots revealed proportional bias in the majority, and systematic bias in all measurements. SIVA and VAMPIRE measurements were associated most consistently with systemic variables relating to blood pressure (SIVAr's from -0.122 to -0.183; VAMPIREr's from -0.078 to -0.177). Williams's tests indicated significant differences in the magnitude of association between retinal and systemic variables for 7 of 77 comparisons (P< 0.05).Conclusions: Agreement between two common software applications was poor. Further studies are required to determine whether associations with systemic variables are software-dependent.Translational Relevance: Standardization of the measurement of retinal vascular parameters is warranted to ensure that they are reliable and application-independent. This would be an important step towards realizing the potential of the retina as a source of imaging-derived biomarkers that are clinically useful.

AB - Purpose: Semiautomated software applications derive quantitative retinal vascular parameters from fundus camera images. However, the extent of agreement between measurements from different applications is unclear. We evaluate the agreement between retinal measures from two software applications, the Singapore "I" Vessel Assessment (SIVA) and the Vessel Assessment and Measurement Platform for Images of the Retina (VAMPIRE), and examine respective associations between retinal and systemic outcomes.Method: Fundus camera images from 665 Lothian Birth Cohort 1936 participants were analyzed with SIVA and VAMPIRE. Intraclass correlation coefficients (ICC) and Bland-Altman plots assessed agreement between retinal parameters: measurements of vessel width, fractal dimension, and tortuosity. Retinal-systemic variable associations were assessed with Pearson's correlation, and intersoftware correlation magnitude differences were examined with Williams's test.Results: ICC values indicated poor to limited agreement for all retinal parameters (0.159-0.410). Bland-Altman plots revealed proportional bias in the majority, and systematic bias in all measurements. SIVA and VAMPIRE measurements were associated most consistently with systemic variables relating to blood pressure (SIVAr's from -0.122 to -0.183; VAMPIREr's from -0.078 to -0.177). Williams's tests indicated significant differences in the magnitude of association between retinal and systemic variables for 7 of 77 comparisons (P< 0.05).Conclusions: Agreement between two common software applications was poor. Further studies are required to determine whether associations with systemic variables are software-dependent.Translational Relevance: Standardization of the measurement of retinal vascular parameters is warranted to ensure that they are reliable and application-independent. This would be an important step towards realizing the potential of the retina as a source of imaging-derived biomarkers that are clinically useful.

KW - Retina

KW - Retinal image analysis

KW - Retinal microvasculature

UR - http://www.scopus.com/inward/record.url?scp=85044357446&partnerID=8YFLogxK

U2 - 10.1167/tvst.7.2.12

DO - 10.1167/tvst.7.2.12

M3 - Article

C2 - 29600120

VL - 7

SP - 1

EP - 17

JO - Translational Vision Science and Technology

JF - Translational Vision Science and Technology

SN - 2164-2591

IS - 2

M1 - 12

ER -