Brain, Vol. 118, No. 6, 1593-1600, 1995
© 1995 Guarantors of Brain
research-article |
Intra- and inter-observer agreement of brain MRI lesion volume measurements in multiple sclerosis
A comparison of techniques
1Departments of Neurology, Scientific Institute Ospedale San Raffaele, University of Milan Italy 2Departments of Neuroradiology, Scientific Institute Ospedale San Raffaele, University of Milan Italy 3Department of Medical Physics, Royal Leicester Infirmary, University of Leicester London, UK 4NMR Research Group, Institute of Neurology London, UK
Correspondence to:
Correspondence to: Dr Massimo Filippi, Department of Neurology, Scientific Institute Ospedale San Raffaele, University of Milan, Via Olgettina 60, 20132 Milan, Italy
The measurement of MRI lesion load in multiple sclerosis is increasingly being used to evaluate the natural history of the disease and to monitor the efficacy of treatments. If, as might occur in multicentre studies, lesion load is measured by several observers in different patients or by the same observer in serial scans, it would be necessary to utilize a technique which provides results with high inter- and intra-observer agreements. This study was performed to evaluate the intra- and inter-observer agreement of semi-automated lesion volume measurement using thresholding, and to compare them with those obtained using an arbitrary scoring system (ASS) and a quantitative manual tracing method (MTM). Brain MRIs were obtained for 20 clinically definite multiple sclerosis patients and were evaluated independently by three observers. The median intra- and inter-observer agreements were, respectively, 88.5% (range 69.0–96.8%) and 79.0% (range 73.3–98.3%) using the ASS, 95.0% (range 85.1–99.4%) and 93.4% (range 77.3–98.3%) for the MTM, 96.3% (range 94.2–98.9%) and 93.7% (range 83.8–98.3%) for the semi-automated technique. The intra- and inter-observer agreements for the semi-automated technique increased to 98.5% (range 96.3–99.8%) and 96.1% (range 90.5–98.6%) when a consensus in the choice of threshold for lesion segmentation was reached. The intra- and inter-observer agreements were significantly greater for the semi-automated method compared with both the arbitrary scoring and the MTMs. The intra-observer variability for the semi-automated technique was significantly lower (P < 0.0001) than the inter-observer variability obtained using the same technique. These data indicate that it is possible to obtain high intra- and inter-observer agreements using a semi-automatic thresholding technique to quantify lesion volumes in multiple sclerosis. The technique may prove useful in multicentre studies, in which a single observer is still preferable.
multiple sclerosis; brain MRI; intra- and inter-observer agreement; lesion volume measurements
Received January 3, 1995. Revised May 2, 1995. Accepted July 4, 1995.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  A. P. Leff, T. M. Schofield, J. T. Crinion, M. L. Seghier, A. Grogan, D. W. Green, and C. J. Price The left superior temporal gyrus is a shared substrate for auditory short-term memory and speech comprehension: evidence from 210 patients with stroke Brain, November 5, 2009; (2009) awp273v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 F. Cotton, H. L. Weiner, F. A. Jolesz, and C. R.G. Guttmann MRI contrast uptake in new lesions in relapsing-remitting MS followed at weekly intervals Neurology, February 25, 2003; 60(4): 640 - 646. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Achiron and M. Faibel Sandlike Appearance of Virchow-Robin Spaces in Early Multiple Sclerosis: A Novel Neuroradiologic Marker AJNR Am. J. Neuroradiol., March 1, 2002; 23(3): 376 - 380. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. D Molyneux, P. A Brex, C. Fogg, S. Lewis, C. Middleditch, F. Barkhof, M. P Sormani, M. Filippi, and D. H Miller The precision of T1 hypointense lesion volume quantification in multiple sclerosis treatment trials: a multicenter study Multiple Sclerosis, August 1, 2000; 6(4): 237 - 240. [Abstract] [PDF]
|
|
|
|
|
|
P. A. Caruana, M. B. Davies, S. J. M. Weatherby, R. Williams, N. Haq, D. H. Foster, and C. P. Hawkins Correlation of MRI lesions with visual psychophysical deficit in secondary progressive multiple sclerosis Brain, July 1, 2000; 123(7): 1471 - 1480. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 Y. Miki, R. I. Grossman, J. K. Udupa, L. Wei, M. Polansky, L. J. Mannon, and D. L. Kolson Relapsing-Remitting Multiple Sclerosis: Longitudinal Analysis of MR Images-Lack of Correlation between Changes in T2 Lesion Volume and Clinical Findings Radiology, November 1, 1999; 213(2): 395 - 399. [Abstract] [Full Text]
|
|
|
|
|
|
B. N. Joe, M. B. Fukui, C. C. Meltzer, Q.-s. Huang, R. S. Day, P. J. Greer, and M. E. Bozik Brain Tumor Volume Measurement: Comparison of Manual and Semiautomated Methods Radiology, September 1, 1999; 212(3): 811 - 816. [Abstract] [Full Text]
|
|
|
|
|
|
V L Stevenson and D H Miller Magnetic resonance imaging in the monitoring of disease progression in multiple sclerosis Multiple Sclerosis, August 1, 1999; 5(4): 268 - 272. [Abstract] [PDF]
|
|
|
|
|
|
T. A. Yousry, K. Seelos, M. Mayer, R. Brüning, I. Uttner, M. Dichgans, S. Mammi, A. Straube, N. Mai, and M. Filippi Characteristic MR Lesion Pattern and Correlation of T1 and T2 Lesion Volume with Neurologic and Neuropsychological Findings in Cerebral Autosomal Dominant Arteriopathy with Subcortical Infarcts and Leukoencephalopathy (CADASIL) AJNR Am. J. Neuroradiol., January 1, 1999; 20(1): 91 - 100. [Abstract] [Full Text]
|
|
|
|
|
|
G. Francis, A. Achiron, Y. Barak, N. Gadoth, E. Melamed, A. Miller, I. Steiner, O. Abramsky, A. Achiron, U. Gabbay, et al. Intravenous immunoglobulin treatment in multiple sclerosis Neurology, January 1, 1999; 52(1): 214 - 214. [Full Text] [PDF]
|
|
|
|
|
|
K. S. Cover, J. Petkau, D. K. B. Li, D. W. Paty, M. Filippi, M. P. Sormani, F. Barkhof, J. H. van Waesberghe, M. L. Gawne-Cain, D. H. Miller, et al. Lesion load reproducibility and statistical sensitivity of clinical trials in multiple sclerosis Neurology, January 1, 1999; 52(2): 433 - 433. [Full Text]
|
|
|
|
|
|
M. Filippi, T. A Yousry, M. A Rocca, C. Pereira, H. Alkadhi, and G. Comi The effect of cross-talk on MRI lesion numbers and volumes in multiple sclerosis using conventional and turbo spin-echo Multiple Sclerosis, December 1, 1998; 4(6): 471 - 474. [Abstract] [PDF]
|
|
|
|
 |
|
 P D Molyneux, P S Tofts, A Fletcher, B Gunn, P Robinson, H Gallagher, I F Moseley, G J Barker, and D H Miller Precision and reliability for measurement of change in MRI lesion volume in multiple sclerosis: a comparison of two computer assisted techniques J. Neurol. Neurosurg. Psychiatry, July 1, 1998; 65(1): 42 - 47. [Abstract] [Full Text]
|
|