Advertisement

Observer Variability as a Determinant of Measurement Error of Ultrasonographic Measurements of the Optic Nerve Sheath Diameter: A Systematic Review

      Abstract

      Background

      Ultrasonographic measurements of the diameter of the sheath of the optic nerve can be used to assess intracranial pressure indirectly. These measurements come with measurement error.

      Objective

      Our aim was to estimate observer's measurement error as a determinant of ultrasonographic measurement variability of the optic nerve sheath diameter.

      Methods

      A systematic search of the literature was conducted in Embase, Medline, Web of Science, the Cochrane Central Register of Trials, and the first 200 articles of Google Scholar up to April 19, 2021. Inclusion criteria were the following: healthy adults, B-mode ultrasonography, and measurements 3 mm behind the retina. Studies were excluded if standard error of measurement could not be calculated. Nine studies featuring 389 participants (median 40; range 15–100) and 22 observers (median 2; range 1–4) were included. Standard error of measurement and minimal detectable differences were calculated to quantify observer variability. Quality and risk of bias were assessed with the Guidelines for Reporting Reliability and Agreement Studies.

      Results

      The standard error of measurement of the intra- and interobserver variability had a range of 0.10–0.41 mm and 0.14–0.42 mm, respectively. Minimal detectable difference of a single observer was 0.28–1.1 mm. Minimal detectable difference of multiple observers (range 2–4) was 0.40–1.1 mm. Quality assessment showed room for methodological improvement of included studies.

      Conclusions

      The standard errors of measurement and minimal detectable differences of ultrasonographic measurements of the optic nerve sheath diameter found in this review with healthy participants indicate caution should be urged when interpreting results acquired with this measurement method in clinical context.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Emergency Medicine
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Dewan MC
        • Rattani A
        • Gupta S
        • et al.
        Estimating the global incidence of traumatic brain injury.
        J Neurosurg. 2018; 130: 1080-1097
        • Brooks JC
        • Shavelle RM
        • Strauss DJ
        • Hammond FM
        • Harrison-Felix CL
        Long-term survival after traumatic brain injury part II: life expectancy.
        Arch Phys Med Rehabil. 2015; 96: 1000-1005
        • Dawes AJ
        • Sacks GD
        • Cryer HG
        • et al.
        Intracranial pressure monitoring and inpatient mortality in severe traumatic brain injury: a propensity score-matched analysis.
        J Trauma Acute Care Surg. 2015; 78 (discussion 502): 492-501
        • Jünger EC
        • Newell DW
        • Grant GA
        • et al.
        Cerebral autoregulation following minor head injury.
        J Neurosurg. 1997; 86: 425-432
        • Carney N
        • Totten AM
        • O'Reilly C
        • et al.
        Guidelines for the Management of Severe Traumatic Brain Injury, Fourth Edition.
        Neurosurgery. 2017; 80: 6-15
        • Bratton SL
        • Chestnut RM
        • Ghajar J
        • et al.
        Guidelines for the management of severe traumatic brain injury. VII. Intracranial pressure monitoring technology.
        J Neurotrauma. 2007; 24: S45-S54
        • Schroeder C
        • Katsanos AH
        • Richter D
        • Tsivgoulis G
        • Gold R
        • Krogias C.
        Quantification of optic nerve and sheath diameter by transorbital sonography: a systematic review and metanalysis.
        J Neuroimaging. 2020; 30: 165-174
        • Fernando SM
        • Tran A
        • Cheng W
        • et al.
        Diagnosis of elevated intracranial pressure in critically ill adults: systematic review and meta-analysis.
        BMJ. 2019; 366: l4225
        • Robba C
        • Santori G
        • Czosnyka M
        • et al.
        Optic nerve sheath diameter measured sonographically as non-invasive estimator of intracranial pressure: a systematic review and meta-analysis.
        Intensive Care Med. 2018; 44: 1284-1294
        • Dubourg J
        • Messerer M
        • Geeraerts T
        • Cour-Andlauer F
        • Javouhey E
        • Kassai B.
        Diagnostic accuracy of ultrasonography of optic nerve sheath diameter for detecting raised intracranial pressure.
        Acta Anaesthesiol Scand. 2011; 55: 899
        • Lee SH
        • Jong Yun S
        Diagnostic performance of optic nerve sheath diameter for predicting neurologic outcome in post-cardiac arrest patients: a systematic review and meta-analysis.
        Resuscitation. 2019; 138: 59-67
        • Maissan IM
        • Dirven PJAC
        • Haitsma IK
        • Hoeks SE
        • Gommers D
        • Stolker RJ.
        Ultrasonographic measured optic nerve sheath diameter as an accurate and quick monitor for changes in intracranial pressure.
        J Neurosurg. 2015; 123: 743-747
        • Bland JM
        • Altman DG.
        Measurement error.
        BMJ. 1996; 313: 744
        • Popovic ZB
        • Thomas JD.
        Assessing observer variability: a user's guide.
        Cardiovasc Diagn Ther. 2017; 7: 317-324
        • de Vet HC
        • Terwee CB
        • Knol DL
        • Bouter LM.
        When to use agreement versus reliability measures.
        J Clin Epidemiol. 2006; 59: 1033-1039
        • Page MJ
        • McKenzie JE
        • Bossuyt PM
        • et al.
        The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.
        BMJ. 2021; 372: n71
        • Bramer WM
        • de Jonge GB
        • Rethlefsen ML
        • Mast F
        • Kleijnen J.
        A systematic approach to searching: an efficient and complete method to develop literature searches.
        J Med Libr Assoc. 2018; 106: 531-541
        • Rethlefsen ML
        • Kirtley S
        • Waffenschmidt S
        • et al.
        PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews.
        Syst Rev. 2021; 10: 39
        • Kottner J
        • Audigé L
        • Brorson S
        • et al.
        Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed.
        J Clin Epidemiol. 2011; 64: 96-106
        • Hopkins WG.
        Measures of reliability in sports medicine and science.
        Sports Med. 2000; 30: 1-15
        • Asghar A
        • Hashmi M
        • Hussain A.
        Optic nerve sheath diameter evaluated by transorbital sonography in healthy volunteers from Pakistan.
        Anaesth Pain Intensive Care. 2015; 19: 282-286
        • Bäuerle J
        • Lochner P
        • Nedelmann M
        • Kaps M.
        Intra- and interobsever reliability of sonographic assessment of the optic nerve sheath diameter.
        Klin Neurophysiol. 2010; : 41
        • Bäuerle J
        • Schuchardt F
        • Schroeder L
        • Egger K
        • Weigel M
        • Harloff A.
        Reproducibility and accuracy of optic nerve sheath diameter assessment using ultrasound compared to magnetic resonance imaging.
        BMC Neurol. 2013; 13: 187
        • Lochner P
        • Coppo L
        • Cantello R
        • et al.
        Intra- and interobserver reliability of transorbital sonographic assessment of the optic nerve sheath diameter and optic nerve diameter in healthy adults.
        J Ultrasound. 2016; 19: 41-45
        • Maissan IM
        • Ketelaars R
        • Vlottes B
        • Hoeks SE
        • Den Hartog D
        • Stolker RJ
        Increase in intracranial pressure by application of a rigid cervical collar: a pilot study in healthy volunteers.
        Eur J Emerg Med. 2018; 25: e24-e28
        • Shrestha G
        • Upadhyay B
        • Shahi A
        • Jaya Ram K
        • Joshi P
        • Poudyal B
        Sonographic measurement of optic nerve sheath diameter: how steep is the learning curve for a novice operator?.
        Indian J Crit Care Med. 2018; 22: 646-649
        • Cimilli Ozturk T
        • Demir H
        • Yorulmaz R
        • Ozdemir S
        • Isat G
        Ecmel Onur O. Assessment of intra-interobserver reliability of the sonographic optic nerve sheath diameter measurement.
        Kaohsiung J Med Sci. 2015; 31: 432-436
        • Shah S
        • Kimberly H
        • Marill K
        • Noble VE.
        Ultrasound techniques to measure the optic nerve sheath: is a specialized probe necessary?.
        Med Sci Monit. 2009; 15: MT63-MT68
        • Amini R
        • Stolz LA
        • Patanwala AE
        • Adhikari S.
        Coronal axis measurement of the optic nerve sheath diameter using a linear transducer.
        J Ultrasound Med. 2015; 34: 1607-1612
        • Koo TK
        • Li MY.
        A guideline of selecting and reporting intraclass correlation coefficients for reliability research.
        J Chiropr Med. 2016; 15: 155-163
        • Ballantyne SA
        • O'Neill G
        • Hamilton R
        • Hollman AS.
        Observer variation in the sonographic measurement of optic nerve sheath diameter in normal adults.
        Eur J Ultrasound. 2002; 15: 145-149
        • Schroeder C
        • Katsanos AH
        • Ayzenberg I
        • et al.
        Atrophy of optic nerve detected by transorbital sonography in patients with demyelinating diseases of the central nervous system.
        Eur J Neurol. 2020; 27: 626-632
        • Ertl M
        • Barinka F
        • Torka E
        • et al.
        Ocular color-coded sonography - a promising tool for neurologists and intensive care physicians.
        Ultraschall Med. 2014; 35: 422-431
        • Teismann NA
        • Lenaghan P
        • Stein J
        • Green A.
        Will the real optic nerve sheath please stand up?.
        J Ultrasound Med. 2012; 31: 130-131
        • McGraw KO
        • Wong SP.
        Forming inferences about some intraclass correlation coefficients.
        Psychol Methods. 1996; 1: 30-46
        • Gardner MJ
        • Altman DG.
        Confidence intervals rather than P values: estimation rather than hypothesis testing.
        Br Med J (Clin Res Ed). 1986; 292: 746-750
        • Van Genderen FR
        • De Bie RA
        • Helders PJ
        • Van Meeteren NLU.
        Reliability research: towards a more clinically relevant approach.
        Phys Ther Rev. 2013; 8: 169-176
        • Albeck MJ
        • Børgesen SE
        • Gjerris F
        • Schmidt JF
        • Sørensen PS.
        Intracranial pressure and cerebrospinal fluid outflow conductance in healthy subjects.
        J Neurosurg. 1991; 74: 597-600
        • Williams B.
        Cerebrospinal fluid pressure changes in response to coughing.
        Brain. 1976; 99: 331-346
        • Mitchell JR
        • Karlik SJ
        • Lee DH
        • Eliasziw M
        • Rice GP
        • Fenster A.
        The variability of manual and computer assisted quantification of multiple sclerosis lesion volumes.
        Med Phys. 1996; 23: 85-97
      1. What is the standard error of the within-subject standard deviation, sw? 2011. Accessed 20-09-2021 https://www-users.york.ac.uk/∼mb55/meas/seofsw.htm.

        • Hansen HC
        • Helmke K.
        Validation of the optic nerve sheath response to changing cerebrospinal fluid pressure: ultrasound findings during intrathecal infusion tests.
        J Neurosurg. 1997; 87: 34-40
        • Stevens RRF
        • Huberts W
        • Gommer ED
        • et al.
        An automated algorithm for optic nerve sheath diameter assessment from b-mode ultrasound images.
        J Neuroimaging. 2021; 31: 724-732