Selected topic: Disaster medicine| Volume 39, ISSUE 5, P629-636, November 2010

Evaluation of Medical Management During a Mass Casualty Incident Exercise: An Objective Assessment Tool to Enhance Direct Observation


      Background: Functional exercises represent an important link between disaster planning and disaster response. Although these exercises are widely performed, no standardized method exists for their evaluation. Study Objectives: To describe a simple and objective method to assess medical performance during functional exercise events. Methods: An evaluation tool comprising three data fields (triage, clinical maneuvers, and radio usage), accompanied by direct anecdotal observational methods, was used to evaluate a large functional mass casualty incident exercise. Results: Seventeen medical responders managed 112 victims of a simulated building explosion. Although 81% of the patients were assigned the appropriate triage codes, evacuation from the site did not follow in priority. Required maneuvers were performed correctly in 85.2% of airway maneuvers and 78.7% of breathing maneuvers, however, significant under-treatment occurred, possibly due to equipment shortages. Extensive use of radio communication was documented. In evaluating this tool, the structured markers were informative, but further information provided by direct observation was invaluable. Conclusion: A three-part tool (triage, medical maneuvers, and radio usage) can provide a method to evaluate functional mass casualty incident exercises, and is easily implemented. For the best results, it should be used in conjunction with direct observation. The evaluation tool has great potential as a reproducible and internationally recognized tool for evaluating disaster management exercises.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of Emergency Medicine
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Daines G.E.
        Planning, training and exercising.
        in: Drabek T.E. Hoetmer G. Emergency management. International City/County Management Association, Washington DC1991: 161-200
        • Cosgrove S.E.
        • Jenckes M.J.
        • Kohri K.
        • et al.
        Evaluation of hospital disaster drills: a module-based approach.
        Agency for Healthcare Research and Quality, Rockville, MD2004 (Accessed January 8, 2008)
        • Seynaeve G.
        • Archer F.
        • Fisher J.
        • et al.
        • World Association for Disaster and Emergency Medicine, Education Committee Working Group
        International standards and guidelines on education and training for the multi-disciplinary health response to major events that threaten the health status of a community.
        Prehosp Disaster Med. 2004; 19: S17-S30
        • Coste V.
        • Vuillermoz F.
        • Barthet M.C.
        • Joly B.
        • Virenque C.
        Exercices de medécine de catastrophe: intérêt d'une fiche de simulation évolutive pour le victimes [French].
        Méd Catastrophe Urg Collectives. 1998; 1: 29-32
        • Debacker M.
        • Delooz H.
        • Della Corte F.
        The European Master Program in Disaster Medicine (EMDM): a unique education and training model.
        Int J Disaster Med. 2003; 1: 35-41
        • Benson M.
        • Koenig K.L.
        • Schultz C.H.
        Disaster triage: START, then SAVE—a new method of dynamic triage for victims of a catastrophic earthquake.
        Prehosp Disaster Med. 1996; 11: 117-124
        • Thorstensson M.
        • Morin M.
        • Jenvald J.
        Monitoring and visualization support for management of medical resources in mass-casualty incidents.
        Proc Int Emerg Manage Soc. 1999; : 179-188
        • Drahota A.
        • Dewey A.
        The sociogram: a useful tool in the analysis of focus groups.
        Nurs Res. 2008; 57: 293-297
        • Morin M.
        • Jenvald J.
        • Thorstensson M.
        Computer-supported visualization of rescue operations.
        Saf Sci. 2000; 35: 3-27
        • Perry R.W.
        Disaster exercise outcomes for professional emergency personnel and citizen volunteers.
        J Contingencies Crisis Manage. 2004; 12: 64-75
        • Cook L.
        Hospital disaster drill game: a strategy for teaching disaster protocols to hospital staff.
        J Emerg Nurs. 1990; 16: 269-273
        • Maxwell C.
        • Cherneski M.
        Post-disaster drill analysis.
        J Emerg Med Serv. 1987; 12: 43-46
        • Tur-Kaspa I.
        • Lev E.I.
        • Hendler I.
        • et al.
        Preparing hospitals for toxicological mass casualties events.
        Crit Care Med. 1999; 27: 1004-1008
        • Lau P.F.
        • Lau C.C.
        A disaster drill in Hong Kong.
        Accid Emerg Nurs. 1997; 5: 34-38
        • Hsu E.B.
        • Jenckes M.W.
        • Catlett C.L.
        • et al.
        Effectiveness of hospital staff mass-casualty incident training methods: a systematic literature review.
        Prehosp Disaster Med. 2004; 19: 191-199
        • Klein K.R.
        • Brandenburg D.C.
        • Atas J.G.
        • Maher A.
        Use of trained observers as evaluation tool for a multi-hospital bioterrorism exercise.
        Prehosp Disaster Med. 2005; 20: 159-163
        • Green G.B.
        • Modi S.
        • Lunney K.
        • Thomas T.L.
        Generic evaluation methods for disaster drills in developing countries.
        Ann Emerg Med. 2003; 41: 689-699
        • Thomas T.L.
        • Hsu E.B.
        • Kim H.K.
        • et al.
        The incident command system in disasters: evaluation methods for a hospital-based exercise.
        Prehosp Disaster Med. 2005; 20: 14-23
        • Cosgrove S.E.
        • Jenckes M.W.
        • Kohri K.
        • et al.
        Evaluation of hospital disaster drills: a module-based approach (AHRQ Publication No. 04-0032).
        Agency for Healthcare Research and Quality, Rockville, MD2004 (Accessed January 8, 2008)
        • National Consensus Conference
        Guideline for the medical assistance in maxiemergencies.
        Azienda USL di Bologna, Bologna, Italy4–5 Nov 2005 (Accessed January 8, 2008)
        • Chan T.C.
        • Killeen J.
        • Griswold W.
        • Lenert L.
        Information technology and emergency medical care during disasters.
        Acad Emerg Med. 2004; 11: 1229-1236
        • Farnham J.W.
        Disaster and emergency communications prior to computers/Internet: a review.
        Crit Care. 2006; 10: 207
        • Tripoli L.
        Disaster communications: functional considerations for EMS communications systems.
        JEMS. 2002; 27: 62-73
        • Olesker S.
        Disaster preparedness.
        Healthc Inform. 2002; 19: 46