Validation of Hospital Disaster Risk Management Evaluation Questionnaire

Document Type : Original Research

Authors

1 National Emergency Medical Organization, Ministry of Health and Medical Education, Tehran, Iran

2 Department of Health Management and Economics, School of Public Health, Tehran University of Medical Sciences, Tehran, Iran

Abstract

Background and Aim: An accurate evaluation of hospitals' performance in dealing with disasters can be a major role in improving hospital preparedness. The Hospital Disaster Risk Management Evaluation (HDRME) Model was developed and approved in 2018 using international models and the opinion of experts. This research was conducted with the aim of validating a questionnaire for evaluating disaster risk management in hospitals based on the standards and measures of this model.
Methods: In this validation study, a questionnaire based on the HDRME Model including 200 measures in 8 domains (management and leadership, risk assessment, planning, prevention and mitigation, preparedness, response, recovery, and key performance results) was designed. The face validity and content validity were verified both qualitatively and quantitatively (using experts’ opinions, CVR, and CVI). The reliability of the questionnaire was evaluated by Cronbach's alpha method and Inter class correlation coefficient (ICC). The questionnaires were completed by two surveyors separately and independently in 30 hospitals at Tehran University of Medical Sciences, and the results were compared and analyzed.
Results: The face validity and content validity of the questionnaire were approved by experts. The results showed that Cronbach's alpha and Inter class correlation coefficient (ICC) was 0.99, which showed that the questionnaire had good reliability. The average score of the hospitals from the questionnaire was 36%. The highest score was related to the domain of prevention/mitigation (51/22) and risk assessment (44/81), and the lowest score was related to the domain of planning (24/75) and recovery (26/97).
Conclusion: The questionnaire designed from the disaster risk management evaluation model has good validity and reliability and could be used as a valid questionnaire to evaluate this issue in the country's hospitals.

Keywords


1. The EM-DAT higher resolution disaster data. Centre for Research on the Epidemiology of Disasters. CRED 2021;62 Available from: https://cred.be/sites/default/files/CredCrunch62.pdf 2. Koenig KL, Schultz CH. Koenig and Schultz's Disaster Medicine: Comprehensive Principles and Practices: Cambridge University Press 2016 3. Ciottone GR, Biddinger PD, Darling RG, Fares S, Keim ME, Molloy MS, Suner S, et al. Ciottone's Disaster Medicine: 2nd Edition Elsevier Health Sciences; 2015 Nov 5 4. Khankeh H, Masoumi G. National Hospital Disaster Risk Management Program Based on Accreditation Indicators. Tehran: University of Social Welfare and Rehabilitation Sciences; 2018. [In Persian] 5. Abbasabadi-Arab M, Mosadeghrad AM, Asgari N. Comprehensive Evaluation of Disaster Risk Management Standards in the Iranian Hospitals. Journal Mil Med. 2022 Jul 19;24(4):1231-40. doi: ‎10.30491/JMM.24.4.1231 [In Persian] 6. Bazyar J, Pourvakhshoori N, Safarpour H, Farrokhi M, Khankeh HR, Daliri S, et al. Hospital disaster preparedness in Iran: a systematic review and meta-analysis. Iranian journal of public health. 2020 May;49(5):837-850. PMID: 32953672 7. Mosadeghrad A. Essentials of healthcare organization and management. Tehran: Dibagran Tehran 2015; 1th ed [in Persian] 8. Abbasabadi -Arab M, Khankeh HR, Mosadeghrad AM, Farrokhi M. Developing a hospital disaster risk management evaluation model. Risk Management and Healthcare Policy 2019;12:287. doi: 10.2147/rmhp.s215444 9. Agrawal N. Natural Disasters and Risk Management in Canada: An Introduction, 1th ed, Springer 2018 10. Zhong S, Clark M, Hou X-Y, Zang Y-L, Fitzgerald G. Development of hospital disaster resilience: conceptual framework and potential measurement. Emergency Medicine Journal 2014;31:930-938. doi: 10.1136/emermed-2012-202282 11. Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Front Public Health. 2018 Jun 11;6:149. doi: 10.3389/fpubh.2018.00149. 12. Lawshe CH. A quantitative approach to content validity. Pers psychol 1975;28(4):563-75. 13. Waltz CF, Bausell RB. Nursing Research: Design. Statistics, and Computer Analysis:FA Davis Company; 1981. 14. Trevethan R. Intraclass correlation coefficients: clearing the air, extending some cautions, and making some requests. Health Services and Outcomes Research Methodology 2017;17;2:127-43. doi: 10.1007/s10742-016-0156-6 15. Abbasabadi -Arab M, Mosadeghrad AM, Khankeh HR, Biglarian A. Development of hospital disaster risk management accreditation standards. Tehran University Medical Journal 2021 Oct 1;79;7: 533-45 [In Persian] 16. Pan American Health Organization (PAHO). What is the Hospital Safety Index? The organization; 2008. 4 p. Available from: http://www.emforum.org/vforum/PAHO/Hospital%20SafetyIndex%20Flyer%20English.pdf. [Accessed 9 Sep 2010] 17. Tang R, Fitzgerald G, Hou XY, Wu YP. Building an evaluation instrument for China's hospital emergency preparedness: a systematic review of preparedness instruments. Disaster Med Public Health Prep. 2014 Feb;8(1):101-9. doi: 10.1017/dmp.2014.10. 18. Nekoie-Moghadam M, Kurland L, Moosazadeh M, Ingrassia PL, Della Corte F, Djalali A. Tools and Checklists Used for the Evaluation of Hospital Disaster Preparedness: A Systematic Review. Disaster Med Public Health Prep. 2016 Oct;10(5):781-788. doi: 10.1017/dmp.2016.30. 19. Adini B, Goldberg A, Laor D, Cohen R, Zadok R, Bar-Dayan Y. Assessing levels of hospital emergency preparedness. Prehospital and disaster medicine. 2006 Nov-Dec;21(6):451-7. doi: 10.1017/s1049023x00004192 20. ISQua. Guidelines and Principles for the Development of Health and Social Care Standards. 4th Edition ed: International society for quality in health care; 2015. 21. Mosadeghrad AM. Hospitals organizational resiliency: From Theory to Practice. Payesh (Health Monitor) 2020 Dec; 15;19;6 :749-51 [in Persian] 22. Sobhani G, Khammarnia M, Hayati R, Ravangard R, Heydari AR, Heydarvand S. Investigation of the preparedness level of the hospitals against disasters in Bandar Abbas, Iran, in 2012. J Pak Med Assoc. 2014 May;64(5):506-9. PMID: 25272533. 23. Parsaei M, Khankeh H, HabibiSaravi R, Hosseini SH. Hospital disaster preparedness in Mazandaran province, Iran 2017. Journal of Mazandaran University of Medical Sciences 2019 Jan 10;28;168:108-17 [In Persian] 24. Abbasabadi-Arab M, Khankeh H R, Mosadeghrad A M. Disaster Risk Management in the Iranian Hospitals: Challenges and Solutions. J Mil Med. 2022; 24 (3) :1150-1165. ‎doi: 10.30491/JMM.24.3.1150 [In Persian]