Psychometric Evaluation of a Measure of Evidence-Based Practice in Occupational Health
Keywords:
questionnaire, evidence-based practice, evidence-based health careAbstract
Background: Occupational Health Services (OHS) are obliged to follow the principles of evidence-based medicine. However, there needs to be tools to measure this. Therefore, we developed and validated a questionnaire for evaluating OHS practitioners' attitudes, competence, and organisational support to perform evidence-based practice (EBP-OHS) following the JBI Model of Evidence-Based Healthcare. Methods: The questionnaire's content validity was assessed by 12 experts in the field. Then, an opportunity sample of 549 OHS practitioners completed the questionnaire. We examined the questionnaire's psychometric properties using exploratory factor analysis and subjected it to construct validity and reliability testing. Results: The content validity index of the chosen items was 0.78 or higher. Exploratory factor analysis revealed that the measure's construct validity was adequate (KMO 0.9). Principal component factor analysis supported a three-factor structure (all eigenvalues 1.3 or more), which explained 60.3 % of the total variance. Aligned with these three factors, the EBP-OHS consists of three domains: Organisational support (seven items), OHS practitioners' competence (six items) and OHS practitioners' attitudes (two items). The scale's reliability is good (Cronbach alpha 0.88). Conclusions: The EBP-OHS is a valid tool for measuring occupational health services' evidence-based practice and enabling the implementation of research into practice. It embodies the phases of evidence transfer and implementation described in the JBI Model of Evidence-Based Healthcare and translates them into concrete measurable activities in the OHS context.
References
Jordan Z, Lockwood C, Munn Z, Aromataris E. The updated Joanna Briggs Institute Model of Evi-dence-Based Healthcare. Int J Evid Based Healthc. 2119;17(1):58-71. Doi: 10.1097/XEB.0000000000000155
Pearson A, Wiechula R, Court A, Lockwood C. The JBI model of evidence-based healthcare. Int J Evid Based Healthc. 2005;3(8):207-215. Doi: 10.1111/j.1479-6988.2005.00026.x
Brämberg EB, Nyman T, Kwak L, et al. Development of evidence-based practice in occupational health services in Sweden: a 3-year follow-up of attitudes, barriers and facilitators. Int Arch Occup Environ Health. 2017;90(4):335-348. Doi: 10.1007/s00420-017-1200-8
Heselmans A, Donceel P, Aertgeerts B, Van de Velde S, Ramaekers D. The attitude of Flemish occupational health physicians toward evidence-based occupational health and clinical practice guidelines. Int Arch Occup Environ Health. 2010;83(2):201-208. Doi: 10.1007/s00420-009-0449-y
Kinnunen-Amoroso M. How occupational health care professionals experience evidence-based guide-lines in Finland: a qualitative study. J Eval Clin Pract. 2013;19(4):612-616. Doi: 10.1111/j.1365-2753.2012.01850.x
Bianchi M, Bagnasco A, Bressan V, et al. A review of the role of nurse leadership in promoting and sus-taining evidence-based practice. J Nurs Manag. 2018;26(8):918-932. Doi: 10.1111/jonm.12638
Shaneyfelt T, Baum KD, Bell D, et al. Instruments for evaluating education in evidence-based practice: a sys-tematic review. JAMA. 2006;296(9):1116-1127. Doi: 10.1001/jama.296.9.1116
da Silva AM, Valentim DP, Martins AL, Padula RS. Instruments to Assess Evidence-Based Practice Among Health Care Professionals: A Systematic Review. Health Educ Behav. Published online June 1, 2023:10901981231170154. Doi :10.1177/10901981231170154
Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. BMJ. 2003;326(7384):319-321. Doi: 10.1136/bmj.326.7384.319
Sanders K, Vassev A. Fresno test. https://www.sralab.org/rehabilitation-measures/fresno-test. Pub-lished November 14, 2018. Accessed November 24, 2023. https://www.sralab.org/rehabilitation-measures/fresno-test
Upton D, Upton P. Development of an evidence-based practice questionnaire for nurses. J Adv Nurs. 2006;53(4):454-458. Doi: 10.1111/j.1365-2648.2006.03739.x
Paul F, Connor L, McCabe M, Ziniel S. The development and content validity testing of the Quick-EBP-VIK: A survey instrument measuring nurses' values, knowledge and implementation of evi-dence-based practice. J Nurs Educ Pract. 2016;6(5). Doi: 10.5430/jnep.v6n5p118
Mikkonen K, Tomietto M, Watson R. Instrument development and psychometric testing in nursing education research. Nurse Educ Today. 2022;119:105603. Doi: 10.1016/j.nedt.2022.105603
Korhonen T, Siltanen H, Hahtela N, Holopainen A. Toteutuuko Näyttöön Perustuva Toiminta Suo-messa? Raportti Nykytilasta Hoitotyön Edustajien Kuvaamana.; 2018.
Polit D, Hungler B. Nursing Research: Principles and Methods. 6th ed. Lippincott Williams & Wilkins; 1999.
Finnish National Board on Research Integrity. The Ethical Principles of Research with Human Par-ticipants and Ethical Review in the Human Sciences in Finland.; 2019. https://tenk.fi/sites/default/files/2021-01/Ethical_review_in_human_sciences_2020.pdf
Nunnally J, Bernstein I. Psychometric Theory. 3rd ed. McGraw-Hill; 1994.
Lockwood C. Applying Theory Informed Global Trends in a Collaborative Model for Organizational Evidence-based Healthcare. Journal of Korean Academy of Nursing Administration. 2017;23(2):111. doi:10.11111/jkana.2017.23.2.111
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Jani Ruotsalainen, Kati Päätalo, Kari-Pekka Martimo, Tuula Oksanen
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
All Journal's articles are Open Access papers distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by-nc/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Reproductions with commercial intent will require written permission and payment of royalties.
This work is licensed under a CC BY-NC 4.0 Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
