Psychometric Evaluation of a Measure of Evidence-Based Practice in Occupational Health

Main Article Content

Jani Ruotsalainen https://orcid.org/0009-0004-4028-5220
Kati Päätalo https://orcid.org/0000-0003-2059-4910
Kari-Pekka Martimo https://orcid.org/0009-0001-3625-7284
Tuula Oksanen https://orcid.org/0000-0002-0004-1035

Keywords

questionnaire, evidence-based practice, evidence-based health care

Abstract


Background: Occupational Health Services (OHS) are obliged to follow the principles of evidence-based medicine. However, there needs to be tools to measure this. Therefore, we developed and validated a questionnaire for evaluating OHS practitioners' attitudes, competence, and organisational support to perform evidence-based practice (EBP-OHS) following the JBI Model of Evidence-Based Healthcare. Methods: The questionnaire's content validity was assessed by 12 experts in the field. Then, an opportunity sample of 549 OHS practitioners completed the questionnaire. We examined the questionnaire's psychometric properties using exploratory factor analysis and subjected it to construct validity and reliability testing. Results: The content validity index of the chosen items was 0.78 or higher. Exploratory factor analysis revealed that the measure's construct validity was adequate (KMO 0.9). Principal component factor analysis supported a three-factor structure (all eigenvalues 1.3 or more), which explained 60.3 % of the total variance. Aligned with these three factors, the EBP-OHS consists of three domains: Organisational support (seven items), OHS practitioners' competence (six items) and OHS practitioners' attitudes (two items). The scale's reliability is good (Cronbach alpha 0.88). Conclusions: The EBP-OHS is a valid tool for measuring occupational health services' evidence-based practice and enabling the implementation of research into practice. It embodies the phases of evidence transfer and implementation described in the JBI Model of Evidence-Based Healthcare and translates them into concrete measurable activities in the OHS context.


Abstract 176 | PDF Downloads 150

References

1. Jordan Z, Lockwood C, Munn Z, Aromataris E. The updated Joanna Briggs Institute Model of Evi-dence-Based Healthcare. Int J Evid Based Healthc. 2119;17(1):58-71. Doi: 10.1097/XEB.0000000000000155
2. Pearson A, Wiechula R, Court A, Lockwood C. The JBI model of evidence-based healthcare. Int J Evid Based Healthc. 2005;3(8):207-215. Doi: 10.1111/j.1479-6988.2005.00026.x
3. Brämberg EB, Nyman T, Kwak L, et al. Development of evidence-based practice in occupational health services in Sweden: a 3-year follow-up of attitudes, barriers and facilitators. Int Arch Occup Environ Health. 2017;90(4):335-348. Doi: 10.1007/s00420-017-1200-8
4. Heselmans A, Donceel P, Aertgeerts B, Van de Velde S, Ramaekers D. The attitude of Flemish occupational health physicians toward evidence-based occupational health and clinical practice guidelines. Int Arch Occup Environ Health. 2010;83(2):201-208. Doi: 10.1007/s00420-009-0449-y
5. Kinnunen-Amoroso M. How occupational health care professionals experience evidence-based guide-lines in Finland: a qualitative study. J Eval Clin Pract. 2013;19(4):612-616. Doi: 10.1111/j.1365-2753.2012.01850.x
6. Bianchi M, Bagnasco A, Bressan V, et al. A review of the role of nurse leadership in promoting and sus-taining evidence-based practice. J Nurs Manag. 2018;26(8):918-932. Doi: 10.1111/jonm.12638
7. Shaneyfelt T, Baum KD, Bell D, et al. Instruments for evaluating education in evidence-based practice: a sys-tematic review. JAMA. 2006;296(9):1116-1127. Doi: 10.1001/jama.296.9.1116
8. da Silva AM, Valentim DP, Martins AL, Padula RS. Instruments to Assess Evidence-Based Practice Among Health Care Professionals: A Systematic Review. Health Educ Behav. Published online June 1, 2023:10901981231170154. Doi :10.1177/10901981231170154
9. Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. BMJ. 2003;326(7384):319-321. Doi: 10.1136/bmj.326.7384.319
10. Sanders K, Vassev A. Fresno test. https://www.sralab.org/rehabilitation-measures/fresno-test. Pub-lished November 14, 2018. Accessed November 24, 2023. https://www.sralab.org/rehabilitation-measures/fresno-test
11. Upton D, Upton P. Development of an evidence-based practice questionnaire for nurses. J Adv Nurs. 2006;53(4):454-458. Doi: 10.1111/j.1365-2648.2006.03739.x
12. Paul F, Connor L, McCabe M, Ziniel S. The development and content validity testing of the Quick-EBP-VIK: A survey instrument measuring nurses' values, knowledge and implementation of evi-dence-based practice. J Nurs Educ Pract. 2016;6(5). Doi: 10.5430/jnep.v6n5p118
13. Mikkonen K, Tomietto M, Watson R. Instrument development and psychometric testing in nursing education research. Nurse Educ Today. 2022;119:105603. Doi: 10.1016/j.nedt.2022.105603
14. Korhonen T, Siltanen H, Hahtela N, Holopainen A. Toteutuuko Näyttöön Perustuva Toiminta Suo-messa? Raportti Nykytilasta Hoitotyön Edustajien Kuvaamana.; 2018.
15. Polit D, Hungler B. Nursing Research: Principles and Methods. 6th ed. Lippincott Williams & Wilkins; 1999.
16. Finnish National Board on Research Integrity. The Ethical Principles of Research with Human Par-ticipants and Ethical Review in the Human Sciences in Finland.; 2019. https://tenk.fi/sites/default/files/2021-01/Ethical_review_in_human_sciences_2020.pdf
17. Nunnally J, Bernstein I. Psychometric Theory. 3rd ed. McGraw-Hill; 1994.
18. Lockwood C. Applying Theory Informed Global Trends in a Collaborative Model for Organizational Evidence-based Healthcare. Journal of Korean Academy of Nursing Administration. 2017;23(2):111. doi:10.11111/jkana.2017.23.2.111