Can youtube be trusted as a source of quality and reliable information on COVID-19 vaccination in Italy?

Main Article Content

Leandro Gentile
Paola Bertuccio
Angela Ancona
Andrea Cucchi
Giulia Dallagiacoma
Martino Alberto Godoy
Carlo Signorelli
Anna Odone


YouTube, Covid-19, vaccination, internet, social media, information, health literacy


 Background and aim: Social media platforms are common sources of information, even more so during the COVID-19 pandemic. YouTube is the second most popular social media platform both in Italy and globally. Following criticisms regarding quality control during the pandemic, banners that would direct viewers to official health information sources were incorporated into Youtube videos related to COVID-19. The aim of this study is to assess the reliability and information quality of YouTube videos related to COVID-19 vaccination in Italy. Methods: On March 2022, six different search queries were used to retrieve COVID-19 vaccination-related videos, resulting in the identification of 329 videos, and their characteristics were described. Two validated instruments, namely HoNCode and DISCERN, were used to assess the reliability and quality of the videos’ content. Results: Of the total number of videos, 72.0% were from non-medical or generalist channels. The most represented category was internet media (32.5%) while the less frequent was educational medical channel (7.0%). Videos from medical channels had higher reliability (p=0.002) and quality (p<0.001) than not medical channels, despite receiving fewer visualizations (p=0.004), likes (p=0.018) and comments (p<0.001). Media and news agencies sources consistently delivered lower quality content. Conclusions: These findings suggest that public health professionals and institutions should consider investing in social media representation to fill the gap with non-medical sources in terms of popularity, to provide reliable and interesting videos, and ultimately deliver health education to the general public.


Download data is not yet available.
Abstract 94 | PDF Downloads 45


1. Merchant RM, Lurie N. Social Media and Emergency Preparedness in Response to Novel Coronavirus. JAMA. 2020; 323(20):2011-2012. doi:10.1001/jama.2020.4469.
2. Islam MS, Sarkar T, Khan SH, et al. COVID-19-Related Infodemic and Its Impact on Public Health: A Global Social Media Analysis. Am J Trop Med Hyg. 2020; 103(4):1621-1629. doi:10.4269/ajtmh.20-0812.
3. World Health Organization (WHO). Novel Coronavirus (2019-nCoV): situation report, 13. World Health Organization. Geneva. 2020.
4. Atkinson NL, Saperstein SL, Pleis J. Using the internet for health-related activities: findings from a national probability sample. J Med Internet Res. 2009; 11(1):e4. doi:10.2196
5. Rutten LJ, Squiers L, Hesse B. Cancer-related information seeking: hints from the 2003 Health Information National Trends Survey (HINTS). J Health Commun. 2006 11 Suppl :147-156. doi:10.1080/10810730600637574.
6. Fahy E, Hardikar R, Fox A, Mackay S. Quality of patient health information on the Internet: reviewing a complex and evolving land-scape. Australas Med J. 2014; 7(1):24-28. doi:10.4066/AMJ.2014.1900.
7. Stellefson ML, Shuster JJ, Chaney BH, et al. Web-based Health Information Seeking and eHealth Literacy among Patients Living with Chronic Obstructive Pulmonary Disease (COPD). Health Commun. 2018; 33(12):1410-1424. doi:10.1080/10410236.2017.1353868.
8. Google Trends. 2023.
/explore?date=all&q=covid-19%20vaccine. (Accessed 15 February 2023).
9. Maugeri A, Barchitta M, Agodi A. Using Google Trends to Predict COVID-19 Vaccinations and Monitor Search Behaviours about Vaccines: A Retrospective Analysis of Italian Data. Vaccines (Basel). 2022; 10(1). doi:10.3390
10. Chan C, Sounderajah V, Daniels E, et al. The Reliability and Quality of YouTube Videos as a Source of Public Health Information Re-garding COVID-19 Vaccination: Cross-sectional Study. JMIR Public Health Surveill. 2021; 7(7):e29942. doi:10.2196/29942.
11. Ngai CSB, Singh RG, Yao L. Impact of COVID-19 Vaccine Misinformation on Social Media Virality: Content Analysis of Message Themes and Writing Strategies. J Med Internet Res. 2022; 24(7):e37806. doi:10.2196/37806.
12. Alexa. The Top 500 sites on the web. (Accessed 15 February 2023).
13. Alexa. Top Sites in Italy.
/countries/IT. (Accessed 15 February 2023).
14. Youtube. How does Youtube address misinformation? (Accessed 15 February 2023).
15. Ministero della Salute. Vaccini anti Covid-19. Domande e Risposte.
.jsp?lingua=italiano&id=255. (Accessed 15 February 2023).
16. Li HOY, Bailey A, Huynh D, Chan J. YouTube as a source of information on COVID-19: A pandemic of misinformation? BMJ Glob-al Health. 2020;5(5). doi:10.1136
17. Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health infor-mation on treatment choices. J Epidemiol Community Health. 1999; 53(2):105-111. doi:10.1136/jech.53.2.105.
18. Boyer C, Selby M, Scherrer JR, Appel RD. The Health On the Net Code of Conduct for medical and health Websites. Comput Biol Med. 1998; 28(5):603-610. doi:10.1016
19. Basch CH, Hillyer GC, Meleo-Erwin ZC, Jaime C, Mohlman J, Basch CE. Preventive Behaviors Conveyed on YouTube to Mitigate Transmission of COVID-19: Cross-Sectional Study. JMIR Public Health Surveill. 2020; 6(2):e18807. doi:10.2196/18807.
20. D’Souza RS, D’Souza S, Strand N, Anderson A, Vogt MNP, Olatoye O. YouTube as a source of medical information on the novel coronavirus 2019 disease (COVID-19) pandemic. Glob Public Health. 2020; 15(7):935-942. doi:10.1080/17441692.2020.1761426.
21. Marchal N, Au H, Howard PN. Coronavirus News and Information on YouTube: A Content Analysis of Popular Search Terms. COVID-19 Series COMPROP Data Memo 2020.3. Oxford, UK. 2020.
22. Briones R, Nan X, Madden K, Waks L. When vaccines go viral: an analysis of HPV vaccine coverage on YouTube. Health Commun. 2012;27(5):478-485. doi:10.1080/10410236.2011.610258.
23. Gori D, Durazzi F, Montalti M, et al. Mis-tweeting communication: a Vaccine Hesitancy analysis among twitter users in Italy. Acta Bi-omed. 2021; 92(S6):e2021416. doi:10.23750/abm.v92iS6.12251.
24. Shi CF, So MC, Stelmach S, Earn A, Earn DJD, Dushoff J. From science to politics: COVID-19 information fatigue on YouTube. BMC Public Health. 2022; 22(1):816. doi:10.1186/s12889-022-13151-7.
25. Lahouati M, De Coucy A, Sarlangue J, Cazanave C. Spread of vaccine hesitancy in France: What about YouTube? Vaccine. 2020; 38(36):5779-5782. doi:10.1016/j.vaccine.2020.07.002.
26. Gianfredi V, Balzarini F, Gola M, et al. Leadership in Public Health: Opportunities for Young Generations Within Scientific Associa-tions and the Experience of the “Academy of Young Leaders”. Front. Public Health. 2019;7. doi:10.3389
27. Gentile L, Cuda A, Dallagiacoma G, et al. Opinion, knowledge and attitude of public health residents towards the new mandatory vac-cination law in Italy. J. Public Health. 2021; 29(3):659-669. doi:10.1007/s10389-019-01171-4.
28. Ministry of Health. Legge 31 luglio 2017, n. 119: «Disposizioni urgenti in materia di prevenzione vaccinale, di malattie infettive e di controversie relative alla somministrazione di farmaci.» Gazzetta Ufficiale Serie Generale 182. 2017.
29. Odone A, Dallagiacoma G, Frascella B, Signorelli C, Leask J. Current understandings of the impact of mandatory vaccination laws in Europe. Expert Rev Vaccines. 2021; 20(5):559-575. doi:10.1080/14760584.2021.1912603.
30. Sabbatucci M, Odone A, Signorelli C, et al. Childhood Immunisation Coverage during the COVID-19 Epidemic in Italy. Vaccines (Basel). 2022; 10(1). doi:10.3390/vaccines10010120.
31. Decreto-Legge 1 Aprile 2021, n. 44. Misure urgenti per il contenimento dell’epidemia da COVID-19, in materia di vaccinazioni anti SARS-CoV-2, di giustizia e di concorsi pubblici. (21G00056) (GU Serie Generale n.79 del 01-04-2021). Available (accessed 15 February 2023).

Most read articles by the same author(s)

1 2 3 4 5 6 7 8 9 > >>