Submitted Successfully!
To reward your contribution, here is a gift for you: A free trial for our video production service.
Thank you for your contribution! You can also upload a video entry or images related to this topic.
Version Summary Created by Modification Content Size Created at Operation
1
Anna Durrance-Bagale
 -- 1519 2022-04-21 08:39:55 |
2 format correct
Vivi Li
 Meta information modification 1519 2022-04-21 10:58:36 |

Video Upload Options

Do you have a full video?
Send video materials Upload full video

Confirm

Are you sure to Delete?
Yes No
Cite
If you have any further questions, please contact Encyclopedia Editorial Office.
Durrance-Bagale, A.; , .; Sirison, K. Monitoring and Evaluation of National Vaccination Implementation. Encyclopedia. Available online: https://encyclopedia.pub/entry/22072 (accessed on 25 April 2024).
Durrance-Bagale A,  , Sirison K. Monitoring and Evaluation of National Vaccination Implementation. Encyclopedia. Available at: https://encyclopedia.pub/entry/22072. Accessed April 25, 2024.
Durrance-Bagale, Anna, , Kanchanok Sirison. "Monitoring and Evaluation of National Vaccination Implementation" Encyclopedia, https://encyclopedia.pub/entry/22072 (accessed April 25, 2024).
Durrance-Bagale, A., , ., & Sirison, K. (2022, April 21). Monitoring and Evaluation of National Vaccination Implementation. In Encyclopedia. https://encyclopedia.pub/entry/22072
Durrance-Bagale, Anna, et al. "Monitoring and Evaluation of National Vaccination Implementation." Encyclopedia. Web. 21 April, 2022.
Monitoring and Evaluation of National Vaccination Implementation
Edit
This entry is adapted from the peer-reviewed paper 10.3390/vaccines10040567

An effective Monitoring and Evaluation (M&E) framework helps vaccination programme managers determine progress and effectiveness for agreed indicators against clear benchmarks and targets. Improving national vaccination programme implementation requires collection and analysis of data on relevant vaccination components. Monitoring and evaluation (M&E) or more recent Monitoring, Evaluation, Accountability and Learning (MEAL) frameworks support decision-making by consolidating available information on agreed indicators, benchmarked targets, and methods to collect, analyse, and report necessary data to strengthen vaccination programmes.

vaccination monitoring evaluation indicators global health

1. Introduction

Improving national vaccination programme implementation requires collection and analysis of data on relevant vaccination components. Monitoring and evaluation (M&E) or more recent Monitoring, Evaluation, Accountability and Learning (MEAL) frameworks [1] support decision-making by consolidating available information on agreed indicators, benchmarked targets, and methods to collect, analyse, and report necessary data to strengthen vaccination programmes [2]. M&E frameworks are usually aggregated into pre-, peri-, and post-vaccination phases, and include elements of vaccine procurement, transport, storage, staff training, communication, coverage, adverse effects, and identification of successes and failures [3].
Planning effective M&E for national rollout of new vaccines, such as for COVID-19, can be strengthened by learning from previous vaccination experiences, particularly those targeted beyond routine childhood populations [4]. A virtual expert roundtable, hosted by the Saw Swee Hock School of Public Health in January 2021, identified key M&E framework components to inform COVID-19 vaccination. This included best practice guidelines, particularly by the World Health Organization (WHO) [5], but few lessons or experiences of using M&E frameworks and selecting and appropriately benchmarking indicators within vaccination programme M&E. Practical details of these experiences could help governments and technical partners in planning, implementing, and assessing M&E for new vaccine implementation. Lessons learnt from assessment experiences worldwide could help inform national efforts to improve routine and vaccine-specific data collection and analyses and support vaccination programme strengthening, particularly in resource-constrained settings, which aligns with the Immunization Agenda 2030 goal to make vaccination available to everyone, everywhere [6].

2. Coverage Indicators

Most (32/43; 74%) described elements of target population estimation, equity, and uptake, primarily of routine childhood vaccines. Thirteen (30%) included targeting or population estimation, although most did not describe indicators in depth and how they were used differed by setting and resource availability. For example, Lacapere et al. roughly estimated measles-rubella vaccination coverage by dividing the number of vaccine doses given by the estimated population for each district in Haiti [7], while D’Ancona et al. used an immunisation register to estimate coverage in Italy [8]. Bianco et al. determined the number of foreign workers eligible for vaccination in Italy through screening [9]. Manyazewal et al. used WHO Reaching Every Community (REC) mapping of community locations and characteristics to help estimate coverage targets for five vaccines in Ethiopia [10].
Only three (7%) included indicators to examine equity or disaggregate data. For example, Sarker et al. compared immunisation coverage among children aged 12–59 months in Bangladesh across socioeconomic and demographic factors, finding disparities by parental education and mothers’ access to media [11]. Wattiaux et al. considered equity aspects of vaccination rollout by comparing hepatitis B immunisation incidence between indigenous and non-indigenous Australians [12]. Geoghegan et al. examined whether women received COVID-19 vaccine when pregnant or received routinely recommended vaccines in pregnancy in Ireland [13].
Sixteen sources (37%) discussed uptake indicators. Most focused on general target populations with minimal discussion on vaccine coverage for migrants and refugees and none on the elderly, people with disabilities, or other potentially vulnerable groups. However, Bawa et al. estimated oral polio vaccination coverage among underserved hard-to-reach communities in Nigeria, defining them based on difficulty of terrain, any local or state border, scattered households, nomadic, water-logged/riverine, or conflict-affected and thus requiring outreach services [14]. More generally, Lacapere et al. calculated numbers of municipalities that reported achieving 95% vaccination coverage for measles-rubella vaccine in Haiti [7]. Only two sources (7%) described coverage indicators beyond the second year of life. Muhamad et al. calculated total HPV vaccine doses delivered through school-based outreach to evaluate the effectiveness of free vaccination for schoolgirls in Malaysia [15], while Beard et al. estimated 40–50% coverage of pertussis vaccination among pregnant women in Australia, based on number of births and consent forms returned centrally [16].
Coverage lessons were varied. Aceituno et al. described challenges of collecting high-quality data in resource-constrained settings [17]. Soi et al. noted that using feedback loops to guide policy decision must be pragmatic, as they are often too slow—e.g., Gavi’s HPV demonstration project policy required countries to demonstrate adequate coverage before applying for rollout funding, which could take years [18]. Alam et al. found automation of EPI scheduling can improve coverage and enhance monitoring, particularly in remote areas [19]. Edelstein et al. found that data triangulation and inclusion of routine data, in countries with good national records, can help identify vulnerable groups and monitoring of vaccine coverage [20]. Lanata et al. found lot quality assurance sampling helped identify small areas with poorer vaccination coverage in rural areas of Peru with dispersed populations, thus improving coverage and equity monitoring [21]. Aceituno et al. found staff understanding of cultural-linguistic context improved coverage and vaccination continuity in Bolivia [17].

3. Operational Indicators

Only two (5%) sources mentioned health service capacity indicators. Manyazewal et al. assessed immunisation services availability, regular static immunisation services delivered, adequate outreach sites, catchment area mapped for immunisation, separate and adequate rooms for immunisation services and storing supplies, all planned outreach sessions conducted, health education on immunisation provided, and immunisation services availability in all catchment health posts in Ethiopia [10]. Walker et al. assessed surveillance feedback reports, timely reporting, and number of districts with populations not receiving immunisation services [22].
Three (7%) sources mentioned supply chain and logistics indicators. Walker et al. used cold chain and logistics data from facility inventory logs for routine immunisation to identify gaps in vaccine supplies and equipment, such as the number of facilities with insufficient supply of syringes and diluent, and number of facilities with inventory logs consistent with vaccine supply [22]. Hipgrave et al. reviewed evidence on thermostability of hepatitis B vaccine for pregnant women when stored outside the cold chain in China [23]. Özdemir et al. assessed cold chain storage and gaps for a hepatitis B vaccine in Turkey [24]. Manyazewal et al. assessed adequacy of fridge-tag 2 units for temperature monitoring, refrigerator spare parts, vaccine request and report forms, and inventory documents in Ethiopia [10].
Five (12%) sources mentioned human resource indicators. Hall et al. assessed the number of English health-workers vaccinated against COVID-19 stratified by dose, manufacturer, and day [25]. Cherif et al. assessed numbers of health-workers participating in vaccination activities, e.g., epidemiological surveillance, adverse event monitoring training, and supervisions in Abidjan [26]. Carrico et al. assessed numbers of states mandating health-worker vaccination in the US [27]. Manyazewal et al. assessed numbers of experts assigned for immunisation and numbers of immunisation focal persons to evaluate effectiveness of system-wide continuous quality improvement for national immunisation programme performance [10]. Walker et al. assessed numbers of supervisory visits conducted, documented in writing, surveillance guidelines observed, surveillance discussed at supervisory visits, and if an operational plan was observed [22].
Two (5%) sources included indicators for vaccination costing. Hutubessy et al. calculated the incremental costs to the health system of HPV vaccination for adolescent girls through schools, health facilities, and other outreach strategies in Tanzania [28]. Walker et al. measured the number of districts in Kenya with insufficient financial resources for key surveillance elements for acute flaccid paralysis [22].
Multiple sources discussed operational lessons. D’Ancona et al. used an observational survey to show that decentralised health systems such as in Italy could result in fragmented immunisation registries and information flow across regions [8]. Ward et al. described how data improvement teams, allocated to all districts, enhanced the quality of vaccine administrative data in Uganda by helping identify data inaccuracies and providing on-the-job data collection training [29]. Dang et al. used qualitative research to describe an approach to optimise vaccination information in Vietnam, which included establishing a partnership between the Vietnamese Ministry of Health and mobile network operators [18]. Soi et al. described the importance of physically co-locating evaluators from different disciplinary backgrounds, and suggested that including evaluators in decision-making could enrich outcomes [18].

4. Clinical Indicators

Five (12%) sources described clinical indicators, primarily counting numbers of adverse events following immunisation (AEFI). For example, Aceituno et al. assessed monthly reporting of adverse events and severe adverse events, details of any deaths, reasons for all withdrawals, and infant and maternal death rates below Demographic and Health Survey rates for Bolivia [17]. Loughlin et al. conducted a post-marketing evaluation to assess the number of confirmed cases of intussusception or Kawasaki disease among infants who received Rotavirus vaccine in the US compared with historical cohort data from diphtheria-tetanus-acellular pertussis vaccination [30].
Lessons were relatively limited. Vivekanandan et al. described the positive role of health-workers in assessing vaccine safety indicators in India [31]. Cherif et al. similarly noted that improving AEFI system performance required improved health-worker training, data analysis, and community engagement [26]. Ijsselmuiden et al. suggested that vaccination targeting at-risk populations, such as for Hepatitis B, should ensure concomitant disease surveillance to reduce morbidity and mortality [28]. Similarly, Beard et al. suggested combining AEFI and syndromic surveillance in emergency departments to monitor numbers of pertussis vaccine adverse events and supplementing maternal influenza vaccination AEFI monitoring with mobile phone text messages in Australia [16].

References

  1. WHO. COVID-19 Strategic Preparedness and Response Plan. Monitoring and Evaluation Framework; World Health Organization: Geneva, Switzerland, 2021.
  2. ECDC. Monitoring and Evaluation Framework for COVID-19 Response Activities in the EU/EEA and the UK. 2020. Available online: https://www.ecdc.europa.eu/en/publications-data/covid-19-monitoring-and-evaluation-framework-response-activities (accessed on 22 February 2022).
  3. WHO. The Monitoring and Evaluation/Accountability Framework; World Health Organization: Geneva, Switzerland.
  4. WHO. Assessing and Improving the Accuracy of Target Population Estimates for Immunization Coverage; World Health Organization: Geneva, Switzerland, 2015.
  5. World Health Organisation. Immunization Agenda 2030: A Global Strategy to Leave No One Behind. 2020. Available online: https://www.who.int/teams/immunization-vaccines-and-biologicals/strategies/ia2030 (accessed on 22 February 2022).
  6. IA2030. Immunization Agenda 203: Monitoring and Evaluation Framework 2021; World Health Organization: Geneva, Switzerland, 2021.
  7. Lacapere, F.; Magloire, R.; Danovaro-Holliday, M.C.; Flannery, B.; Chamoulliet, H.; Celestin, E.P. The use of rapid coverage monitoring in the national rubella vaccination campaign, Haiti 2007-2008. J. Infect. Dis. 2011, 204 (Suppl. 2), S698–S705.
  8. D’Ancona, F.; Gianfredi, V.; Riccardo, F.; Iannazzo, S. Immunisation Registries at regional level in Italy and the roadmap for a future Italian National Registry. Ann. Ig. 2018, 30, 77–85.
  9. Bianco, P.; Ieraci, R.; Comito, M.; Anzelmo, V. Controindications and adverse events of immunizations at workplace. Multidiscipunary management in workers for 2005–2010. G. Ital. Di Med. Del Lav. Ed Ergonomia 2012, 34, 631–634. (In Italian)
  10. Manyazewal, T.; Mekonnen, A.; Demelew, T.; Mengestu, S.; Abdu, Y.; Mammo, D.; Abebe, W.; Haffa, B.; Zenebe, D.; Worku, B.; et al. Improving immunization capacity in Ethiopia through continuous quality improvement interventions: A prospective quasi-experimental study. Infect. Dis. Poverty 2018, 7, 119.
  11. Sarker, A.R.; Akram, R.; Ali, N.; Sultana, M. Coverage and factors associated with full immunisation among children aged 12-59 months in Bangladesh: Insights from the nationwide cross-sectional demographic and health survey. BMJ Open 2019, 9, e028020.
  12. Wattiaux, A.L.; Yin, J.K.; Beard, F.; Wesselingh, S.; Cowie, B.; Ward, J.; Macartney, K. Hepatitis B immunization for indigenous adults, Australia. Bull. World Health Organ. 2016, 94, 826–834.
  13. Geoghegan, S.; Stephens, L.C.; Feemster, K.A.; Drew, R.J.; Eogan, M.; Butler, K.M. This choice does not just affect me. Attitudes of pregnant women toward COVID-19 vaccines: A mixed-methods study. Hum. Vaccines Immunother. 2021, 17, 3371–3376.
  14. Bawa, S.; McNab, C.; Nkwogu, L.; Braka, F.; Obinya, E.; Galway, M.; Mirelman, A.J.; Hammanyero, K.I.; Safiyanu, G.; Chukwuji, M.; et al. Using the polio programme to deliver primary health care in Nigeria: Implementation research. Bull. World Health Organ. 2019, 97, 24–32.
  15. Muhamad, N.A.; Buang, S.N.; Jaafar, S.; Jais, R.; Tan, P.S.; Mustapha, N.; Aris, T.; Sulaiman, L.H.; Murad, S. Achieving high uptake of human papillomavirus vaccination in Malaysia through school-based vaccination programme. BMC Public Health 2018, 18, 1402.
  16. Beard, F.H. Pertussis immunisation in pregnancy: A summary of funded Australian state and territory programs. Commun. Dis. Intell. Q Rep. 2015, 39, E329–E336.
  17. Aceituno, A.M.; Stanhope, K.K.; Rebolledo, P.A.; Burke, R.M.; Revollo, R.; Iniguez, V.; Suchdev, P.S.; Leon, J.S. Using a monitoring and evaluation framework to improve study efficiency and quality during a prospective cohort study in infants receiving rotavirus vaccination in El Alto, Bolivia: The Infant Nutrition, Inflammation, and Diarrheal Illness (NIDI) study. BMC Public Health 2017, 17, 911.
  18. Soi, C.; Shearer, J.C.; Budden, A.; Carnahan, E.; Salisbury, N.; Asiimwe, G.; Chilundo, B.; Sarma, H.; Gimbel, S.; Simuyemba, M.; et al. How to evaluate the implementation of complex health programmes in low-income settings: The approach of the Gavi Full Country Evaluations. Health Policy Plan 2020, 35 (Suppl. S2), ii35–ii46.
  19. Alam, A.; Capoor, A.K.; Rao, L.V. Evaluation of adjuvanticity of promising new synthetic MDP analogues. Immunol. Lett. 1991, 27, 53–57.
  20. Edelstein, M.; White, J.; Bukasa, A.; Saliba, V.; Ramsay, M. Triangulation of measles vaccination data in the United Kingdom of Great Britain and Northern Ireland. Bull. World Health Organ. 2019, 97, 754–763.
  21. Lanata, C.F.; Stroh, G.; Black, R.E.; Gonzales, H. An evaluation of Lot Quality Assurance sampling to monitor and improve immunization coverage. Int. J. Epidemiol. 1990, 19, 1086–1090.
  22. Walker, A.T.; Sodha, S.; Warren, W.C.; Sergon, K.; Kiptoon, S.; Ogange, J.; Ahmeda, A.H.; Eshetu, M.; Corkum, M.; Pillai, S.; et al. Forewarning of poliovirus outbreaks in the Horn of Africa: An assessment of acute flaccid paralysis surveillance and routine immunization systems in Kenya. J. Infect. Dis. 2014, 210 (Suppl. S1), S85–S90.
  23. Hipgrave, D.B.; Maynard, J.E.; Biggs, B.A. Improving birth dose coverage of hepatitis B vaccine. Bull. World Health Organ. 2006, 84, 65–71.
  24. Özdemir, H.; Özer, A.Y. Investigating cold-chain system and efficacy of vaccines reaching the end user in Turkey and related regulations. Fabad J. Pharm. Sci. 2010, 35, 93–104.
  25. Hall, V.J.; Foulkes, S.; Saei, A.; Andrews, N.; Oguti, B.; Charlett, A.; Wellington, E.; Stowe, J.; Gillson, N.; Atti, A.; et al. COVID-19 vaccine coverage in health-care workers in England and effectiveness of BNT162b2 mRNA vaccine against infection (SIREN): A prospective, multicentre, cohort study. Lancet 2021, 397, 1725–1735.
  26. Cherif, D.; Ken, N.G.; Coulibaly, D.; Zengbe-Acray, P.; Ekra, K.D.; Traore, A.; Tiembré, I. Evaluation of epidemiological monitoring of post-vaccination adverse reactions in Abidjan. Sante Publique 2018, 30, 411–417. (In French)
  27. Carrico, R.M.; Sorrells, N.; Westhusing, K.; Wiemken, T. Monitoring of health care personnel employee and occupational health immunization program practices in the United States. Am. J. Infect. Control 2014, 42, 66–68.
  28. Ijsselmuiden, C.B.; Küstner, H.G.; Barron, P.M.; Steinberg, W.J. Notification of five of the EPI target diseases in South Africa. An assessment of disease and vaccination reporting. South Afr. Med. J. 1987, 72, 311–316.
  29. Ward, K.; Mugenyi, K.; Benke, A.; Luzze, H.; Kyozira, C.; Immaculate, A.; Tanifum, P.; Kisakye, A.; Bloland, P.; MacNeil, A. Enhancing Workforce Capacity to Improve Vaccination Data Quality, Uganda. Emerg. Infect. Dis. 2017, 23 (Suppl. 1), S85.
  30. Loughlin, J.; Mast, T.C.; Doherty, M.C.; Wang, F.T.; Wong, J.; Seeger, J.D. Postmarketing evaluation of the short-term safety of the pentavalent rotavirus vaccine. Pediatric Infect. Dis. J. 2012, 31, 292–296.
  31. Vivekanandan, K.; Prakash, J.; Singh, G.N. Pharmacovigilance programme of India. Arch. Pharm. Pract. 2012, 3, 229–232.
More
© Text is available under the terms and conditions of the Creative Commons Attribution (CC BY) license; additional terms may apply. By using this site, you agree to the Terms and Conditions and Privacy Policy.
Upload a video for this entry
Information
Subjects: Health Care Sciences & Services
Contributors MDPI registered users' name will be linked to their SciProfiles pages. To register with us, please refer to https://encyclopedia.pub/register :
Anna Durrance-Bagale
,
,
Kanchanok Sirison
View Times: 665
Revisions: 2 times (View History)
Update Date: 22 Apr 2022
Table of Contents
    1000/1000
    Hot Most Recent
    Feedback