Skip to main content
Download PDF
Download ePub

The gas cylinder, the motorcycle and the village health team member: a proof-of-concept study for the use of the Microsystems Quality Improvement Approach to strengthen the routine immunization system in Uganda

Implementation Science volume 10, Article number: 30 (2015) Cite this article

Abstract

Background

Although global efforts to support routine immunization (RI) system strengthening have resulted in higher immunization rates, the World Health Organization (WHO) estimates that the proportion of children receiving recommended DPT3 vaccines has stagnated at 80% for the past 3 years (WHO Fact sheet—Immunization coverage 2014, WHO, 2014). Meeting the WHO goal of 90% national DPT3 coverage may require locally based strategies to support conventional approaches. The Africa Routine Immunization Systems Essentials-System Innovation (ARISE-SI) initiative is a proof-of-concept study to assess the application of the Microsystems Quality Improvement Approach for generating local solutions to strengthen RI systems and reach those unreached by current efforts in Masaka District, Uganda.

Methods

The ARISE-SI intervention had three components: health unit (HU) advance preparations, an action learning collaborative, and coaching of improvement teams. The intervention was informed and assessed using qualitative and quantitative methods. Data collection focused on changes and outcomes of improvement efforts among five HUs and one district-level team during the intervention (June 2011–February 2012) and five follow-up months.

Results

Workshops and team meetings had a 95% attendance rate. All teams gained RI system knowledge and implemented changes to address locally identified problems. Specific changes included: RI register implementation and expanded use, Child Health Card provision and monitoring, staff cross-training, staffing pattern changes, predictable outreach schedules, and health system leader—community leader meetings. Several RI system barriers prevalent across Masaka District (e.g., lack of backup HU gas cylinders, inadequate outreach transportation, and village health team underutilization) were successfully addressed. Three of five HUs significantly increased the vaccines administered. All improvements were sustained 5 months post-intervention. External evaluation validated the findings of high levels of participant engagement, empowerment to make change, and willingness to sustain improvements.

Conclusions

The Microsystems Quality Improvement Approach is a comprehensive approach, grounded in systems thinking, and coupled with intensive coaching. It provides a robust framework for engaging teams in the development of unique local solutions that strengthen RI systems in resource poor settings. The sustained improvements in local RI systems from this study provide evidence that this approach may be an effective framework for enhancing the WHO’s Reaching Every District (RED) immunization strategy.

Peer Review reports

Background

“Immunization averts an estimated two to three million deaths every year from diphtheria, tetanus, pertussis (whooping cough), and measles [1]”. However, one in five children who die before the age of 5 still lose their lives to vaccine-preventable diseases [2]. In 2012, 22.6 million children below 1 year of age were not protected against DPT3 (a proxy measure for full immunization coverage) and more than 70% of these children lived in ten developing countries including Uganda [3].

For the past 30 years, developing countries have worked to increase immunization coverage by building the infrastructure to support vaccination procurement and delivery and have relied on campaigns (child health days, national immunization days) to increase coverage rates more rapidly. While these efforts have resulted in higher and increasing rates of immunization “the proportion of the world’s children who receive recommended vaccines has remained steady for the past three years and has stagnated at about 80% DPT3 coverage” [1]. Uganda, specifically, has accomplished exemplary work focused on enhancing its routine immunization (RI) system function [4]. For example, Uganda has (a) developed district-level strategies for improvement with the World Health Organization (WHO) and partners [5], (b) participated in evaluation studies [6-9], (c) developed a training manual [4] for operational-level staff which incorporates the Reaching Every District (RED) strategy [10,11], (d) launched RED in 2003, and (e) as evidenced by the Uganda National Expanded Program on Immunization (UNEPI) multi-year plan, developed numerous strategies to sustain immunization rates when they are high and improve them when they are low [12]. However, while Uganda’s success in reaching high levels of DPT3 immunization coverage is commendable, improving rapidly from 9% in 1980 to a high of 82% in 2011, like other developing countries, its rates have stagnated around 80% (2009–2012—the past 4 years for which WHO data are available) [13].

The Africa Routine Immunization Systems Essentials-System Innovation (ARISE-SI) was designed as a proof-of-concept study to articulate an approach to systems change that addresses the pressing issue of immunization rate stagnation. This study sought to develop capacity among local community-based RI frontline workers for problem-solving resulting in innovative solutions to strengthen RI systems immediately and in the future. ARISE-SI is based on the assumption that meeting the global WHO goal of 90% national coverage for DPT3 and 80% coverage within every national district [14] requires the development of innovative approaches that take local context into account to link children to immunization services [5,15-18]. Efforts should target children from (a) peri-urban areas that do not fully utilize accessible services; (b) rural and urban populations with access to services, but who drop out of care; (c) remote rural populations with poor access to services; and (d) marginalized groups and sects [17].

Uganda’s commitment to reaching the WHO goal of 90% DPT3 coverage made it a prime site for our research initiative. ARISE-SI was sponsored by the Bill & Melinda Gates Foundation and realized through a partnership between Dartmouth College, JSI Research & Training Institute, Inc. (JSI), Makerere University School of Public Health (MUSPH), and the UNEPI, Ministry of Health (MoH).

Methods

Context: the microsystems quality improvement approach

The Dartmouth Institute for Health Policy and Clinical Practice pioneered the development of improvement science as it applies to health systems [19-34]. This knowledge is encapsulated in the Microsystems Quality Improvement Approach, a comprehensive approach to quality improvement (QI) practice grounded in systems thinking and coupled with intensive coaching. The approach is derived from the concept of microunits [28] and their functioning within complex systems adaptive to environmental changes [24,35-37,19].

The Microsystems Approach promotes the identification of the place in a system called the front line where the essential work actually happens. In ARISE-SI, this is where children get immunized. The approach further underscores the need to identify higher level systems (i.e., in Masaka, the District and UNEPI) that interface with the front line to facilitate work and promote achieving desired outcomes. QI methods, processes, and tools (e.g., flowcharts, data collection and display over time, small tests of change, and reflection) are applied at the appropriate system levels to encourage synergistic work toward common goals. Finally, the approach encourages teams to use data to identify system barriers and apply problem-solving techniques to develop locally appropriate changes. This differs from other approaches that provide a predetermined change package for improvement [38]. The Microsystems Approach has been successfully implemented in hospitals and ambulatory care settings in the US, Canada [39-49], and in developing countries, e.g., Kosovo [50,51]. To our knowledge, ARISE-SI is the first application of the Microsystems Approach focused on RI.

The conceptual model that informed the design and implementation of ARISE-SI is illustrated by the “two triangle” System Strengthening Model (Figure 1). The model is based on the ARISE-SI team’s initial understanding of the RI system and sociocultural structures in Uganda.

Figure 1
figure 1

Microsystems approach systems strengthening model. The conceptual model for the ARISE-SI included a representation of the health system (left triangle) and the sociocultural system (right triangle). Both triangles are segmented, representing smaller aspects of each system as one moves inward in the diagram. In the center, the two triangles overlap. This represents the inextricable link between the HU and the community it serves. Together, these two segments comprise the microsystem for routine immunization.

Full size image

The left triangle represents the Ugandan RI system (hospitals, clinics, outreach services). The smallest, most basic aspect is the health unit (HU). The right triangle represents the civic system; the smallest, most basic aspect is the community. The model demonstrates the importance of the linkages, and the influences of each level of system on other levels, i.e., microsystems, are embedded and function within mesosystems that are, in turn, embedded and function within a macrosystem. Thus, while the ARISE-SI intervention was primarily focused at the microsystem level (i.e., the point where a caregiver, with child, comes together with the HU staff to receive the service of immunization), the intervention concurrently included and incorporated input and context from the mesosystem (district leadership) and the macrosystem (UNEPI). In addition, it illustrates that the “service” of immunization happens within a community-HU dyad (the point where the triangles overlap) that functions within the context of cultural and socioeconomic factors as well as the dynamics of demand (people wanting services) and supply (the service is available).

Context: Uganda’s routine immunization system

Routine immunizations are delivered through Uganda’s hierarchical health system and are not mandated by law or policy. UNEPI (macrosystem level) establishes national policy and procedures, budgets, training programs, and analyzes and disseminates RI data collected by the MoH. National Medical Stores manages all cold chain logistics for UNEPI. Each district (mesosystem level) provides education, training, supervision, and oversight of health units (microsystem level) that provide immunizations to children in clinics and outreach sites and send data back to the district where coverage is monitored.

Study design

ARISE-SI was conducted from January 2011–June 2012. The project was a longitudinal study of QI teams that worked to improve the local RI system. In addition, the teams worked collaboratively with one another to maximize and accelerate their learning about change and improvement. The individual teams and collaborative of teams were supported by coaching. The Committee for Protection of Human Subjects at Dartmouth College in the USA and the Institutional Review Board of Makerere University School of Public Health in Uganda approved this research. All participants completed a consent form indicating understanding of the purpose of the study and willingness to participate.

Setting and site selection

Masaka District was identified by UNEPI and the ARISE-SI team as an appropriate setting in rural and semi-urban Uganda for the study due to its (a) known high rates of immunization coverage, (b) identified leaders, (c) interest in system improvement, and (d) lack of potentially conflicting projects. Five HUs (Bukeeri, Butende, Kiyumba, Kyannamukaka, and Masaka Municipal Council) were enrolled into the study. These HUs represented the full range of governmental service-level designations HU-II to HU-IV (HU-II provides RI services only; HU-IVs are full-service clinical sites with operating theater), and each served populations of unreached children. Butende represented a non-governmental HU. Criteria for selection included that the HU (a) provided at least 250 doses of DPT1 in the previous year (a proxy measure of access to immunization services and of patient volume in the catchment area [4]), (b) was accessible by car from Masaka City, (c) had adequate staffing and management to support RI, (d) had strong relationships with at least one village health team (VHT) member (i.e., community elected volunteer residents designated as HU1 by UNEPI—the point of interface between the health system and community), and (e) assessment through site visits by ARISE-SI faculty.

QI teams

Each HU formed a four- to seven-member core QI team including the Officer-in-Charge (usually a Clinical Officer), the staff person responsible for RI (RI focal person), a staff member trained in Health Management Information Systems (HMIS), and at least one VHT member. At the request of the Masaka District Health Officer, a district QI team including the District Health Inspector, HMIS Officer, Senior Nursing Officer, Health Educator, and Cold Chain Officer participated in the study.

Intervention

The intervention consisted of three main components: advance preparations, an action learning collaborative, and coaching of QI teams.

Advance preparations

The goals of the advance preparations were to (a) introduce ARISE-SI to HU staff and community members and obtain their commitment to the intervention; (b) establish QI teams; (c) increase the QI teams’ knowledge of the supply and demand sides of their RI microsystem; and (d) prepare the teams for the first meeting of the action learning collaborative. A local assessment was completed by each QI team in partnership with community stakeholders. Using local data, the team summarized the HU RI system’s function based on five themes: people, personnel, process, purpose, and patterns [19]. To obtain more information about enablers and barriers, ARISE-SI faculty conducted focus group discussions with community members. (Interview guide is available by request.)

Action learning collaborative

An action learning collaborative was the vehicle for implementing the Microsystems Approach. Members of the collaborative were the five HU teams, the Masaka District team, the UNEPI Training Director, and the ARISE-SI faculty and coach. The collaborative brought the six QI teams together to study their RI system from multiple perspectives and create a higher level “system” awareness of problems that could be improved. Activities of the collaborative included teaching the principles and practice of systems thinking and QI, providing technical support and training specific to RI, fostering shared learning and communication within, between, and across team functional roles and systems, and training the coach to mentor the teams through a QI project [52-58]. The collaborative ran for the entire 9-month study intervention period.

The specific activities of the collaborative were workshops, on-site HU visits, and local QI team meetings between workshops (action periods) (Figure 2). QI teams came together to attend four 2- or 3-day workshops in Masaka City (June, Sept, Dec 2011, and Feb 2012). Themes for the workshops in sequential order were problem identification and improvement plan development, improvement plan implementation, reflection on the improvement process, and transition to local ownership. During each workshop, Dartmouth and MUSPH faculty, the coach, and the UNEPI Director of Training adapted and taught the Dartmouth Microsystems Curriculum [19] and provided technical assistance and training on RI and cold chain maintenance [5,59,10,4,11]. The UNEPI Director of Training and the District Health Inspector addressed technical issues raised by the QI teams and traveled with the faculty and coach to HUs, mentoring teams during educational site visits held before or after each workshop. Interactive and participatory teaching methods engaged participants with each other, the curriculum, and with the issues they were working to improve.

Figure 2
figure 2

ARISE-SI intervention timeline. The ARISE-SI Project began with advance preparation to establish Ugandan project partners in January 2011. Advance preparations continued with initial HU assessments and formation of HU QI teams in June 2011. The District QI team was formed in June 2011 at Workshop 1 of the action learning collaborative. The collaborative included sequential action periods, HU site visits, and workshops which continued through February 2012. Coaching provided support to QI teams between collaborative workshops.

Full size image

Workshops and HU site visits guided QI team planning, implementation, and measurement. Teams were challenged to develop system-strengthening solutions using existing staff and local budgets. Each team identified a unique aim and designed their improvement project based on data generated from their baseline assessment, immunization data, and understanding of local context and culture. Implementation and evaluation of improvements were accomplished through plan-do-study-act (PDSA) cycles of improvement [60]. Teams were taught to use run charts to monitor the changes in numbers of immunizations provided at HUs and outreach sites. Reliable denominator data were not available for geographic areas smaller than Masaka District, thus rates of coverage were not considered for benchmarking. At each workshop, QI teams presented their work to each other in a facilitated forum. Team members were encouraged to take on the roles of learners and teachers; thus, questions that arose were addressed by other participants, the District, UNEPI, or ARISE-SI faculty. Grant resources funded the time and travel of the faculty and coach, reimbursed participants for workshop time, lodging, and travel, and funded participants’ per diem expenses at HU educations sessions.

Coaching

The coach provided technical support, project management, and mentoring of QI teams. He was mentored by a US-based ARISE-SI faculty member through bi-weekly phone/SKYPE calls and quarterly in-person support in Uganda. The MUSPH faculty, UNEPI, and coach attended a “coach the coach” workshop at Dartmouth to learn the principles and methods of QI and coaching. Support for the coach’s time (one full-time salary) as well as his travel to the HUs and the collaborative workshops was provided through ARISE-SI funding.

Data sources

Quantitative and qualitative data were collected during each aspect of the learning collaborative (workshops, site visits, and action periods). Data from these multiple sources supported on-going evaluation of the intervention’s fidelity, improvement processes, and outcomes. These data also helped the researchers identify and assess contextual factors of each level of the RI system at each site over time [61-65]. The major data collection activities during ARISE-SI are described in Table 1. These included (a) assessment of immunization doses administered to children, (b) initial assessment by each HU of it RI system functioning, (c) data presented by QI teams as well as workshop evaluations, (d) field notes and observations by the coach during QI team meetings, and (e) an external evaluation of the project completed by researchers not affiliated with the study.

Table 1 Detailed description of data collection including purpose, sources and methods, and measures for each ARISE-SI activity
Full size table

Data analysis

Triangulation of data assured an in-depth assessment of the intervention [66]. Data were analyzed using a mixed-methods approach. Initially, qualitative and quantitative data were analyzed separately then examined together. Research findings were validated by external evaluation.

Quantitative data related to attendance and evaluation of workshops, improvement team meetings, and associated immunization data were summarized. Qualitative data were analyzed using an iterative coding and data reduction process [66,67] in which a preliminary coding scheme was developed based on grounded theory technique [68] and then analyzed using NVIVO 9, applying a process of continual comparison of findings over time. Emerging themes about learning and application of QI skills by the improvement teams, as well as before and after action reviews [69,70] and workshop evaluations were used by ARISE-SI faculty to refine the intervention (workshop content, teaching methods, coaching approach) as it was implemented. Counts of doses of DPT1 and DPT3 vaccines administered at each HU clinic and outreach sites were aggregated monthly. DPT1 and DPT3 counts were used as proxies for access and coverage, respectively [71,4,5]. A two-tailed, unpaired t-test was used to compare the average monthly immunization doses administered at baseline (June 2010 to May 2011) with the intervention and follow-up periods (June 2011 through May 2012). In addition, independent Ugandan researchers conducted an external evaluation of the intervention (February 2012) using a mixed-methods triangulation design [72]. The evaluators conducted five focus groups and administered a comprehensive written questionnaire to participants prior to the final workshop session in the absence of project faculty.

Results

Intervention fidelity

All components of ARISE-SI were implemented successfully during the planned timeline. The four workshops that formed the educational basis of the action learning collaborative were successfully completed (June 2011–February 2012). Participant evaluations indicated that workshop objectives were met. External evaluation demonstrated that participants rated the quality of the teaching, coaching, and overall project highly. For example, respondents indicated that the teaching methods and activities helped them learn about QI, meeting skills, coaching, and setting team-specific aims. Mean ratings on these teaching activities ranged from 4.2 ± 0.67 to 4.6 ± 0.5 on a 5-point scale with “5” being the highest rating. (Full details are provided in the project report available online [73].)

Participation

The four workshops and associated education sessions were well attended. HU and district QI team members participated in virtually every workshop (95% attendance). During action periods, the coach met monthly with each QI team helping them complete assignments from the previous workshop. In all, he held eight meetings at each HU. Meeting participation combined across HUs was excellent: the five HU QI team members remained stable (23–28 persons, median = 27, SD = 1.62); numbers of other HU staff attending ranged from 22–39 persons; and participation among community members increased from 14 persons in June 2011 to 44 in December 2011 (median = 34.5, SD = 11.07) (Figure 3).

Figure 3
figure 3

Numbers of participants attending monthly HU coaching meetings. The coach held monthly meetings at each of the HUs beginning in June 2011 and continuing through January 2012. Participants for all HU meetings combined are shown for QI team members (blue diamonds), HU staff (red squares), and VHT/community members (tan triangles).

Full size image

Local solutions to long-term problems

QI teams developed unique, HU-specific project aims, designed changes and associated process measures, implemented two PDSA cycles of change, and evaluated outcomes. As illustrative examples of the successes achieved by teams, we highlight three major barriers to RI system function that were addressed during the study and were recognized by UNEPI as prevalent across Masaka District: (a) lack of a backup supply of gas cylinders at HUs, (b) inadequate transport from HUs to outreach sites, and (c) underutilization of VHTs [12]. The local solutions to these long-term problems are summarized in the case studies below.

The story of the gas cylinder

Gas cylinders are used in most Masaka District HUs to power refrigerators to keep vaccines at the right temperature to maintain potency. The District Health Inspector summarized the implications of not having a backup cylinder in a short brief to USAID: “For at least the past ten years there has been only one gas cylinder in the HUs in Masaka instead of two. This shortage affects the cold chain. For example, during the time it takes to refill the one existing cylinder (up to one month), vaccines may be improperly stored with potency compromised, may be wasted, or routine services may be interrupted; all resulting in lower immunization coverage [74]”.

To address this problem, the district QI team developed the specific aim to obtain a second gas cylinder for every HU in Masaka District (their inventory revealed that 22 of the 33 units had gas powered refrigerators). The team used QI tools to identify points of leverage for action. Their improvement plan proposed a reallocation of funds from the District Primary Health Care budget to procure additional gas cylinders, provided data affirming that a reallocation of funds would not affect other primary care services, and included a detailed proposal for tracking and monitoring the flow of gas cylinders through a more rigorous inventory tracking and control process which included financial responsibility for the HU if a cylinder was lost or stolen. The District Health Officer approved and helped negotiate the plan with the District Health Committee. As a result of this improvement initiative, the District Health Office procured 22 gas cylinders in December 2012, supplied each HU using gas with a backup cylinder, and integrated inventory control into their quarterly support supervision process. As of May 2014, no gas cylinders have gone missing and the inventory control process is intact and functioning (verbal communication with the ARISE-SI coach).

The story of the motorcycle

Bukeeri (HU-III) provides RI at the HU and at four outreach sites for the 10,000 people in its service area. Many roads in Bukeeri are gravel, some are dirt. UNEPI provides each HU-III a motorcycle for transporting immunizations to outreach sites. Four months prior to ARISE-SI, the Bukeeri motorcycle broke down. Since there was no money to repair the motorcycle, Bukeeri closed its outreaches. Thus, vaccines were unavailable to those who were not able to get to the HU.

During the first ARISE-SI workshop, the Bukeeri team learned from their colleagues that two other HUs had motorcycles that were out-of-service. However, these HUs had kept their outreaches open by reallocating funds from the “fuel” for the motorcycle line item in their Primary Health Care Funds to hire a motorcycle driver to transport staff and immunizations to outreaches. Building on this new knowledge, the Bukeeri team developed an improvement plan to implement a similar solution. In addition, based on information from their own baseline assessment, Bukeeri’s plan included a communication strategy to negotiate dates and times of outreaches with VHTs and villagers. As a result, the four outreaches were reopened in Bukeeri’s service area (July 2011) and were well attended. As of May 2014, the four outreaches remain open (verbal communication with ARISE-SI coach).

The story of the VHTs

The in-charge and staff at Kyannamukaka (HU-IV) have many duties including providing primary care, maternal child health services, deliveries, inpatient care, and RI. VHTs, although trained to coach families on RI, were not well integrated within the RI system function. Thus, the Kyannamukaka QI team focused their improvement plan on capacity building of VHTs. Planned changes included: (a) training VHTs to read Child Health Cards, (b) supporting VHTs in visiting 25 homesteads and checking each child’s immunization record and status, (c) having VHTs include phone contacts of caregivers into the HU registry to facilitate follow-up of children, (d) developing a duplicate HU registry so these data could be taken to the field for VHT use, (e) and including VHTs at regular meetings.

Sixty VHTs were trained to read Child Health Cards. The QI team held meetings with these newly trained VHTs and developed plans for home visits. The VHTs provided the HU with lists of the names of homesteads visited during September–January with children under 1 year of age. Through this process, they identified three children who had not had measle vaccinations and referred them to the HU. In addition, families in two villages who had not previously had their children immunized are using these services and receiving vaccines.

Changes and associated improvements in RI system function

Enablers and barriers identified and addressed through QI team projects

Thirty enablers and barriers to RI were identified by HU staff and community members at baseline. These factors are commonly described as being important to RI system strengthening [12]. Twenty-one of these factors were addressed through the QI teams’ projects, enhancing enablers and reducing barriers. (*Addressed through QI team projects)

Enablers

Immunizations provided at no cost*

Accessible services*

Approachable, competent staff*

Supplies in stock (vaccines, Child Health Cards, gas cylinders)*

Reliable schedules*

Community involvement*

Leadership*

Monthly meetings to discuss unreached*

Integrated outreach*

Active staff (RI focal person)*

Effective and timely reporting*

Public messaging, mobilizing campaigns

Schools require immunization for enrollment

Mothers of child-bearing age are immunized

Barriers

Inconsistent follow up*

Outreach unavailable*

Lack of awareness about RI*

Lack of resources (stockouts)*

Long wait lines*

Insensitive staff attitudes*

Cultural beliefs*

Transportation*

Unaware of schedules*

Mothers miss clinic*

Transient population

Staff absent

VHT too busy

No allowance for VHT

History of sickness or death from immunization

Family issues

Changes initiated by QI teams and associated improvements in RI system function

QI teams initiated changes focused on improving the internal processes associated with RI service delivery as well as improving communication, relationships, and education associated with RI. All HUs worked to engage or strengthen VHT involvement in their QI team’s efforts to improve internal system delivery as well as external engagement with community leaders and families. As illustrated in Table 2, process changes resulted in improvements to specific aspects of RI system function (e.g., increased numbers of VHTs making home visits to monitor Child Health Cards and encourage families to go to HU or outreach sites for RI, increased numbers of VHTs trained to work with families and clinic staff to engage families and community to obtain RI for their children, decreased wait time at HU for RI services, and increased number of meetings between the HU In-Charge and community leadership to promote RI services). In three of five HUs, process changes were associated with significant increases in DPT doses administered by the HU during the intervention and follow-up period. Specifically, there were eight significant increases in the number of DPT doses provided to children during intervention and follow-up. Four of the increases (both DPT3 and DPT1 at the HU and at outreach sites) occurred in Bukeeri HU where closed outreach sites were opened and VHTs were mobilized to engage families and caregivers to immunize their children.

Table 2 Description of changes initiated by QI teams and associated outcomes including data on number of DPT doses administered
Full size table

Discussion

This study demonstrates that the Microsystems Quality Improvement Approach provides a robust framework for developing local solutions and improvements to strengthen local RI systems in resource poor settings. Incorporating systems thinking, principles and practice of QI, and coaching inspires system-wide learning and opportunities to build capacity and ownership of system processes and outcomes among front-line workers. In the 9-month study period, participants gained a working knowledge of the local RI systems in Masaka District. Participants leveraged, implemented, and monitored changes, and in some cases, sustained improvements (e.g., higher than average DPT doses for at least 5 months after the intervention period). In addition, back-up gas cylinders remain in place in all Masaka HUs, Bukeeri’s outreaches remain open, and VHTs are still more engaged in RI than they had been 2 years after the intervention period (per communication from Ugandan coach).

Previous approaches to RI system strengthening have focused on targeted aspects of a system such as: increasing the supply of immunizations and improving management practices [11,75-79], changing practices at specific sites [76,79,11,80], bringing immunizations closer to communities [81-83], increasing demand for immunizations by using information dissemination [84,82,85-88], or providing incentives to caregivers [89,87]. The Microsystems Approach focuses on building system capacity for on-going assessment, problem-solving, and evaluation. The approach accomplishes this by (a) promoting systems thinking and active problem-solving within and across multiple levels of a system, (b) developing multidisciplinary QI teams, using tools and training that foster team ownership of a system and its outcomes, (c) providing a non-prescriptive educational curriculum focused on QI principles and systems thinking that incorporates knowledge of locally identified barriers and enablers, and (d) in the case of ARISE-SI, expecting that teams could design, implement, test, and refine solutions using existing staff and within current budgetary constraints. ARISE-SI likely achieved its effects through these unique factors that provided a platform for local problem-solving.

The action learning collaborative intentionally brought key leaders from three distinct levels of the RI system together to develop a shared understanding of system complexity and to promote innovation in problem-solving based on shared knowledge. The educational tools and action-learning process of the workshops, as well as the development of multi-disciplinary teams, were designed to break down the existing hierarchical and siloed approach to communication, learning, and decision-making. For example, at Kiyumba (HU-IV), one person was designated as the focal person for RI. If this person was late/absent from work, his/her role was not typically filled by other staff members, resulting in missed opportunities for immunization. To address this issue, the Kiyumba QI team cross-trained HU staff on immunization practices, giving the clinic the ability to accomplish RI at almost any patient encounter. The coach’s role was critical for enhancing communication within and across levels of systems as he met with all study participants monthly and was the one “constant” of the intervention and in all communications. Figure 4 illustrates the within, across, and up and down communication, learning, and decision-making that was promoted during the intervention.

Figure 4
figure 4

Interactions among different levels of systems associated with ARISE-SI. The ARISE-SI project engaged three levels of the RI system—HUs (microsystem), Masaka District (mesosystem), and UNEPI (macrosystem). The project brought representatives from each system level together for all project activities. The coach facilitated communication and interactions both within and across the three system levels.

Full size image

The QI teams’ projects were based on assessment of baseline data. The workshops provided a safe space for HU members to ask questions directly of district and UNEPI leaders. This resulted in “just-in-time” clarification of issues related to RI policies and practices that promoted local problem-solving. For example, the District Health Office’s approval of the reallocation of the “gas” line item in their budget gave permission to Bukeeri (HU-III) to implement this as a change strategy. Additionally, the development of QI knowledge and skills may have promoted participants’ self-efficacy and improved team member status within their HU and community. Team members benefited from learning new skills that they could apply to other problems. For example, the District Health Inspector applied this approach with his sanitation team before the ARISE-SI workshops were completed.

Furthermore, the Microsystems educational curriculum and approach [90] may have accelerated the participants’ abilities to brainstorm freely about problems and solutions and learn how issues were being addressed at other HUs. For example, the teams’ presentations of their baseline data highlighted that the lack of a second gas cylinder affected their ability to provide quality RI services. The district team’s prioritization of this issue in their improvement project validated the workshop discussions. Likewise, the Bukeeri (HU-III) team learned how to use their own budget to get important needs met and also learned that other HU teams and district leaders are important resources for information, guidance, and problem-solving.

UNEPI identifies the VHT as the first level of contact for RI and as essential to system function [91]. During the baseline assessment, information emerged that VHTs were disconnected from HUs and unclear about their RI role and function. In an effort to maximize this resource, the intervention encouraged participation by VHTs on QI teams. Several teams enhanced the training of VHTs, and all HU teams included VHTs in their QI plans. These efforts may have created more demand for RI services from families. Participation in the project may have harnessed the VHTs’ desire to provide excellent care to those that they served, thereby contributing to their increasing participation at HU QI meetings. On the other hand, it is also possible that the growing participation of VHTs was in part associated with the per diem paid for every meeting VHTs attended, as such payments are of great importance in developing countries.

All teams demonstrated success in applying QI methods through implementation of cycles of change to make system improvements. Analyses of RI data were required to assess progress toward each HUs improvement aim. As HUs learned more about their own RI system, it became increasingly important to them to understand RI data stratified by where immunizations were provided—at the HU itself or at outreach sites. RI data were discussed concurrently with process and intermediate outcome data collected throughout improvement efforts. HUs reported that using their own data in this transparent way (displaying data over time on graphs, stratifying RI data based on service delivery sites, and sharing data with other HUs and the DHT) helped promote engagement and sustain the improvement work.

Improvements implemented during ARISE-SI were locally derived and innovative within the context in which they occurred. The heterogeneity in improvement in the number of DPT1 and DPT3 immunizations administered during the initiative should be considered in the context of the changes chosen and implemented by each HU. For example, Bukeeri (HU-III) opened outreach units that had been closed for several months and evidenced rapid, significant improvement in doses of immunizations administered in outreach units. Kiyumba (HU-IV), on the other hand, focused on reducing waiting times for mothers at the HU. Thus, while Kiyumba successfully met its goal, it experienced no significant changes in doses of DPT provided.

One could argue that the improvements to the RI system implemented during ARISE-SI were not innovative. However, for purposes of this study, innovation was defined as creative, local problem-solving [92]. To this end, the six QI teams designed innovative solutions that when implemented, immediately began to strengthen local RI systems and function. Some of the changes made by the QI teams might have occurred without ARISE-SI. However, the timing of all improvements (e.g., opening of outreach clinics, ensuring HUs have two gas cylinders, increasing training and mobilization of VHTs, reducing wait times at HUs, enhancing use of immunization cards) followed the initiation of the intervention, as did the upward trend in numbers of vaccines administered. Furthermore, problems such as closed outreach clinics and shortage of gas cylinders had existed for months/years prior to ARISE-SI. Thus, it seems highly likely that these improvements were at least in part related to the intervention.

The small ARISE-SI sample size limited the ability to utilize immunization data for analyses of rates. However, the problem of calculating coverage rates exists for any intervention in a small area of analysis. The use of proxy measures (counts of DPT1 and DPT3 doses administered to access trends of change) provided some assurance that the changes to the system resulted in improved outcomes. In addition, while the absolute number of QI teams was small, they were selected to represent every level/type of HU in Masaka District. The engagement of a district-level QI team provided the possibility of effecting change that could reach beyond the five HUs [90]. It remains possible that part of the intervention’s success was related to more attention than usual focused on RI and that this induced team members to feel more accountable to the work. Additional research would be required to disentangle this question.

Although initial external support to develop, train, and maintain the QI teams was resource intensive, this support was necessary since Microsystems Approach expertise did not exist in Uganda before the intervention. It is feasible that the key elements of this intervention could be adapted by UNEPI and MUSPH and be embedded within the Ugandan health care system training and management infrastructure so that these elements could be implemented on a larger scale going forward. For example, a rigorous QI process and application of systems thinking could be built into the proposed infrastructure of RED. In 2002, the WHO and its partners developed and began implementation of RED [93,10,11] with the aim of strengthening RI services by focusing on the district level for immunization service delivery [5,16]. RED has five core components: (a) planning and management of resources, (b) reaching target populations, (c) linking services with communities, (d) supportive supervision, and (e) monitoring for action specifically within the context of a microplanning process [16].

Recent studies in Uganda (e.g., The EPI Review 2010 and Effective Vaccine Management Assessment (EVMA) 2011) showed operational inadequacies of the immunization system related to the supportive supervision and advocacy and communication aspects of RED [12]. The initial assessment of each HU in ARISE-SI corroborated these findings as well as other challenges in Masaka District’s RI system. Specifically, HU staff noted difficulty in identifying and prioritizing barriers to their RI system as they had no approach for doing this. Similarly, staff lacked an approach for developing and implementing microplans. While the staff knew the population they served well, they were not reaching out to the community for input on their immunization processes. VHTs were available and willing to help HUs but neither the HU nor the VHTs fully recognized how to maximize the VHT role in the RI system. Finally, HU staff noted having very little on-site training or opportunity to clarify issues or questions related to RI.

While RED provides for and mandates supportive supervision as well as its other components, it does not provide robust tools and training to operationalize these components. As noted in Table 3, the design of ARISE-SI incorporated a focus on both the supply and demand for immunizations as well as several of the components of RED and may provide an approach and tools to operationalize this national strategy. Specifically, ARISE-SI supported the development of HU teams that were focused on improving the RI system (these teams did not exist before ARISE-SI). ARISE-SI funded monthly in-person or phone meetings between the coach and each HU improvement team. The District Health Inspector joined the coach during all in-person HU visits. This partnership enhanced the supportive supervision component of RED in two major ways. First, funds were made available through ARISE-SI to pay staff (specifically the VHTs) the usual per diem rate for travel and food so that they could attend the HU team meetings. Most importantly, these frequent meetings created an opportunity for the ARISE-SI coach to train the District Health Inspector in the Microsystems Approach and for the District Health Inspector to train the HU teams on technical aspects of RI.

Table 3 Reaching Every District (RED) components with associated description mapped to ARISE-SI advance preparation findings and activities
Full size table

ARISE-SI made a concerted effort to address the advocacy and communication aspect of RED. VHTs were included as functioning members of the new RI improvement teams. The VHTs and health unit staff worked together to design outreach strategies that enhanced communication between the VHTs, villagers, and HU staff. In addition, the District Health Inspector met directly with VHTs to describe and emphasize their key role in the RI system. The VHT numbers at the HU meetings grew during ARISE-SI which might suggest that the VHTs were more engaged with and had a better understanding of the powerful role they could play in enhancing immunization rates in their own communities.

Finally, ARISE-SI included funds to bring the five HU teams together and provided hands-on technical assistance on work flow, cold chain maintenance, and VHT training by RI technical experts (the UNEPI Director of Training and District Health Inspector), the trained coach, and QI experts from the ARISE-SI team. The coach worked to coordinate the HU team meetings within the supportive supervision infrastructure that already existed in Masaka District. To enhance sustainability of this approach, coaching expertise could be provided by district-level staff (e.g., the District Health Inspector) and QI-focused coaching could be embedded within usual district supportive supervision. Thus, implementing the Microsystems Approach concurrently with RED by engaging national (UNEPI), district, HU, and community participation may be an effective strategy for linking knowledge to practice to actualize technical RI information and for leveraging systems improvements across HU and district service areas. That said, it must be noted that ARISE-SI did not study the effects on RI system strengthening that might be achieved if similar funds as those used for this study were employed solely in support of RED supportive supervision, or for other types of supportive supervision within Masaka District. This remains an open question for future research.

In summary, this intervention fostered the development of sustainable local solutions by multidisciplinary teams across system levels. The ARISE-SI study findings prompted interest from UNEPI in embedding QI and systems thinking policy and practice into existing training and management systems. UNEPI also recognized that beyond RI, the Microsystems Approach has been proven to be applicable to a range of health issues [39-49]. Thus, building a work force capable of applying systems thinking and QI tools could enhance the broader Ugandan work of health system strengthening.

Conclusions

This proof-of-concept study illustrates how a structured change process such as the Microsystems Approach can successfully spearhead and support system strengthening through development of local solutions to address entrenched problems within a RI system in Uganda. This approach may provide an effective framework for actualizing the WHO Reaching Every District core components. Research to apply this approach within the training, meeting, and supervisory infrastructure that already exists within the Ugandan RI system is needed to assess costs and benefits of adapting such an approach on a larger scale. The Microsystems Approach uses universal principles of QI and systems thinking that can readily be applied to other public health issues and is thus a good framework for implementing integrated primary care services.

Abbreviations

RI:

routine immunization

WHO:

World Health Organization

HU:

health unit

DPT3:

third dose of diphtheria, tetanus, pertussis vaccine

DPT1:

First dose of diphtheria, tetanus, pertussis vaccine

ARISE-SI:

Africa routine immunization systems essentials – system innovation research study

JSI:

JSI Research & Training Institute, Inc.

MUSPH:

Makerere University School of Public Health

UNEPI:

Uganda National Expanded Program on Immunization

MoH:

Ministry of health

RED:

WHO reaching every district strategy

QI:

quality improvement

VHT:

village health team member

HMIS:

Health Management Information Systems

PDSA:

plan-do-study-act

NVIVO:

qualitative data analysis software

USAID:

United States Agency for International Development

References

  1. WHO. WHO Fact sheet—Immunization coverage 2014. WHO. 2014. http://www.who.int/mediacentre/factsheets/fs378/en/. Accessed May 14 2014.

  2. GAVI Alliance. GAVI facts and figures. http://www.gavialliance.org/advocacy-statistics/. Accessed May 14 2014.

  3. WHO, UNICEF. Global immunization data. 2014. http://www.who.int/immunization/monitoring_surveillance/Global_Immunization_Data.pdf?ua=1. Accessed May 14 2014.

  4. Government of Uganda. Immunisation practice in Uganda: a manual for operational level health workers. Kampala, Uganda: Ministry of Health, Uganda National Expanded Programme on Immunisation (UNEPI). 2007.

  5. WHO. AFRO-RED Guide—implementing the Reaching Every District approach: a guide for District Health Management Teams. Geneva, Switzerland: WHO Africa Regional Office in collaboration with UNICEF and USAID’s IMMUNIZATIONbasics Project. 2008.

  6. Network for education support in immunisation. Annual report. Antwerp, Belgium: University of Antwerp: Department of Epidemiology and Social Medicine; 2004.

  7. Nuwaha F, Kabwongyera E, Mulindwa G, Barenzi E. National immunisation days for polio eradication in Uganda: did immunisation cards increase coverage? East Afr Med J. 2000;77(2):66–70.

    CAS  PubMed  Google Scholar 

  8. Nuwaha F, Mulindwa G, Kabwongyera E, Barenzi J. Causes of low attendance at national immunization days for polio eradication in Bushenyi district, Uganda. Trop Med Int Health. 2000;5(5):364–9.

    Article  CAS  PubMed  Google Scholar 

  9. UNICEF. Combatting antivaccination rumors: lessons learned from case studies in East Africa. Nairobi, Kenya: UNICEF; 2012. http://www.path.org/vaccineresources/files/Combatting_Antivac_Rumors_UNICEF.pdf.

  10. Banerjee K, Beyai PL, Brunkard J, Kelani R, Sequeira J, Watkins M, et al. Comprehensive evaluation of the RED Strategy: Uganda. 2007.

    Google Scholar 

  11. Ryman T, Macauley R, Nshimirimana D, Taylor P, Shimp L, Wilkins K. Reaching Every District (RED) approach to strengthen routine immunization services: evaluation in the African region, 2005. J Public Health. 2010;32(1):18–25. Doi: 10.1093/pubmed/fdp048.

    Article  CAS  Google Scholar 

  12. WHO, UNICEF. UGANDA National Expanded Programme on Immunization: multi-year plan 2012–2016 WHO and UNICEF. 2012. http://www.nationalplanningcycles.org/sites/default/files/country_docs/Uganda/uganda_epi_cmyp_2012-2016_update_2013.pdf. Accessed April 5 2014.

  13. WHO. WHO vaccine-preventable diseases: monitoring system. 2013 global summary. http://apps.who.int/immunization_monitoring/globalsummary/countries?countrycriteria[country][]=UGA. Accessed May 14 2014.

  14. WHO. Global vaccine action plan. 2013. http://apps.who.int/gb/ebwha/pdf_files/WHA66/A66_19-en.pdf?ua=1.

  15. Favin M, Steinglass R, Fields R, Banerjee K, Sawhney M. Why children are not vaccinated: a review of the grey literature. Int Health. 2012;4(4):229–38. doi:10.1016/j.inhe.2012.07.004.

    Article  PubMed  Google Scholar 

  16. WHO, UNICEF. Microplanning for immunization service delivery using the Reaching Every District (RED) strategy. Geneva, Switzerland/New York, NY. 2009. http://www.who.int/immunization/sage/9_Final_RED_280909.pdf. Accessed May 8 2013.

  17. WHO. Sustainable Outreach Services (SOS): a strategy for reaching the unreached with immunization and other services. Geneva, Switzerland: World Health Organization, Expanded Programme on Immunization Team of the Department of Vaccines and Biologicals; 2000. Contract No.: WHO/V&B/00.37.

  18. Rainey JJ, Watkins M, Ryman TK, Sandhu P, Bo A, Banerjee K. Reasons related to non-vaccination and under-vaccination of children in low and middle income countries: findings from a systematic review of the published literature, 1999–2009. Vaccine. 2011;29(46):8215–21.

    Article  PubMed  Google Scholar 

  19. Nelson EC, Batalden PB, Godfrey MM. Quality by design: a clinical microsystems approach. San Francisco: Jossey-Bass; 2007.

    Google Scholar 

  20. Batalden PB, Nelson EC, Edwards WH, Godfrey MM, Mohr JJ. Microsystems in health care, part 9: developing small clinical units to attain peak performance. Jt Comm J Qual Patient Saf. 2003;29(11):575–85.

    Google Scholar 

  21. Godfrey MM, Melin CN, Muething SE, Batalden PB, Nelson EC. Clinical microsystems, part 3. Transformation of two hospitals using microsystem, mesosystem, and macrosystem strategies. Jt Comm J Qual Patient Saf. 2008;34(10):591–603.

    PubMed  Google Scholar 

  22. Godfrey MM, Nelson EC, Wasson JH, Mohr JJ, Batalden PB. Microsystems in health care, part 3. Planning patient-centered services. Jt Comm J Qual Patient Saf. 2003;29(4):159–70.

    Google Scholar 

  23. Mohr JJ, Barach P, Cravero JP, Blike G, Godfrey MM, Batalden PB, et al. Microsystems in health care, part 6: designing patient safety into the microsystem. Jt Comm J Qual Patient Saf. 2003;29(8):401–8.

    Google Scholar 

  24. Mohr JJ, Batalden PB. Improving safety on the front lines: the role of clinical microsystems. Qual Saf Health Care. 2002;11(1):45.

    Article  CAS  PubMed  Google Scholar 

  25. Wasson JH, Anders SG, Moore LG, Ho L, Nelson EC, Godfrey MM, et al. Clinical microsystems: part 2. Learning from micro practices about providing patients the care they want and need. Jt Comm J Qual Patient Saf. 2008;34(8):445–52.

    PubMed  Google Scholar 

  26. Nelson EC, Batalden PB, Huber TP, Mohr JJ, Godfrey MM, Headrick LA, et al. Microsystems in health care: part 1. Learning from high-performing front-line clinical units. Jt Comm J Qual Improv. 2002;28:472–93.

    PubMed  Google Scholar 

  27. Nelson EC, Batalden PB, Homa K, Godfrey MM, Campbell C, Headrick LA, et al. Microsystems in health care: part 2. Creating a rich information environment. Jt Comm J Qual Saf. 2003;29:5–15.

    PubMed  Google Scholar 

  28. Nelson EC, Batalden PB, Mohr JJ, Plume SK. Building a quality future. Front Health Serv Manage. 1998;15(1):3–32.

    CAS  PubMed  Google Scholar 

  29. McKinley KE, Berry SA, Laam LA, Doll MC, Brin KP, Bothe AJ, et al. Clinical microsystems, part 4. Building innovative population-specific mesosystems. Jt Comm J Qual Patient Saf. 2008;34(11):655–63.

    PubMed  Google Scholar 

  30. Huber TP, Godfrey MM, Nelson EC, Mohr JJ, Campbell C, Batalden PB. Microsystems in health care: part 8. Developing people and improving work life: What front-line staff told us. Jt Comm J Qual Saf. 2003;29:512–22.

    PubMed  Google Scholar 

  31. Batalden PB, Splaine M. What will it take to lead the continual improvement and innovation of health care in the 21st Century? Qual Manag Health Care. 2002;11:45–54.

    Article  PubMed  Google Scholar 

  32. Batalden PB, Nelson EC, Mohr JJ, Godfrey MM, Huber TP, Kisnick L, et al. Microsystems in health care: part 5. How leaders are leading. Jt Comm J Qual Saf. 2003;29:297–308.

    PubMed  Google Scholar 

  33. Batalden PB, Nelson EC, Gardent PB, Godfrey MM. Leading the macrosystem and mesosystem for microsystem peak performance. In: Berman S, editor. From front office to front line: essential issues for health care leaders. Oakbrook Terrace, Ill: Joint Commission Resources; 2005.

    Google Scholar 

  34. Mohr JJ, Batalden P, Barach P. Integrating patient safety into the clinical microsystem. Qual Saf Health Care. 2004;13 Suppl 2:ii34–8.

  35. Holden LM. Complex adaptive systems: concept analysis. J Adv Nurs. 2005;52:651–7.

    Article  PubMed  Google Scholar 

  36. Jayasinghe S. Conceptualising population health: from mechanistic thinking to complexity science. Emerging Themes Epidemiol. 2011;8:2.

    Article  Google Scholar 

  37. Amagoh F. Perspectives on organizational change: systems and complexity theories. Innovation J: Publ Sector Innovation J. 2008;13(3):1–14.

    Google Scholar 

  38. Institute for Healthcare Improvement. The Breakthrough Series: IHI's collaborative model for achieving breakthrough improvement. 2003. http://www.ihi.org/knowledge/Pages/IHIWhitePapers/TheBreakthroughSeriesIHIsCollaborativeModelforAchievingBreakthroughImprovement.aspx. Accessed April 28 2014.

  39. Reis MD, Scott SD, Rempel GR. Including parents in the evaluation of clinical microsystems in the neonatal intensive care unit. Adv Neonatal Care. 2009;9(4):174–9.

    Article  PubMed  Google Scholar 

  40. Hix C, McKeon L, Walters S. Clinical nurse leader impact on clinical microsystems outcomes. J Nurs Adm. 2009;39(2):71–6.

    Article  PubMed  Google Scholar 

  41. Berry SA, Laam LA, Wary AA, Mateer HO, Cassagnol HP, McKinley KE, et al. ProvenCare Perinatal: a model for delivering evidence/guideline-based care for perinatal populations. Jt Comm J Qual Patient Saf. 2011;37(5):229–39.

    PubMed  Google Scholar 

  42. Berry SA, Doll MC, McKinley KE, Casale AS, Bothe Jr A. ProvenCare: quality improvement model for designing highly reliable care in cardiac surgery. Qual Saf Health Care. 2009;18(5):360–8.

    Article  CAS  PubMed  Google Scholar 

  43. Barach P, Johnson JK. Understanding the complexity of redesigning care around the clinical microsystem. Qual Saf Health Care. 2006;15:110–6.

    Article  Google Scholar 

  44. Gurses AP, Carayon P. Performance obstacles of intensive care nurses. Nurs Res. 2007;56:185–94.

    Article  PubMed  Google Scholar 

  45. Wirtschafter D, Pettit J, Kurtin P, Dalsey M, Chance K, Morrow H, et al. A statewide quality improvement collaborative to reduce neonatal central line-associated blood stream infections. J Perinatol. 2010;30(3):170–81.

    Article  CAS  PubMed  Google Scholar 

  46. von Plessen C, Aslaksen A. Improving the quality of palliative care for ambulatory patients with lung cancer. BMJ: Br Med J. 2005;330(7503):1309.

    Article  Google Scholar 

  47. Stark A, Lannon C. Systems changes to prevent severe hyperbilirubinemia and promote breastfeeding: pilot approaches. J Perinatol. 2009;29:S53–7.

    Article  PubMed  Google Scholar 

  48. Wang MC, Hyun JK, Harrison MI, Shortell SM, Fraser I. Redesigning health systems for quality: lessons from emerging practices. Jt Comm J Qual Patient Saf. 2006;32(11):599–611.

    PubMed  Google Scholar 

  49. Keroack MA, Youngberg BJ, Cerese JL, Krsek C, Prellwitz LW, Trevelyan EW. Organizational factors associated with high performance in quality and safety in academic medical centers. Acad Med. 2007;82(12):1178–86.

    Article  PubMed  Google Scholar 

  50. Thompson E, Harding AL, Pond F, Hammond C, Taylor M. A partnership to improve health care in Kosovo: Dartmouth Medical School and Kosovar nurses worked together on a two-year project to rebuild primary health care in the postconflict city of Gjilan. Am J Nurs. 2006;106(11):72CC, DD.

  51. Kollisch DO, Hammond CS, Thompson E, Strickler J. Improving family medicine in Kosovo with microsystems. J Am Board Fam Med: JABFM. 2011;24(1):102–11.

    Article  PubMed  Google Scholar 

  52. Gillen S, McKeever J, Edwards K, Thielen L. Promoting quality improvement and achieving measurable change: the lead states initiative. J Public Health Manag Pract. 2010;16(1):55–60. Doi: 10.1097/PHH.0b013e3181bedb5d.

    Article  PubMed  Google Scholar 

  53. Revans R. ABC of action learning. Burlington, VT: Gower Publishing; 2011.

    Google Scholar 

  54. Bazos DA, Schifferdecker KE, Fedrizzi R, Hoebeke J. Action-learning collaboratives as a platform for community-based participatory research to advance obesity prevention. J Health Care Poor Underserved. 2013;24(2):61–79.

    Article  PubMed  Google Scholar 

  55. Nembhard IM. Learning and improving quality improvement learning collaboratives: which collaborative features do participants value most? Health Res Educ Trust. 2009;44(2):359–78.

    Google Scholar 

  56. Schouten LM, Hulscher ME, van Everdingen JJ, Huijsman R, Grol RP. Evidence for the impact of quality improvement collaboratives: systematic review. BMJ. 2008;336:1491–4.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. In: Implementation Science. 2009. www.implementationscience.com/content/4/1/50. Accessed 50 4.

  58. Ayers LR, Beyea SC, Godfrey MM, Harper DC, Nelson EC, Batalden PB. Quality improvement learning collaboratives. Qual Manag Health Care. 2005;4(4):234–46.

    Article  Google Scholar 

  59. WHO, UNICEF. Microplanning for immunization service delivery using the Reaching Every District (RED) strategy. Geneva, Switzerland/New York, NY2009 Contract No.: WHO/IVB/09.11.

  60. Langley G, Moen R, Nolan K, Norman C, Provost L. The improvement guide: a practical approach to enhancing organizational performance. 2nd ed. San Francisco: Jossey-Bass; 2009.

    Google Scholar 

  61. Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, Cronholm PF, Halladay JR, Driscoll DL, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013;11 Suppl 1:S115–23. Doi: 10.1370/afm.1549.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Wasson JH, Splaine ME, Bazos D, Fisher ES. Overview: working inside, outside, and side by side to improve the quality of health care. Jt Comm J Qual Improv. 1998;24(10):513–7.

    CAS  PubMed  Google Scholar 

  63. Foster-Fishman PG, Nowell B, Yang H. Putting the system back into systems change: a framework for understanding and changing organizational and community systems. Am J Community Psychol. 2007;39:197–215.

    Article  PubMed  Google Scholar 

  64. Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3(1):1.

    Article  PubMed  PubMed Central  Google Scholar 

  65. McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K. Getting evidence into practice: the meaning of ‘context’. J Adv Nurs. 2002;38:94–104.

    Article  PubMed  Google Scholar 

  66. Patton MQ. Qualitative research and evaluation methods. 3rd ed. Thousand Oaks, CA: Sage; 2002.

    Google Scholar 

  67. Strauss A, Corbin J. Basics of qualitative research: techniques and procedures for developing grounded theory. 2nd ed. Thousand Oaks, CA: Sage; 1998.

    Google Scholar 

  68. Glaser B, Strauss A. A discovery of grounded theory: strategies for qualitative research. Chicago: Aldine; 1967.

    Google Scholar 

  69. Darling M, Parry C, Moore J. Learning in the thick of it. Harvard Business Review 2005. , Boston, MA: Harvard Business Publishing.

  70. US Army. A leader’s guide to after-action reviews. Washington, D.C. 1993. http://www.au.af.mil/au/awc/awcgate/army/tc_25-20/tc25-20.pdf. Accessed April 28 2014.

  71. Bos E, Batson A. Using immunization rates for monitoring health sector performance: measurement and interpretation issues. Washington, DC: International Bank for Reconstruction and Development / The World Bank; 2000.

    Google Scholar 

  72. Schifferdecker KE, Reed VA. Using mixed methods research in medical education: basic guidelines for researchers. Med Educ. 2009;43(7):637–44. doi:10.1111/j.1365-2923.2009.03386.x.

    Article  PubMed  Google Scholar 

  73. Splaine M, Nuwaha F, Bazos D, LaFave LA, Suresh G, Shannon K. African Routine Immunization System Essentials-Systems Innovation: final report. Submitted to: Bill and Melinda Gates Foundation. Washington, DC: JSI Research & Training Institute, Inc., and The Dartmouth Institute; 2012. http://arise.jsi.com/files/2012/08/8.01.12-ARISE-Report-Final.pdf. Accessed April 28 2014.

  74. Bukenya M. Applying an improvement process to a difficult long-term problem of gas cylinder supply yields positive results for the Masaka District, Uganda. Applying Science to Strengthen and Improve Systems: USAID Assist Project; 2012.

  75. Aylward RB, Linkins J. Polio eradication: mobilizing and managing the human resources. Bull World Health Organ. 2005;83(4):268–73.

    PubMed  PubMed Central  Google Scholar 

  76. Clements CJ, Nshimirimanda D, Gasasira A. Using immunization delivery strategies to accelerate progress in Africa towards achieving the Millennium Development Goals. Vaccine. 2008;26(16):1926–33.

    Article  PubMed  Google Scholar 

  77. Naimoli JF, Challa S, Schneidman M, Kostermans K. Toward a grounded theory of why some immunization programmes in sub-Saharan Africa are more successful than others: a descriptive and exploratory assessment in six countries. Health Policy Plan. 2008;23(6):379–89.

    Article  PubMed  Google Scholar 

  78. Wiysonge CS, Waggie Z, Rhoda L, Hussey G. Vaccines for Africa (VACFA) website: an innovative immunisation advocacy tool. S Afr Med J. 2009;99(5):275.

    PubMed  Google Scholar 

  79. LaFond AK, Kanagat N, Sequeira JS, Steinglass R, Fields R, Mookherji S. Drivers of routine immunization system performance at the district level: study findings from three countries, Research Brief No. 3. Arlington, VA: JSI Research and Training Institute, Inc., ARISE Project for the Bill & Melinda Gates Foundation; 2012.

    Google Scholar 

  80. VERGUET, Stéphane et al. Supplementary immunization activities (SIAs) in South Africa: comprehensive economic evaluation of an integrated child health delivery platform. Global Health Action, [S.l.], v. 6, mar. 2013. ISSN 1654-9880. Available at: <http://www.globalhealthaction.net/index.php/gha/article/view/20056>. Date accessed: 13 Feb. 2015. doi:http://dx.doi.org/10.3402/gha.v6i0.20056.

  81. Bernhardt G, Cameron N, Willems B, Boulle A, Coetzee D. Measles vaccination coverage in high-incidence areas of the Western Cape, following the mass vaccination campaign. S Afr Med J. 2013;103(3):181–6.

    Article  CAS  PubMed  Google Scholar 

  82. LaFond A, Kanagat N, Steinglass R, Fields R, Sequeira J, Mookherji S. Drivers of routine immunization coverage improvement in Africa: findings from district-level case studies. Health Policy and Planning. 2014. doi:10.1093/heapol/czu011.

  83. Weldegebriel GG, Gasasira A, Harvey P, Masresha B, Goodson JL, Pate MA, et al. Measles resurgence following a nationwide measles vaccination campaign in Nigeria, 2005–2008. J Infect Dis. 2011;204 suppl 1:S226–31.

    Article  PubMed  Google Scholar 

  84. Kitamura T, Komada K, Xeuatvongsa A, Hachiya M. Factors affecting childhood immunization in Lao People’s Democratic Republic: a cross-sectional study from nationwide, population-based, multistage cluster sampling. Biosci Trends. 2013;7:4.

    Google Scholar 

  85. Mbabazi W, Lako AK, Ngemera D, Laku R, Yehia M, Nshakira N. Maiden immunization coverage survey in the republic of South Sudan: a cross-sectional study providing baselines for future performance measurement. Pan Afr Med J. 2013;16:110.

    Article  PubMed  PubMed Central  Google Scholar 

  86. Nutley T, Reynolds HW. Improving the use of health data for health system strengthening. Global Health Action. 2013;6:1–9.

    Article  Google Scholar 

  87. Ryman TK, Briere EC, Cartwright E, Schlanger K, Wannemuehler KA, Russo ET, et al. Integration of routine vaccination and hygiene interventions: a comparison of 2 strategies in Kenya. J Infect Dis. 2012;205 suppl 1:S65–76. Doi: 10.1093/infdis/jir777.

    Article  PubMed  Google Scholar 

  88. Ryman TK, Wallace A, Mihigo R, Richards P, Schlanger K, Cappelier K, et al. Community and health worker perceptions and preferences regarding integration of other health services with routine vaccinations: four case studies. J Infect Dis. 2012;205 suppl 1:S49–55.

    Article  PubMed  Google Scholar 

  89. Mathanga DP, Luman ET, Campbell CH, Silwimba C, Malenga G. Integration of insecticide‐treated net distribution into routine immunization services in Malawi: a pilot study. Trop Med Int Health. 2009;14(7):792–801.

    Article  PubMed  Google Scholar 

  90. Parry G, Carson-Stevens A, Luff D, McPherson M, Goldmann D. Recommendations for evaluation of health care improvement initiatives. Acad Pediatr. 2013;13(6S):S23–9.

    Article  PubMed  Google Scholar 

  91. Government of Uganda Ministry of Health. Health sector strategic plan 2010/11-2014/15. Kampala: Government of Uganda Ministry of Health; 2010.

  92. Amabile T. Creativity and innovation in organizations. Harvard College, Boston: Harvard Business School Publishing; 1996.

    Google Scholar 

  93. Arevshatian L, Clements CJ, Lwanga SK, Misored AO, Ndumbe P, Seward JF, et al. An evaluation of infant immunization in Africa: is a transformation in progress? Bull World Health Organ. 2007;85(6):421–500.

    Google Scholar 

Download references

Acknowledgements

The Africa Routine Immunization System Essentials-Systems Innovation (ARISE-SI) was conducted in partnership with Dartmouth College, Makerere University School of Public Health, and JSI Research & Training Institute, Inc. This initiative was guided by an Internal (Ugandan) and External (International) Panel of Experts and was funded by the Bill and Melinda Gates Foundation (grant reference number OPPGH5271).

We wish to gratefully acknowledge all who supported this initiative. The authors would like to recognize the support received from the Bill & Melinda Gates Foundation, especially the encouragement of Mary Taylor. We would like to express our appreciation to the JSI Research & Training Institute, Inc. advisors Wendy Abramson, Robert Steinglass, and Jenny Sequeira for their thoughtful guidance and suggestions on development of a conceptual framework, adaptation of the tools and methods to the Ugandan public health context, and interpretation and analysis of the information collected, and without whom, this initiative would never have been brought to fruition. We wish to thank the Ministry of Health of Uganda staff who gave generously of their time to make this initiative a success. In particular, we would like to recognize the support that was received by the Uganda National Expanded Program on Immunization team, Dr. Rachel Seruyange, Dr. Jacinta Sabiiti, Mrs. Winifred Tabaaro; the Masaka District Health Team leaders, Dr. Stuart Musisi and Mr. Muhamed Bukenya; and the Health Unit Improvement Teams from Bukeeri, Butende, Kiyumba, Kyannamukaka, Masaka Municipal Council, and Masaka District.

Special appreciation goes to the Internal Panel of Experts, in particular, Mr. Robert Basaza, (Ugandan Ministry of Health), Dr. Patrick Banura and Dr. Annette Kisakye, (WHO), Dr. Eva Kabwongera (UNICEF), Mrs. Robinah Kaitiritimba (Uganda National Health Consumer’s Organization), Dr. Sabrina Bakeera-Kitaka (Uganda Paediatric Association), Dr. Humphrey Mgere (USAID HCI Project), Dr. Janex Kabarangira (USAID/Uganda), and Mr. John Barenzi (first EPI Manager/Uganda) for their ongoing advice and assistance in grounding us in the reality of the Ugandan context. We would also like to recognize the important role that the External Panel of Experts played in initiative design, implementation, and interpretation of findings, in particular, Rachel Feilden, Dr. Mashako Leonard, Dr. M. Rashad Massoud, Dr. Marty Makinen, Dr. Bjorn Melgaard, Dr. Nick Tilley, and Dr. Nana Twum-Danso.

As the initiative matured, Dr. Martin Ssendyona, Uganda Ministry of Health (Quality Assurance), and Dr. Kakala Mushiso Alex, USAID HCI Project, helped link ARISE-SI to the important work of the MoH in developing a national Quality Assurance Framework.

We would like to acknowledge Jabeen Ahmed, Ph.D., for her analytic work and also emphasize the diligence, insight, and guidance of Mr. Patrick Isingoma, the National ARISE-SI Coach/Manager, who worked tirelessly across systems assuring the successful implementation of this research initiative. Finally, we wish to thank Drs. Paul Batalden and Eugene Nelson whose wisdom and guidance allowed this project to become a reality.

Author information

Authors and Affiliations

  1. Community Engagement, the Prevention Research Center at Dartmouth, The Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth College, 35 Centerra Parkway, Lebanon, NH, 03766, USA

    Dorothy A Bazos

  2. JSI Research & Training Institute, Inc., Community Health Institute, 501 South Street, 2nd Floor, Bow, NH, 03304, USA

    Lea R Ayers LaFave

  3. Pediatrics and Community & Family Medicine, Geisel School of Medicine, Dartmouth-Hitchcock Medical Center, 1 Rope Ferry Road, Hanover, NH, 03755, USA

    Gautham Suresh

  4. SAC Health System, Department of Family Medicine, Loma Linda University School of Medicine, Suite 206-A, Loma, Linda, CA, 92354, USA

    Kevin C Shannon

  5. Disease Control and Prevention, Makerere University School of Public Health, PO Box 7072, Kampala, Uganda

    Fred Nuwaha

  6. The Dartmouth Institute for Health Policy and Clinical Practice and Community and Family Medicine, Geisel School of Medicine at Dartmouth, 30 Lafayette Street, Lebanon, NH, 03766, USA

    Mark E Splaine

  7. 501 South Street, Bow, NH, 03304, USA

    Dorothy A Bazos

Authors
  1. Dorothy A Bazos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lea R Ayers LaFave
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gautham Suresh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kevin C Shannon
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fred Nuwaha
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mark E Splaine
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dorothy A Bazos.

Additional information

Competing interests

The authors declare that they have no competing interests. This research was funded by a Bill & Melinda Gates Foundation grant.

Authors’ contributions

DB contributed to the conceptual design of the study, led the research team in Uganda, and prepared the initial manuscript draft. LAL led the research design and analysis of the qualitative component of the project. GS contributed to the conceptualization of the research, most significantly to the implementation of the educational components. KS contributed to the conceptualization of the research, most significantly to the implementation of the coaching component. FN was responsible for the cultural and political translation of the study design to the Ugandan context. MS led the conceptualization of the study and quantitative research design and analysis component of the project. All authors contributed theoretical and methodological expertise to the design and implementation of the study, supported the drafting of the manuscript, and have read and approved the final manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bazos, D.A., LaFave, L.R.A., Suresh, G. et al. The gas cylinder, the motorcycle and the village health team member: a proof-of-concept study for the use of the Microsystems Quality Improvement Approach to strengthen the routine immunization system in Uganda. Implementation Sci 10, 30 (2015). https://doi.org/10.1186/s13012-015-0215-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-015-0215-3

Keywords

Implementation Science

ISSN: 1748-5908