<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
   <ui>1748-5908-5-37</ui>
   <ji>1748-5908</ji>
   <fm>
      <dochead>Study protocol</dochead>
      <bibl>
         <title>
            <p>Translating research into practice in Leeds and Bradford (TRiPLaB): a protocol for a programme of research</p>
         </title>
         <aug>
            <au id="A1">
               <snm>Hanbury</snm>
               <fnm>Andria</fnm>
               <insr iid="I1"/>
               <email>ah537@york.ac.uk</email>
            </au>
            <au id="A2">
               <snm>Thompson</snm>
               <fnm>Carl</fnm>
               <insr iid="I1"/>
               <email>cat4@york.ac.uk</email>
            </au>
            <au ca="yes" id="A3">
               <snm>Wilson</snm>
               <mi>M</mi>
               <fnm>Paul</fnm>
               <insr iid="I2"/>
               <email>pmw7@york.ac.uk</email>
            </au>
            <au id="A4">
               <snm>Farley</snm>
               <fnm>Kate</fnm>
               <insr iid="I1"/>
               <email>kf546@york.ac.uk</email>
            </au>
            <au id="A5">
               <snm>Chambers</snm>
               <fnm>Duncan</fnm>
               <insr iid="I2"/>
               <email>dc510@york.ac.uk</email>
            </au>
            <au id="A6">
               <snm>Warren</snm>
               <fnm>Erica</fnm>
               <insr iid="I3"/>
               <email>Erica.Warren@bradford.nhs.uk</email>
            </au>
            <au id="A7">
               <snm>Bibby</snm>
               <fnm>John</fnm>
               <insr iid="I3"/>
               <email>John.Bibby@bradford.nhs.uk</email>
            </au>
            <au id="A8">
               <snm>Mannion</snm>
               <fnm>Russell</fnm>
               <insr iid="I4"/>
               <email>r.mannion@bham.ac.uk</email>
            </au>
            <au id="A9">
               <snm>Watt</snm>
               <mi>S</mi>
               <fnm>Ian</fnm>
               <insr iid="I1"/>
               <email>isw1@york.ac.uk</email>
            </au>
            <au id="A10">
               <snm>Gilbody</snm>
               <fnm>Simon</fnm>
               <insr iid="I1"/>
               <email>sg519@york.ac.uk</email>
            </au>
         </aug>
         <insg>
            <ins id="I1">
               <p>Department of Health Sciences, University of York, York, YO10 5DD UK</p>
            </ins>
            <ins id="I2">
               <p>Centre for Reviews and Dissemination, University of York, York, YO10 5DD, UK</p>
            </ins>
            <ins id="I3">
               <p>NHS Bradford and Airedale, Douglas Mill, Bradford, BD5 7JR, UK</p>
            </ins>
            <ins id="I4">
               <p>Health Services Management Centre, University of Birmingham, Birmingham, B15 2RT, UK</p>
            </ins>
         </insg>
         <source>Implementation Science</source>
         <issn>1748-5908</issn>
         <pubdate>2010</pubdate>
         <volume>5</volume>
         <issue>1</issue>
         <fpage>37</fpage>
         <url>http://www.implementationscience.com/content/5/1/37</url>
         <xrefbib>
            <pubidlist>
               <pubid idtype="pmpid">20492651</pubid>
               <pubid idtype="doi">10.1186/1748-5908-5-37</pubid>
            </pubidlist>
         </xrefbib>
      </bibl>
      <history>
         <rec>
            <date>
               <day>18</day>
               <month>3</month>
               <year>2010</year>
            </date>
         </rec>
         <acc>
            <date>
               <day>21</day>
               <month>5</month>
               <year>2010</year>
            </date>
         </acc>
         <pub>
            <date>
               <day>21</day>
               <month>5</month>
               <year>2010</year>
            </date>
         </pub>
      </history>
      <cpyrt>
         <year>2010</year>
         <collab>Hanbury et al; licensee BioMed Central Ltd.</collab>
         <note>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</note>
      </cpyrt>
      <abs>
         <sec>
            <st>
               <p>Abstract</p>
            </st>
            <sec>
               <st>
                  <p>Background</p>
               </st>
               <p>The National Institute for Health Research (NIHR) has funded nine Collaborations for Leadership in Applied Health Research and Care (CLAHRCs). Each CLAHRC is a partnership between higher education institutions (HEIs) and the NHS in nine UK regional health economies. The CLAHRC for Leeds, York, and Bradford comprises two 'research themes' and three 'implementation themes.' One of these implementation themes is Translating Research into Practice in Leeds and Bradford (TRiPLaB). TRiPLaB aims to develop, implement, and evaluate methods for inducing and sustaining the uptake of research knowledge into practice in order to improve the quality of health services for the people of Leeds and Bradford.</p>
            </sec>
            <sec>
               <st>
                  <p>Methods</p>
               </st>
               <p>TRiPLaB is built around a three-stage, sequential, approach using separate, longitudinal case studies conducted with collaborating NHS organisations, TRiPLaB will select robust innovations to implement, conduct a theory-informed exploration of the local context using a variety of data collection and analytic methods, and synthesise the information collected to identify the key factors influencing the uptake and adoption of targeted innovations. This synthesis will inform the development of tailored, multifaceted, interventions designed to increase the translation of research findings into practice. Mixed research methods, including time series analysis, quasi-experimental comparison, and qualitative process evaluation, will be used to evaluate the impact of the implementation strategies deployed.</p>
            </sec>
            <sec>
               <st>
                  <p>Conclusion</p>
               </st>
               <p>TRiPLaB is a theory-informed, systematic, mixed methods approach to developing and evaluating tailored implementation strategies aimed at increasing the translation of research-based findings into practice in one UK health economy. Through active collaboration with its local NHS, TRiPLaB aims to improve the quality of health services for the people of Leeds and Bradford and to contribute to research knowledge regarding the interaction between context and adoption behaviour in health services.</p>
            </sec>
         </sec>
      </abs>
   </fm>
   <meta>
      <classifications>
         <classification id="endnote" subtype="user_supplied_xml" type="bmc"/>
      </classifications>
   </meta>
   <bdy>
      <sec>
         <st>
            <p>Background</p>
         </st>
         <p>In response to the recommendation of the Chief Medical Officer's Clinical Effectiveness Group that the NHS should better utilise higher education to support initiatives to enhance the effectiveness and efficiency of clinical care <abbrgrp><abbr bid="B1">1</abbr></abbrgrp>, the National Institute for Health Research (NIHR) announced a strategy of increasing partnerships between higher education and the NHS in local health economies. One means of developing these partnerships is Collaborations in Leadership and Applied Health Research and Care or CLAHRCs. The NIHR has funded nine CLAHRCs, each with an emphasis on research that makes an impact locally and with a strong, disciplined, and strategic approach to implementing that research. The NIHR CLAHRC for Leeds, York and Bradford (LYBRA) comprises two 'research' programmes (Improving Vascular Prevention in Cardiac and Stroke Care (IMPROVE-PC), Improving the Quantity and Quality of Life in People with Addictions) and three 'implementation' programmes (Outcome Driven Stroke Care, Maternal and Child Health, and the focus of this protocol, Translating Research into Practice in Leeds and Bradford, or TRiPLaB).</p>
         <p>The aim of TRiPLaB is to develop, implement, and evaluate methods of inducing and sustaining the uptake of research into practice in order to improve the quality of health services for the people of Leeds and Bradford. Research implementation is a complex process, highly dependent on context, and interactions between multiple, interconnected, factors at the level of individuals, groups, organisations and wider health systems <abbrgrp><abbr bid="B2">2</abbr><abbr bid="B3">3</abbr><abbr bid="B4">4</abbr><abbr bid="B5">5</abbr><abbr bid="B6">6</abbr></abbrgrp>. Despite this complexity, or perhaps because of it, implementation research has often focused on individual behaviour change without reflecting on, or paying attention to, the characteristics of health technologies, the processes by which health technologies are adopted and sustained, or a workable understanding of the particular context in which implementation occurs <abbrgrp><abbr bid="B7">7</abbr></abbrgrp>.</p>
         <p>Successive reviews of the evidence for successful translation of research findings into healthcare practice reveal that a range of implementation strategies can be successful. However, why strategies work in some circumstances but not others remains unclear <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B6">6</abbr><abbr bid="B8">8</abbr></abbrgrp>.</p>
         <p>Using theory to guide the exploration of the local context for implementation can help <abbrgrp><abbr bid="B6">6</abbr></abbrgrp>. First, relevant theories enable the tailoring of strategies to the most significant barriers to translating research into practice in a given context. Second, theories enable researchers to build on existing knowledge and increase the transferability of findings to settings and contexts other than the immediate research environment <abbrgrp><abbr bid="B9">9</abbr></abbrgrp>.</p>
         <p>TRiPLaB will use theory to guide its exploration of context in our collaborating healthcare organisations. This exploration will in turn inform the development of tailored implementation strategies for innovation delivery. The synthesis of research findings by Greenhalgh <it>et al</it>. <abbrgrp><abbr bid="B5">5</abbr></abbrgrp> on the dissemination and implementation of research-based innovations provides the theoretical framework for TRiPLaB. Their analysis proposes that successful innovation adoption requires analysis of the characteristics of the innovation itself, the perceptions of those individuals tasked with adopting the innovation, and the wider organisational cultures in place in the setting for adoption. Shaped by diffusion of innovation theory <abbrgrp><abbr bid="B10">10</abbr></abbrgrp>, Greenhalgh <it>et al</it>. also acknowledge the influence of channels of communication, or social networks, between practitioners as important influences on whether, and how quickly, an innovation is adopted. In adopting this particular theoretical framework, TRiPLaB will explore the relative influence of these often overlooked but important elements at individual, team and organisational levels in our NHS partners <abbrgrp><abbr bid="B2">2</abbr><abbr bid="B3">3</abbr><abbr bid="B4">4</abbr><abbr bid="B5">5</abbr><abbr bid="B6">6</abbr></abbrgrp>. This theory-informed exploration will form our 'diagnostic analysis' <abbrgrp><abbr bid="B3">3</abbr></abbrgrp> of the local context in each of the NHS healthcare organisations that make up our case study series.</p>
      </sec>
      <sec>
         <st>
            <p>Methods</p>
         </st>
         <p>Ethical approval for this study was given by York Research Ethics Committee (REC 10/H1311/1).</p>
         <sec>
            <st>
               <p>The Develop, IMplement, Evaluate (DIME) approach of TRiPLaB</p>
            </st>
            <p>TRiPLaB is a multisite, longitudinal, mixed methods case study. Currently, we are working with NHS Bradford and Airedale (an NHS commissioning and community provider organisation) to translate research-based findings into practice in the areas of maternal mental health and stroke care, and with Leeds Partnership Foundation Trust (a provider of mental health services) to enhance the implementation of recent and relevant NICE guidance.</p>
            <p>Each case study will have three sequential phases (see Figure <figr fid="F1">1</figr>): the findings from the development phase (phase one) lead into the implementation phase (phase two), and the outcomes of this are assessed in the evaluation phase (phase three). The three-phase approach has been informed by the Medical Research Council's framework <abbrgrp><abbr bid="B11">11</abbr></abbrgrp> for developing and evaluating complex interventions, acknowledges the need to use theory in planning and analysis, recognises the importance of local context, piloting, and evaluating intervention components, and the use of multiple outcome measures to evaluate intervention effectiveness. The three phases are summarised below.</p>
            <fig id="F1">
               <title>
                  <p>Figure 1</p>
               </title>
               <caption>
                  <p>The Develop, Implement, Evaluate model of TRiPLaB</p>
               </caption>
               <text>
                  <p><b>The Develop, Implement, Evaluate model of TRiPLaB</b>.</p>
               </text>
               <graphic file="1748-5908-5-37-1"/>
            </fig>
            <p>Phase one is a development phase in which the innovation that is the focus of each case study will be selected and its key characteristics mapped. Theory-informed factors hypothesised as influential in health professionals' adoption of the selected innovation into routine practice are explored and mapped.</p>
            <p>Phase two is an implementation phase in which tailored behaviour-change interventions are developed piloted and delivered using personnel from TRiPLaB and its partner organisations.</p>
            <p>Phase Three is an evaluation phase in which changes in structure, process, and outcome are described and evaluated. We will be looking at change both within and, towards the end of the programme, between case studies.</p>
            <p>TRiPLaB will use the resources of the Centre for Reviews and Dissemination (CRD) to increase the accessibility of research evidence to decision makers (particularly commissioners) in the NHS. Primarily, we will do this by using tailored briefings relating research evidence to specific decision problems and context in Bradford and Leeds. These 'evidence briefings' will be based on existing sources of synthesised and quality assessed evidence - for example, CRD's databases of systematic reviews (DARE) and economic evaluations (NHS EED). We will develop and implement methods for producing and disseminating evidence briefings and evaluate their perceived usefulness, costs, and use by decision makers.</p>
         </sec>
         <sec>
            <st>
               <p>Development phase (phase one)</p>
            </st>
            <sec>
               <st>
                  <p>Selecting the innovation</p>
               </st>
               <p>At the start of each case study, the specific innovation to be targeted will be selected. The selection will be based on the results of: a qualitative stakeholder consultation designed to identify key topics; a conjoint analysis survey of commissioners and practitioners designed to explore those characteristics of innovations likely to influence individuals' prioritisation of them; and a mapping exercise exploring how each of the stakeholder short-listed topics 'scores' against the characteristics measured in the conjoint analysis survey (for example, local capacity and expertise for implementation, cost/impact on local budgets). We will also consider pragmatic issues, such as the presence or absence of routine data sources to aid the measurement of innovation adoption.</p>
               <p>Stakeholder consultations will focus on identifying key topics in the relevant clinical area. For example, in NHS Bradford and Airedale, stakeholder consultation in the area of child and maternal health care with a range of commissioners and practitioners revealed the importance of maternal mental health as a focus for activity.</p>
               <p>The conjoint survey will reveal the characteristics <abbrgrp><abbr bid="B6">6</abbr></abbrgrp> that influence an individual's decision to prioritise one innovation over another. The factors that make up the conjoint profiles to be evaluated will include characteristics such as the strength of supporting evidence base behind an innovation and its economic costs. By conjoint analysing the characteristics of potential innovations, we will be able to 'plug in' future innovations and inform the organisation's understanding the likelihood of successful implementation. This has the obvious advantage of not having to ask the healthcare workforce or consumers to rank or rate innovations on multiple occasions. The conjoint analysis also reduces the likelihood of the TRiPLaB team targeting respondents (for example, as change agents) who may not favour the innovation eventually selected.</p>
               <p>The mapping exercise will score short-listed innovations against characteristics measured in the conjoint analysis survey. For example, the strength of supporting evidence base for each of the short listed innovations from the stakeholder consultation will be explored through reference to published systematic reviews. The outcome of this process will be summarised in a matrix. Finally, the pragmatic factors to be considered will include whether suitable process of care and health outcome measures are available through routinely collected data to evaluate the impact of the implementation strategies, or whether tailor-made, repeatable, audits have to be established.</p>
               <p>The selected innovation for each case study will be one that has been identified as a key topic from the stakeholder consultation that scores highly on those characteristics identified from the conjoint analysis survey as influential in commissioners' and practitioners' prioritisation of innovations, and can be monitored through tailor-made audits or, preferably, via routinely collected data. In sum, the combination of stakeholder consultation, the conjoint survey of practitioner and commissioner preferences, and the mapping exercise will enable us to select a robust but feasible innovation to target in each case site.</p>
            </sec>
            <sec>
               <st>
                  <p>Exploring the local context</p>
               </st>
               <p>Following selection of the innovation to be targeted, we will undertake a diagnostic analysis <abbrgrp><abbr bid="B3">3</abbr></abbrgrp> in which we will administer a second survey in each case site to measure health professionals' attitudes towards the innovation, health care team innovation culture (using the Team Climate Inventory <abbrgrp><abbr bid="B12">12</abbr></abbrgrp>), and the social networks/communication channels between health professionals with regards to the innovation. A series of semi-structured interviews will also be conducted with a sample of the health professionals to further explore perceived barriers to implementation, and to gain a richer understanding of the influence of health care teams and social networks in the uptake and adoption of new innovations into practice.</p>
               <p>Quantitative survey data will be synthesised using multilevel modelling (MLM) approaches to identify the hierarchical level most likely to be responsive to the implementation strategies developed. For example, if the MLM identifies healthcare team culture to be particularly influential, a multifaceted intervention specifically targeting a team's culture towards innovation might (<it>a priori</it>) be more successful than an intervention targeting only individual attitudes towards the innovation. This focus is deliberate given the current dearth of implementation research examining the influence of factors at different hierarchical levels in the health care system, and recommendations for further research in this area <abbrgrp><abbr bid="B13">13</abbr></abbrgrp>. The qualitative data collected from the semi-structured interviews will be analysed using thematic analysis and combined with the outcome of the MLM to gain a richer understanding of the local context and to help tailor the implementation strategies.</p>
            </sec>
         </sec>
         <sec>
            <st>
               <p>Implementation phase (phase two)</p>
            </st>
            <p>Development of the intervention will be systematic, specifying intervention objectives, developing specific implementation strategies to satisfy these objectives, and piloting strategies to assess their likely impact and test how they will be received by the health professionals. This piloting and modelling prior to rolling out implementation strategies/behaviour-change interventions is a necessary prerequisite stage <abbrgrp><abbr bid="B11">11</abbr></abbrgrp>. The objectives and design of the intervention will be determined by the outcome of the development phase, in particular the results of the planned multilevel modelling. The selection and design of the actual intervention components will be informed by existing systematic, and other, reviews of the relevant literature.</p>
            <p>Having decided on the innovation in phase one and possible implementation strategies in phase two, we will make the final choice on our implementation approach with reference to the idea of 'policy' cost effectiveness <abbrgrp><abbr bid="B14">14</abbr></abbrgrp>. Summary data on: the innovation from Phase One (net cost per patient and likely health gain per patient); the implementation strategies under consideration (net cost of planned implementation and likely change in adoption/adherence); and local scale factors (for example, the number of NHS organisational units involved and number of patients targeted) will be combined to arrive at a policy cost effectiveness figure for each option. The combination with the highest cost effectiveness will be the option pursued.</p>
            <p>The failure to adequately describe interventions in the context of research and the commensurate reduction in others' ability to then use successful programs -- or conversely, avoid making the same mistakes as unsuccessful ones -- is common in healthcare research <abbrgrp><abbr bid="B15">15</abbr></abbrgrp>. For each of the case studies in the TRiPLaB program we will describe: the intervention and its component parts in sufficient detail that others could reproduce it; why the specific intervention was chosen; and a fidelity measure of how well the intervention was delivered. For example, if we undertake educational outreach or training as a component of an intervention, we will detail how many sessions each unit of analysis receive, and when and where the training took place.</p>
         </sec>
         <sec>
            <st>
               <p>Evaluation phase (phase three)</p>
            </st>
            <p>Following the recommendation to conduct exploratory trials prior to embarking on more definitive randomised controlled trials <abbrgrp><abbr bid="B11">11</abbr></abbrgrp>, TRiPLaB will employ three different methods to evaluate the impact of the tailored implementation strategies delivered in each case study. The findings from these evaluation measures will inform (if worthwhile) later randomised controlled trials. The three methods to be used are: interrupted time series analysis of either tailor-made audit data or routinely collected data to estimate the impact of the intervention upon suitable process of care and outcome measures; comparison of pre- and post-intervention scores of survey-gathered measures of individual attitudes, team culture, and changing nature, composition, and size of social networks; and a qualitative process evaluation of why the intervention worked (or did not work).</p>
            <p>Alongside these three primary evaluation methods we will also collect cost data on the resources used in the delivery of implementation approaches. The micro costs <abbrgrp><abbr bid="B16">16</abbr></abbrgrp> associated with each strategy will be estimated alongside the extent of behavioural change achieved to arrive at summary estimates of implementation cost effectiveness <abbrgrp><abbr bid="B14">14</abbr></abbrgrp> for each of the case studies in the programme.</p>
         </sec>
         <sec>
            <st>
               <p>Interrupted time series analysis</p>
            </st>
            <p>Interrupted time series designs compare multiple 'before and after' (the introduction of a change strategy) measures to detect whether an intervention has had an effect over and above any underlying trend in the data <abbrgrp><abbr bid="B17">17</abbr></abbrgrp>. Time series analysis has been used as a technique for evaluating the effectiveness of health care interventions <abbrgrp><abbr bid="B18">18</abbr></abbrgrp>. In the case studies, routinely collected process (health professionals' adoption of the innovation) and health outcome measures (dependent on the innovation selected) will provide the multiple time points necessary to perform a time series analysis. Time, possible seasonal trend, and possible upward trend, commonly occurring following the introduction of a new innovation <abbrgrp><abbr bid="B10">10</abbr></abbrgrp>, will be modelled into the analysis. This will be the primary outcome measure for each case study.</p>
         </sec>
         <sec>
            <st>
               <p>Comparison of pre- and post-intervention scores</p>
            </st>
            <p>The interrupted time series analysis will estimate the impact of the intervention upon process of care and health outcome measures; however, a comparison of pre- and post-intervention scores is also necessary to estimate whether the intervention successfully changed the factors (for example, individual attitudes, social networks and team culture) in the underlying theoretical framework that it was designed to target (based on the data synthesis through multilevel modelling in TRiPLaB's development phase in each site). This 'meditational analysis' <abbrgrp><abbr bid="B9">9</abbr></abbrgrp> is critical when evaluating the theory used to develop change interventions, as it will inform our understanding of why an intervention either works or fails to work in the ways we intended.</p>
         </sec>
         <sec>
            <st>
               <p>Qualitative process evaluation</p>
            </st>
            <p>Qualitative interviews with health professionals receiving the intervention will enable an exploration of their perceptions of what worked and what did not work in the intervention, providing insight into the 'black box' of intervention effectiveness <abbrgrp><abbr bid="B19">19</abbr></abbrgrp>. In combination with the measure of fidelity taken during the implementation phase, these qualitative interviews comprise a process evaluation of the intervention, addressing recommendations to monitor intervention delivery and receipt by participants <abbrgrp><abbr bid="B11">11</abbr><abbr bid="B20">20</abbr></abbrgrp>. The data will be analysed using a framework approach <abbrgrp><abbr bid="B21">21</abbr></abbrgrp>: familiarisation with the data, identification of a thematic framework, indexing, charting, and finally, mapping and interpretation with reference to the overall aim of TRiPLaB as well as the themes revealed by the data.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Conclusion</p>
         </st>
         <p>TRiPLaB is a theory-informed, systematic, mixed methods approach to developing and evaluating tailored implementation strategies aimed at increasing the translation of research findings into clinical and service practice. TRiPLaB aims to play a part in improving the quality of health services for the people of Leeds and Bradford. By working alongside multiple healthcare organisations in a series of longitudinal case studies, the TRiPLaB programme will develop a richer understanding of key issues influencing the adoption of innovations in the NHS and the promotion of quality improvement in routine practice.</p>
      </sec>
      <sec>
         <st>
            <p>Competing interests</p>
         </st>
         <p>The authors declare that they have no competing interests.</p>
      </sec>
      <sec>
         <st>
            <p>Authors' contributions</p>
         </st>
         <p>The programme protocol was originally developed by CT, PMW, RM, ISW, JB, and SG. The protocol was further developed by AH, KF, DC, and EW. All of the authors contributed to the development and completion of the manuscript. All authors read and approved the final manuscript.</p>
      </sec>
   </bdy>
   <bm>
      <ack>
         <sec>
            <st>
               <p>Acknowledgements</p>
            </st>
            <p>This article presents independent research funded by the National Institute for Health Research (NIHR) through the Leeds York Bradford Collaboration for Leadership in Applied Health Research and Care. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.</p>
         </sec>
      </ack>
      <refgrp>
         <bibl id="B1">
            <title>
               <p>Report of the High Level Group on Clinical Effectiveness. A report to Sir Liam Donaldson Chief Medical Officer</p>
            </title>
            <aug>
               <au>
                  <snm>Tooke</snm>
                  <fnm>JC</fnm>
               </au>
            </aug>
            <publisher>London: Department of Health</publisher>
            <pubdate>2007</pubdate>
         </bibl>
         <bibl id="B2">
            <title>
               <p>Retailing research: Increasing the role of evidence in clinical services for childbirth</p>
            </title>
            <aug>
               <au>
                  <snm>Lomas</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Milbank Quarterly</source>
            <pubdate>1993</pubdate>
            <volume>71</volume>
            <fpage>439</fpage>
            <lpage>475</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.2307/3350410</pubid>
                  <pubid idtype="pmpid">8413070</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B3">
            <title>
               <p>Getting evidence into practice</p>
            </title>
            <aug>
               <au>
                  <cnm>Centre for Reviews and Dissemination</cnm>
               </au>
            </aug>
            <source>Effective Health Care</source>
            <pubdate>1999</pubdate>
            <volume>5</volume>
            <fpage>1</fpage>
         </bibl>
         <bibl id="B4">
            <title>
               <p>Improving the quality of health care in the United Kingdom and the United States: a framework for change</p>
            </title>
            <aug>
               <au>
                  <snm>Ferlie</snm>
                  <fnm>EB</fnm>
               </au>
               <au>
                  <snm>Shortell</snm>
                  <fnm>SM</fnm>
               </au>
            </aug>
            <source>Milbank Quarterly</source>
            <pubdate>2001</pubdate>
            <volume>79</volume>
            <fpage>281</fpage>
            <lpage>315</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1111/1468-0009.00206</pubid>
                  <pubid idtype="pmpid" link="fulltext">11439467</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B5">
            <title>
               <p>Diffusion of innovations in service organizations: systematic review and recommendations</p>
            </title>
            <aug>
               <au>
                  <snm>Greenhalgh</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Robert</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>MacFarlane</snm>
                  <fnm>F</fnm>
               </au>
               <au>
                  <snm>Bate</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Kyriakidou</snm>
                  <fnm>O</fnm>
               </au>
            </aug>
            <source>Milbank Quarterly</source>
            <pubdate>2004</pubdate>
            <volume>82</volume>
            <fpage>581</fpage>
            <lpage>629</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1111/j.0887-378X.2004.00325.x</pubid>
                  <pubid idtype="pmpid" link="fulltext">15595944</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B6">
            <title>
               <p>Effectiveness and efficiency of guideline dissemination and implementation strategies</p>
            </title>
            <aug>
               <au>
                  <snm>Grimshaw</snm>
                  <fnm>JM</fnm>
               </au>
               <au>
                  <snm>Thomas</snm>
                  <fnm>RE</fnm>
               </au>
               <au>
                  <snm>MacLennan</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Fraser</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Ramsay</snm>
                  <fnm>CR</fnm>
               </au>
               <au>
                  <snm>Vale</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Whitty</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Eccles</snm>
                  <fnm>MP</fnm>
               </au>
               <au>
                  <snm>Matowe</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Shirran</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Wensing</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Dijkstra</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Donaldson</snm>
                  <fnm>C</fnm>
               </au>
            </aug>
            <source>Health Technology Assess</source>
            <pubdate>2004</pubdate>
            <volume>8</volume>
            <issue>6</issue>
            <fpage>iii</fpage>
            <lpage>iv</lpage>
            <note>1-72</note>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pubmed">14960256</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B7">
            <title>
               <p>From best evidence to best practice: effective implementation of change in patients' care</p>
            </title>
            <aug>
               <au>
                  <snm>Grol</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Grimshaw</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Lancet</source>
            <pubdate>2003</pubdate>
            <volume>362</volume>
            <fpage>1225</fpage>
            <lpage>1230</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S0140-6736(03)14546-1</pubid>
                  <pubid idtype="pmpid" link="fulltext">14568747</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B8">
            <title>
               <p>No magic bullets: a systematic review of 102 trials of interventions to improve professional practice</p>
            </title>
            <aug>
               <au>
                  <snm>Oxman</snm>
                  <fnm>AD</fnm>
               </au>
               <au>
                  <snm>Thomson</snm>
                  <fnm>MA</fnm>
               </au>
               <au>
                  <snm>Davis</snm>
                  <fnm>DA</fnm>
               </au>
               <au>
                  <snm>Haynes</snm>
                  <fnm>RB</fnm>
               </au>
            </aug>
            <source>CMAJ</source>
            <pubdate>1995</pubdate>
            <volume>153</volume>
            <fpage>1423</fpage>
            <lpage>1431</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1487455</pubid>
                  <pubid idtype="pmpid">7585368</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B9">
            <title>
               <p>Interventions to change health behaviours: evidence based or evidence inspired?</p>
            </title>
            <aug>
               <au>
                  <snm>Michie</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Abraham</snm>
                  <fnm>C</fnm>
               </au>
            </aug>
            <source>Psychology and Health</source>
            <pubdate>2004</pubdate>
            <volume>19</volume>
            <fpage>29</fpage>
            <lpage>49</lpage>
            <xrefbib>
               <pubid idtype="doi">10.1080/0887044031000141199</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B10">
            <title>
               <p>Diffusion of innovations</p>
            </title>
            <aug>
               <au>
                  <snm>Rogers</snm>
                  <fnm>EM</fnm>
               </au>
            </aug>
            <publisher>New York, NY; London: Free Press</publisher>
            <edition>5</edition>
            <pubdate>2003</pubdate>
         </bibl>
         <bibl id="B11">
            <title>
               <p>Developing and evaluating complex interventions: new guidance</p>
            </title>
            <aug>
               <au>
                  <snm>Craig</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Dieppe</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Macintyre</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Michie</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Nazareth</snm>
                  <fnm>I</fnm>
               </au>
               <au>
                  <snm>Pettigrew</snm>
                  <fnm>M</fnm>
               </au>
            </aug>
            <publisher>London: Medical Research Council</publisher>
            <pubdate>2008</pubdate>
         </bibl>
         <bibl id="B12">
            <title>
               <p>Measuring climate for work group innovation: development and validation of the team climate inventory</p>
            </title>
            <aug>
               <au>
                  <snm>Anderson</snm>
                  <fnm>NR</fnm>
               </au>
               <au>
                  <snm>West</snm>
                  <fnm>MA</fnm>
               </au>
            </aug>
            <source>Journal of Organizational Behaviour</source>
            <pubdate>1998</pubdate>
            <volume>19</volume>
            <fpage>235</fpage>
            <lpage>258</lpage>
            <xrefbib>
               <pubid idtype="doi">10.1002/(SICI)1099-1379(199805)19:3&lt;235::AID-JOB837>3.0.CO;2-C</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B13">
            <title>
               <p>Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes</p>
            </title>
            <aug>
               <au>
                  <snm>Baker</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Camosso-Stefinovic</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Gillies</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Shaw</snm>
                  <fnm>EJ</fnm>
               </au>
               <au>
                  <snm>Cheater</snm>
                  <fnm>F</fnm>
               </au>
               <au>
                  <snm>Flottorp</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Robertson</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Cochrane Database of Systematic Reviews</source>
            <pubdate>2010</pubdate>
            <issue>3</issue>
            <fpage>CD005470</fpage>
            <note>Doi: 10.1002/14651858.CD005470</note>
         </bibl>
         <bibl id="B14">
            <title>
               <p>When is it cost effective to change the behaviour of health professionals?</p>
            </title>
            <aug>
               <au>
                  <snm>Mason</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Freemantle</snm>
                  <fnm>N</fnm>
               </au>
               <au>
                  <snm>Nazareth</snm>
                  <fnm>I</fnm>
               </au>
               <au>
                  <snm>Eccles</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Haines</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Drummond</snm>
                  <fnm>M</fnm>
               </au>
            </aug>
            <source>JAMA</source>
            <pubdate>2001</pubdate>
            <volume>286</volume>
            <fpage>2988</fpage>
            <lpage>2992</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1001/jama.286.23.2988</pubid>
                  <pubid idtype="pmpid" link="fulltext">11743840</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B15">
            <title>
               <p>A spotters guide to study designs</p>
            </title>
            <aug>
               <au>
                  <snm>Glasziou</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Heneghan</snm>
                  <fnm>C</fnm>
               </au>
            </aug>
            <source>Evidence Based Medicine</source>
            <pubdate>2009</pubdate>
            <volume>14</volume>
            <fpage>37</fpage>
            <lpage>38</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1136/ebm.14.2.37-a</pubid>
                  <pubid idtype="pmpid" link="fulltext">19332594</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B16">
            <title>
               <p>Comparing methodologies for the cost estimation of hospital services</p>
            </title>
            <aug>
               <au>
                  <snm>Tan</snm>
                  <fnm>SS</fnm>
               </au>
               <au>
                  <snm>Rutten</snm>
                  <fnm>FF</fnm>
               </au>
               <au>
                  <snm>van Ineveld</snm>
                  <fnm>BM</fnm>
               </au>
               <au>
                  <snm>Redekop</snm>
                  <fnm>WK</fnm>
               </au>
               <au>
                  <snm>Hakkaart-van Roijen</snm>
                  <fnm>L</fnm>
               </au>
            </aug>
            <source>European Journal of Health Economics</source>
            <pubdate>2009</pubdate>
            <volume>10</volume>
            <fpage>39</fpage>
            <lpage>45</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1007/s10198-008-0101-x</pubid>
                  <pubid idtype="pmpid" link="fulltext">18340472</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B17">
            <title>
               <p>Quasi-Experimentation: Design and Analysis Issues for Field Settings</p>
            </title>
            <aug>
               <au>
                  <snm>Cook</snm>
                  <fnm>TD</fnm>
               </au>
               <au>
                  <snm>Campbell</snm>
                  <fnm>DT</fnm>
               </au>
            </aug>
            <publisher>Chicago: Rand McNally</publisher>
            <pubdate>1979</pubdate>
         </bibl>
         <bibl id="B18">
            <title>
               <p>Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behaviour change strategies</p>
            </title>
            <aug>
               <au>
                  <snm>Ramsey</snm>
                  <fnm>CR</fnm>
               </au>
               <au>
                  <snm>Matowe</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Grilli</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Grimshaw</snm>
                  <fnm>JM</fnm>
               </au>
               <au>
                  <snm>Thomas</snm>
                  <fnm>RE</fnm>
               </au>
            </aug>
            <source>International Journal of Technology Assessment in Health Care</source>
            <pubdate>2003</pubdate>
            <volume>19</volume>
            <fpage>613</fpage>
            <lpage>623</lpage>
            <xrefbib>
               <pubid idtype="pmpid">15095767</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B19">
            <title>
               <p>Process evaluation on quality improvement interventions</p>
            </title>
            <aug>
               <au>
                  <snm>Hulscher</snm>
                  <fnm>MEJL</fnm>
               </au>
               <au>
                  <snm>Laurant</snm>
                  <fnm>MGH</fnm>
               </au>
               <au>
                  <snm>Grol</snm>
                  <fnm>RPTM</fnm>
               </au>
            </aug>
            <source>Quality and Safety in Health Care</source>
            <pubdate>2003</pubdate>
            <volume>12</volume>
            <fpage>40</fpage>
            <lpage>46</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1136/qhc.12.1.40</pubid>
                  <pubid idtype="pmcid">1743654</pubid>
                  <pubid idtype="pmpid" link="fulltext">12571344</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B20">
            <title>
               <p>Fidelity and delivery of a physical activity intervention: predictors and consequences</p>
            </title>
            <aug>
               <au>
                  <snm>Hardeman</snm>
                  <fnm>W</fnm>
               </au>
               <au>
                  <snm>Michie</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Fanshawe</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Prevost</snm>
                  <fnm>AT</fnm>
               </au>
               <au>
                  <snm>McLoughlin</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Kinmouth</snm>
                  <fnm>AL</fnm>
               </au>
            </aug>
            <source>Psychology and Health</source>
            <pubdate>2008</pubdate>
            <volume>23</volume>
            <fpage>11</fpage>
            <lpage>24</lpage>
            <xrefbib>
               <pubid idtype="doi">10.1080/08870440701615948</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B21">
            <title>
               <p>Qualitative research in health care: analysing qualitative data</p>
            </title>
            <aug>
               <au>
                  <snm>Pope</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Ziebland</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Mays</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>British Medical Journal</source>
            <pubdate>2000</pubdate>
            <volume>320</volume>
            <fpage>114</fpage>
            <lpage>120</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1136/bmj.320.7227.114</pubid>
                  <pubid idtype="pmcid">1117368</pubid>
                  <pubid idtype="pmpid" link="fulltext">10625273</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
      </refgrp>
   </bm>
</art>

