<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
	<ui>1748-5908-1-5</ui>
	<ji>1748-5908</ji>
	<fm>
		<dochead>Debate</dochead>
		<bibl>
			<title>
				<p>Designing theoretically-informed implementation interventions: Fine in theory, but evidence of effectiveness in practice is needed</p>
			</title>
			<aug>
				<au id="A1">
					<snm>Bhattacharyya</snm>
					<fnm>Onil</fnm>
					<insr iid="I1"/>
					<email>onil.bhattacharyya@utoronto.ca</email>
				</au>
				<au id="A2">
					<snm>Reeves</snm>
					<fnm>Scott</fnm>
					<insr iid="I2"/>
					<insr iid="I3"/>
					<insr iid="I4"/>
					<email>scott.reeves@utoronto.ca</email>
				</au>
				<au id="A3">
					<snm>Garfinkel</snm>
					<fnm>Susan</fnm>
					<insr iid="I5"/>
					<email>susan.garfinkel@ices.on.ca</email>
				</au>
				<au id="A4" ca="yes">
					<snm>Zwarenstein</snm>
					<fnm>Merrick</fnm>
					<insr iid="I1"/>
					<insr iid="I5"/>
					<insr iid="I6"/>
					<email>merrick.zwarenstein@ices.on.ca</email>
				</au>
			</aug>
			<insg>
				<ins id="I1">
					<p>Department of Health Policy, Management and Evaluation, University of Toronto, Ontario, Canada</p>
				</ins>
				<ins id="I2">
					<p>Department of Family &amp; Community Medicine, University of Toronto, Ontario, Canada</p>
				</ins>
				<ins id="I3">
					<p>Centre for Faculty Development, St. Michael's Hospital, Toronto, Ontario, Canada</p>
				</ins>
				<ins id="I4">
					<p>Wilson Centre for Research in Education, University of Toronto, Ontario, Canada</p>
				</ins>
				<ins id="I5">
					<p>Sunnybrook and Women's College Health Sciences Centre, Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada</p>
				</ins>
				<ins id="I6">
					<p>Knowledge Translation Programme, University of Toronto at St. Michael's Hospital, Toronto, Ontario, Canada</p>
				</ins>
			</insg>
			<source>Implementation Science</source>
			<issn>1748-5908</issn>
			<pubdate>2006</pubdate>
			<volume>1</volume>
			<issue>1</issue>
			<fpage>5</fpage>
			<url>http://www.implementationscience.com/content/1/1/5</url>
			<xrefbib>
				<pubidlist><pubid idtype="pmpid">16722583</pubid><pubid idtype="doi">10.1186/1748-5908-1-5</pubid>
				</pubidlist></xrefbib>
		</bibl>
		<history>
			<rec>
				<date>
					<day>14</day>
					<month>11</month>
					<year>2005</year>
				</date>
			</rec>
			<acc>
				<date>
					<day>23</day>
					<month>2</month>
					<year>2006</year>
				</date>
			</acc>
			<pub>
				<date>
					<day>23</day>
					<month>2</month>
					<year>2006</year>
				</date>
			</pub>
		</history>
		<cpyrt>
			<year>2006</year>
			<collab>Bhattacharyya et al; licensee BioMed Central Ltd.</collab>
			<note>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</note>
		</cpyrt>
		<abs>
			<sec>
				<st>
					<p>Abstract</p>
				</st>
				<p>The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) authors assert that a key weakness in implementation research is the unknown applicability of a given intervention outside its original site and problem, and suggest that use of explicit theory offers an effective solution. This assertion is problematic for three primary reasons. First, the presence of an underlying theory does not necessarily ease the task of judging the applicability of a piece of empirical evidence. Second, it is not clear how to translate theory reliably into intervention design, which undoubtedly involves the diluting effect of "common sense." Thirdly, there are many theories, formal and informal, and it is not clear why any one should be given primacy. To determine whether explicitly theory-based interventions are, on average, more effective than those based on implicit theories, pragmatic trials are needed. Until empirical evidence is available showing the superiority of theory-based interventions, the use of theory should not be used as a basis for assessing the value of implementation studies by research funders, ethics committees, editors or policy decision makers.</p>
			</sec>
		</abs>
	</fm>
	<bdy>
		<sec>
			<st>
				<p>Introduction</p>
			</st>
			<p>The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) authors assert <abbrgrp><abbr bid="B1">1</abbr><abbr bid="B2">2</abbr></abbrgrp> that a key weakness in implementation research is the unknown applicability of a given intervention outside its original site and problem. They argue that more widely <b><it>applicable </it></b>interventions (and imply that more <b><it>effective </it></b>interventions) should be created by: (1) using explicit behavioral theories to quantitatively characterize the determinants of professionals' behavior choices, (2) identifying predictors that are common across many settings and problems, and (3) designing interventions based on the most powerful predictors. Though this view is logical, it is problematic, and not based on empirical evidence.</p>
			<sec>
				<st>
					<p>First, the presence of an underlying theory does not necessarily ease the task of judging the applicability of a piece of empirical evidence</p>
				</st>
				<p>Judgment on the wider applicability of a piece of evidence proceeds by induction, and is not mechanistically related to the underlying theory from which grew the empirical study. Behavioral theory is possibly less predictive of behavior than physiological theory is of physiology. It is further diluted in its predictive power by contextual differences, such as health service design and medical cultural differences whose effects on choice cannot be directly translated into the internal psychological forces which are the subject of behavioral theory. We should also bear in mind that the physiological theory predicting a cardio-protective physiological effect for hormone replacement therapy was so convincing that millions of women were prescribed it, but in empirical studies it failed to achieve the predicted benefits, and indeed resulted in substantial harm <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>. Formal theory may be an unreliable predictor of outcome even within the theorized group, and thus a poor framework for extrapolation of outcome to other settings and subjects.</p>
			</sec>
			<sec>
				<st>
					<p>Secondly, it is not clear how to translate theory rigidly into intervention design</p>
				</st>
				<p>There is no reproducible, algorithmically operationalised process for taking predictor variables from a quantitative theory based descriptive study and turning them into elements of an intervention. Since this process will be diluted by human judgment, which is influenced by many factors other than the theory (i.e., knowledge of context and personal prior beliefs), we believe that theory is contributing less to this part of the process than it appears. Theory could be merely a cover for common sense, or a grounded approach to designing an intervention.</p>
			</sec>
			<sec>
				<st>
					<p>Thirdly, there are many theories, formal and informal, and it is not clear why any one should be given primacy</p>
				</st>
				<p>Theories overlap and contradict each other. Even theoreticians are forced to distill from the multitude of testable formal theories relevant to professional behavior change a common core of domains; in itself a new, meta-theory, but because of its reverse engineering, based upon little more than common sense <abbrgrp><abbr bid="B4">4</abbr></abbrgrp>. Many formal theories and concepts in the field of psychology had already been described recognizably using lay terms and ideas, suggesting that these ideas are accessible without theories. We live in our own psyche, observe ourselves, reflect on our situation, and ask our colleagues why they make choices. Others observe our choices, directly, through inquiry or by analysis of routine data, and speculate on its determinants. Though not particularly rigorous, all these approaches are plausible sources of informal 'theories.' As such, they can explain professional behavior and inspire ideas for the design of interventions to change behavior, which can then be tested.</p>
			</sec>
			<sec>
				<st>
					<p>How could we decide whether formal theory offers the best approach for designing interventions to change behavior?</p>
				</st>
				<p>Abstract arguments on this question will continue inconclusively <abbrgrp><abbr bid="B5">5</abbr></abbrgrp>. On the one hand, theory development may lead to a greater meta-understanding and move the field forward. On the other hand, the phenomena being studied may be so complex that all this work will not lead to theories with greater predictive power than implicit theory or "common sense." The exercise may be so time-consuming (e.g., the 20 to 80 years spent conceptualizing cognitive behavioural theory is Eccles et al.'s example <abbrgrp><abbr bid="B2">2</abbr></abbrgrp>) that it may not be a particularly efficient way to proceed. We need an empirical answer to Eccles et al.'s assertion that "better evaluations of what does and does not work in implementation research will only be possible with the explicit use of theoretically informed interventions." We need to know, in practice, whether interventions to change professional behavior, designed using formal theory applied in a predefined and reproducible manner, are more effective at changing the targeted behavior than alternative, less theory bound approaches. Given a sufficient set of replicates, across a reasonable range of settings and professional behavior choices, we can reach an empirical answer. One such randomized trial is underway (TRYME protocol, Francis et al, in submission).</p>
				<p>Until there is empirical evidence that interventions designed using theories are generally superior in impact on behavior choice to interventions not so designed, the choice to use or not use formal theory in implementation research should remain a personal judgment. Research funders, ethics committees, systematic reviewers, editors, and policy decision makers should not in any way restrict this choice.</p>
			</sec>
		</sec>
		<sec>
			<st>
				<p>Competing interests</p>
			</st>
			<p>The author(s) declare that they have no competing interests.</p>
		</sec>
		<sec>
			<st>
				<p>Authors' contributions</p>
			</st>
			<p>OB wrote the first draft, MZ suggested the idea for the paper and commented on all of the drafts, SR wrote the second draft, and SG modified subsequent drafts. All authors read and approved the final manuscript.</p>
		</sec>
	</bdy>
	<bm>
		<ack>
			<sec>
				<st>
					<p>Acknowledgements</p>
				</st>
				<p>We would like to acknowledge the ICEBeRG group for a very lively and enriching discussion on this subject, in particular Martin Eccles and Jeremy Grimshaw.</p>
			</sec>
		</ack>
		<refgrp>
			<bibl id="B1">
				<title>
					<p>The role of theory in designing healthcare professional behaviour change interventions: the arguments for. <it>in this issue of Biomed HSR/Implementation science</it></p>
				</title>
				<aug>
					<au>
						<cnm>KTICEBeRG group</cnm>
					</au>
				</aug>
			</bibl>
			<bibl id="B2">
				<title>
					<p>Changing the behaviour of healthcare professionals: the use of theory in promoting the uptake of research findings</p>
				</title>
				<aug>
					<au>
						<snm>Eccles</snm>
						<fnm>M</fnm>
					</au>
					<au>
						<snm>Grimshaw</snm>
						<fnm>J</fnm>
					</au>
					<au>
						<snm>Walker</snm>
						<fnm>A</fnm>
					</au>
					<au>
						<snm>Johnston</snm>
						<fnm>M</fnm>
					</au>
					<au>
						<snm>Pitts</snm>
						<fnm>N</fnm>
					</au>
				</aug>
				<source>Journal of Clinical Epidemiology</source>
				<pubdate>2005</pubdate>
				<volume>58</volume>
				<fpage>107</fpage>
				<lpage>112</lpage>
				<xrefbib>
					<pubidlist>
						<pubid idtype="doi">10.1016/j.jclinepi.2004.09.002</pubid>
						<pubid idtype="pmpid" link="fulltext">15680740</pubid>
					</pubidlist>
				</xrefbib>
			</bibl>
			<bibl id="B3">
				<title>
					<p>Principal results from the Women's Health Initiative randomized controlled trial</p>
				</title>
				<aug>
					<au>
						<cnm>Writing Group for the Women's Health Initiative Investigators. Risks and benefits of estrogen plus progestin in healthy postmenopausal women</cnm>
					</au>
				</aug>
				<source>JAMA</source>
				<pubdate>2002</pubdate>
				<volume>288</volume>
				<fpage>321</fpage>
				<lpage>33</lpage>
				<xrefbib>
					<pubidlist>
						<pubid idtype="doi">10.1001/jama.288.3.321</pubid>
						<pubid idtype="pmpid" link="fulltext">12117397</pubid>
					</pubidlist>
				</xrefbib>
			</bibl>
			<bibl id="B4">
				<title>
					<p>Making psychological theory useful for implementing evidence based practice: a consensus approach</p>
				</title>
				<aug>
					<au>
						<snm>Michie</snm>
						<fnm>S</fnm>
					</au>
					<au>
						<snm>Johnston</snm>
						<fnm>M</fnm>
					</au>
					<au>
						<snm>Abraham</snm>
						<fnm>C</fnm>
					</au>
					<au>
						<snm>Lawton</snm>
						<fnm>R</fnm>
					</au>
					<au>
						<snm>Parker</snm>
						<fnm>D</fnm>
					</au>
					<au>
						<snm>Walker</snm>
						<fnm>A</fnm>
					</au>
					<au>
						<cnm>on behalf of the "Psychological Theory" group</cnm>
					</au>
				</aug>
				<source>Qual Saf Health Care</source>
				<pubdate>2005</pubdate>
				<volume>14</volume>
				<fpage>26</fpage>
				<lpage>33</lpage>
				<xrefbib>
					<pubidlist>
						<pubid idtype="doi">10.1136/qshc.2004.011155</pubid>
						<pubid idtype="pmpid" link="fulltext">15692000</pubid>
					</pubidlist>
				</xrefbib>
			</bibl>
			<bibl id="B5">
				<title>
					<p>The OFF theory of research utilization</p>
				</title>
				<aug>
					<au>
						<snm>Oxman</snm>
						<fnm>A</fnm>
					</au>
					<au>
						<snm>Flottorp</snm>
						<fnm>S</fnm>
					</au>
					<au>
						<snm>Fretheim</snm>
						<fnm>A</fnm>
					</au>
				</aug>
				<source>Journal of Clinical Epidemiology</source>
				<pubdate>2005</pubdate>
				<volume>58</volume>
				<fpage>113</fpage>
				<lpage>116</lpage>
				<xrefbib>
					<pubidlist>
						<pubid idtype="doi">10.1016/j.jclinepi.2004.10.002</pubid>
						<pubid idtype="pmpid" link="fulltext">15680741</pubid>
					</pubidlist>
				</xrefbib>
			</bibl>
		</refgrp>
	</bm>
</art>
