Skip to main content

Understanding effects in reviews of implementation interventions using the Theoretical Domains Framework

Abstract

Background

Behavioural theory can be used to better understand the effects of behaviour change interventions targeting healthcare professional behaviour to improve quality of care. However, the explicit use of theory is rarely reported despite interventions inevitably involving at least an implicit idea of what factors to target to implement change.

There is a quality of care gap in the post-fracture investigation (bone mineral density (BMD) scanning) and management (bisphosphonate prescription) of patients at risk of osteoporosis. We aimed to use the Theoretical Domains Framework (TDF) within a systematic review of interventions to improve quality of care in post-fracture investigation. Our objectives were to explore which theoretical factors the interventions in the review may have been targeting and how this might be related to the size of the effect on rates of BMD scanning and osteoporosis treatment with bisphosphonate medication.

Methods

A behavioural scientist and a clinician independently coded TDF domains in intervention and control groups. Quantitative analyses explored the relationship between intervention effect size and total number of domains targeted, and as number of different domains targeted.

Results

Nine randomised controlled trials (RCTs) (10 interventions) were analysed. The five theoretical domains most frequently coded as being targeted by the interventions in the review included “memory, attention and decision processes”, “knowledge”, “environmental context and resources”, “social influences” and “beliefs about consequences”. Each intervention targeted a combination of at least four of these five domains. Analyses identified an inverse relationship between both number of times and number of different domains coded and the effect size for BMD scanning but not for bisphosphonate prescription, suggesting that the more domains the intervention targeted, the lower the observed effect size.

Conclusions

When explicit use of theory to inform interventions is absent, it is possible to retrospectively identify the likely targeted factors using theoretical frameworks such as the TDF. In osteoporosis management, this suggested that several likely determinants of healthcare professional behaviour appear not yet to have been considered in implementation interventions. This approach may serve as a useful basis for using theory-based frameworks such as the TDF to retrospectively identify targeted factors within systematic reviews of implementation interventions in other implementation contexts.

Peer Review reports

Background

Changing the behaviour of healthcare professionals is key to achieving the goals of evidence-based medicine, ensuring that research findings are translated into clinical practice and the best possible outcomes for patients are realised. This is not an easy task to carry out systematically, routinely and uniformly, but it has been shown to be more effective if interventions are based on evidence-based principles drawn from theories of behaviour and behaviour change [1, 2].

Theory can be used prospectively to identify and describe the processes involved in existing patterns of care and the barriers and facilitators to change that could be targeted by an intervention [3, 4]. Theory can then be used to guide the development and content of the intervention, giving an understanding of how and why the intervention is designed to work and a framework for testing the mechanism(s) underlying behaviour change [57]. The explicit use of theory in this way not only provides a generalizable framework facilitating the replication of interventions in other settings [8], but there is also evidence that behaviour change interventions informed by theory are more effective than those that are not [1, 2, 9]. Despite increasing recognition that the design of behaviour change interventions should be based on relevant theories [8, 10, 11], systematic reviews of behaviour change interventions applied to change the behaviour of healthcare professionals show that theory is rarely used to explicitly underpin intervention methods [12]. Thus, even if positive effects are reported, we are left with little understanding of the behaviour change processes responsible, no basis for choosing between different types of intervention, and little to inform the design of future interventions.

Although interventions may not always be based on a theory explicitly, it is inevitable that any intervention designer will have at least an implicit idea of what factors to target to promote change. Such implicit theories may be helpful for the specific setting in which they are used, but without making them explicit, they cannot be tested and replicated. Given the likely preponderance of implicit theories, it may be useful to retrospectively identify which factors implementation interventions report targeting and the extent to which such factors map onto pre-existing theoretical factors. Such a process would be inferential but would nevertheless provide a better capacity to identify what factors seem to be targeted and thus contribute to a cumulative evidence base for designing future interventions.

Retrospective coding of targeted factors requires a sufficiently broad framework of theoretical factors to capture the potential range of possible targeted factors. The Theoretical Domains Framework (TDF) [13] was developed and validated [14] to summarise the array of psychological theory underpinning behaviour change into distinct factors.

The TDF provides a useful basis for both assessing implementation problems and for identifying potential modifiable factors to target when designing interventions [15]. It is increasingly used as a tool for conducting interviews and designing questionnaires [1620], but it may also be used as a basis for understanding what factors may have been targeted for change in an intervention. This has the potential to enhance understanding of the behaviour change processes inherent in the transfer of evidence-based guidelines into practice, but to our knowledge, the TDF has yet to be applied in this way. Using the clinical setting of post-fracture investigation and management of patients at risk of osteoporosis, we aimed to conduct a secondary analysis of a systematic review using the TDF to identify the factors targeted by the interventions.

Post-fracture management of osteoporosis risk

The post-fracture management of patients at risk of osteoporosis is an area of patient care in which there is evidence of a large quality of care gap [2130] despite widely available evidence-based guidelines [3135]. Two key post-fracture management behaviours for which a quality gap has been widely documented include primary and secondary healthcare professionals scanning bone mineral density and prescribing anti-resorptive therapy.

We conducted a systematic review of interventions (reported elsewhere) [36] aiming to improve the investigation and management of osteoporosis in patients following fragility fracture. For both of the main outcomes of the review (bone mineral density (BMD) scanning and osteoporosis treatment with anti-resorptive therapy), all nine identified studies [3745] reported a positive effect of the intervention, with an overall 36 % absolute increase in BMD scanning rates and a 20 % absolute increase in treatment rates.

Whilst the review provided a compelling case that implementation interventions can be effective in improving scanning and treatment rates, replicability of these interventions is undermined by a lack of capacity to understand how the intervention had its effect, i.e. what factors did the interventions target to promote change.

The aim of this paper was to explore, using the TDF, the factors that the interventions may have been targeting, how this might be related to the main outcomes of the systematic review (rates of BMD scanning and osteoporosis treatment with bisphosphonate medication) and highlighting opportunities for targeting factors that seem to be less frequently considered but may be worth exploring in future interventions.

Methods

Description of interventions

As part of the systematic review, a verbatim description of the interventions as delivered and the care received by the control group was extracted and reported. The authors of the studies included in the systematic review were contacted by email and informed of our intention to carry out a secondary analysis of their interventions. It was requested in the email that firstly they verify whether or not they agreed with the details of their intervention which were identified and described in the email and secondly send us any additional materials that were given to those delivering the intervention or any protocols or linked studies that described the intervention, how it was carried out and what it was targeting, in more detail. Those nominated as the corresponding author were contacted initially, but if the email address was no longer functioning, alternative authors were tried. A first reminder was sent 2 weeks after the initial email, a second reminder 2 weeks after that, and the authors were then given a further 2 weeks to respond.

Coding of the TDF domains targeted by the interventions

We used the 14 domains from TDFv2 [14] as a basis for coding TDF domains. The TDF domains that appeared to be targeted by the interventions and within the control groups were identified and coded independently by two reviewers (EAL, a clinician and JP, a behavioural scientist), using a data extraction form designed for the purpose (Additional file 1). We used domains as well as constructs within domains to inform coding decisions within domains, using construct definitions as described by Cane et al. [14]. The data extraction form was tested on one included study. The coding of each domain was supported by evidence from the text. However, this required inferences to be made about which domains the authors were intending to target, as this was never explicitly stated in the text. The descriptions of the interventions were studied and each aspect that was judged to be targeting a domain with respect to the behaviours of BMD scanning and osteoporosis treatment with anti-resorptive medication was coded. The domains were also coded according to the individual targeted, i.e. patient or healthcare professional. Inter-rater reliability was calculated prior to resolving discrepancies (Cohen’s kappa: Κ = 0.507 (moderate agreement [46]). Following discussion with a third party (MPE), 100 % agreement was achieved.

Quantitative analysis

The relationship between the total number of domains coded and effect size of the intervention was explored using Pearson correlations (two-tailed) for both BMD scanning and osteoporosis treatment with anti-resorptive therapy. “Total number of domains” is a sum of every time any domain was coded and does not take into account the recipient of the intervention. For example, if “knowledge” was coded twice for the primary care physician (PCP) and once for the patient, and “beliefs about consequences” was coded three times for the PCP, this would add up to a total of six times. The total number of times the domains were coded in the control groups of the studies was subtracted from the total number of times the domains were coded in the intervention groups. This was a subtraction of total number of domains and did not take into consideration which domains were coded in each group. To investigate whether subtracting domains that appear in the control group impacted on the findings, we conducted a sensitivity analysis whereby all domains coded in the intervention group were counted irrespective of whether also coded in the control group.

The relationship between the number of different domains coded and the effect size of the intervention was also explored using Pearson correlations for both BMD scanning and osteoporosis treatment with anti-resorptive therapy. The recipient of the intervention was not taken into account. For example, if “knowledge” was coded five times, “skills” once and “social influence” twice, this would mean that three different domains had been coded. The maximum possible number of different domains coded was 14 (the number of TDF domains). The number of different domains coded in the control group was subtracted from the number of different domains coded in the intervention group. A sensitivity analysis was performed in which the subtraction of control groups was not done, to examine the effect of the subtraction on the result.

Results

Descriptions of the interventions and control care

With regard to the development of the intervention, only two studies reported consulting with representatives of the intended professional recipients [40, 43]. Six studies reported the evidence base for the intervention [37, 38, 4043]. Patient involvement was not reported by any of the studies. In four studies, the authors reported specific barriers to change that the intervention was tailored to address [37, 40, 42, 44]. Only one study reported that they had carried out substantial exploratory work to identify them [40] (literature reviews and qualitative in-depth interviews with healthcare professionals). In two of the four studies, barriers were not identified and discussed until the end of the paper [37, 44]. Only one study designed the intervention to address all of the identified barriers [40]; the others offered no explanation as to why they had chosen particular barriers to target over others, with one study selecting a single barrier from a long list of barriers [44].

The coding for the domains targeted in the intervention and control groups for each of the studies is shown in Table 1. A more detailed description of the coding as well as the care given to intervention and control groups by study is presented in Additional file 2.

Table 1 Coding of domains targeted in the intervention and control groups

Table 2 presents the number of times each of the domains were coded with respect to BMD scanning and osteoporosis treatment with anti-resorptive therapy in the intervention group of each of the studies. The recipient of the intervention, i.e. patient or PCP, was also specified.

Table 2 Number of times each domain coded in the intervention group

The domain coded most frequently was “memory, attention and decision processes” (10 of 10 interventions; BMD scanning coded 33 times; treatment coded 29 times). The second most frequently coded domain was “knowledge” (10 of 10 interventions; BMD scanning coded 21 times; treatment coded 20 times), closely followed by “environmental context and resources” (9 of 10 interventions; BMD scanning coded 16 times; treatment coded 13 times), “social influences” (9 of 10 interventions; BMD scanning coded 11 times; treatment coded 11 times) and then “beliefs about consequences” (5 of 10 interventions; BMD scanning coded 9 times; treatment coded 9 times). In all of the studies, there was a combination of at least four of these five domains. There were five domains that were never coded: “social/professional role and identity”; “optimism”; “reinforcement”; “intentions”; and “behavioural regulation”. The remaining four domains (“skills”; “beliefs about capabilities”; “goals”; “emotion”) were coded only once or twice with respect to both BMD scanning and treatment.

Table 3 presents the number of times each of the domains were coded with respect to BMD scanning and osteoporosis treatment with anti-resorptive therapy in the control groups of each of the studies.

Table 3 Number of times each domain coded in the control group

We identified and coded domains in the control group for only five of the studies. This was due to the poor descriptions of the care given to the control groups. Fewer elements were coded, and these were spread over fewer domains. The domains most frequently identified in the description of the control group were again “memory, attention and decision processes” (4 of 9 control groups; BMD scanning coded 7 times; treatment coded 7 times), “knowledge” (4 of 9 control groups; BMD scanning coded 4 times; treatment coded 4 times) and “social influences” (3 of 9 control groups; BMD scanning coded 4 times; treatment coded 4 times). “Beliefs about consequences” and “environmental context and resources” were coded once each for both BMD scanning and treatment.

Across the studies described as having been tailored to identified barriers and facilitators, each reported lack of clarity regarding which physician was responsible for the investigation and management of osteoporosis following a fragility fracture as a significant barrier but the interventions themselves were not described to target the “social/professional role and identity” domain for any of these studies. The interventions instead addressed this barrier either by taking the behaviour out of the hands of the PCP altogether (“environmental context and resources”) or by using reminders for the PCP to perform the behaviour (“memory, attention and decision processes”).

On the whole, the remainder of the barriers and facilitators that were identified in the studies were reflected in the frequency of the domains coded, with the exception of the “social influences” domain. This was the fourth most frequently coded domain and yet was only referred to in one study as being important in changing health care professionals’ behaviour [41]. Only one study addressed the “social influences” domain, by selecting local opinion leaders that had been identified as educationally influential physician peers in the area of osteoporosis by PCPs through a validated questionnaire prior to the intervention [43].

Relationship between total number of times the domains are coded within an intervention and effect size

Table 4 summarises the total number of times the domains were coded, for each study intervention and control group by BMD scanning and osteoporosis treatment with anti-resorptive therapy. Scatterplots are presented in Fig. 1.

Table 4 Total number of times domains coded within intervention and control groups
Fig. 1
figure 1

Scatterplot of total number of times the domains were coded and intervention effect size (BMD scanning and treatment with anti-resorptive therapy)

There was a statistically significant inverse relationship between the total number of times the domains were coded within an intervention and the post-intervention risk difference for BMD scanning, r = −0.831, p < 0.05 but not for treatment (r = −0.615, p = 0.058). The sensitivity analysis (not subtracting the number of control group domains) showed similar results (BMD scanning: r = −0.704, p < 0.05; treatment: r = −0.603, p = 0.065).

Relationship between the number of different domains coded within an intervention and the effect size

Table 5 summarises the number of different domains coded in the intervention and control groups of each of the studies. Scatterplots are presented in Fig. 2.

Table 5 Number of different domains coded within intervention and control groups and intervention effect size
Fig. 2
figure 2

Scatterplot of number of different domains coded and intervention effect size (BMD scanning and treatment with anti-resorptive therapy)

There was a statistically significant inverse relationship between number of different domains coded within an intervention and the post-intervention risk difference for BMD scanning (r = −0.848, p < 0.05) but not for treatment (r = −0.530, p = 0.115). The sensitivity analysis (no subtraction of control group domains) showed similar results for BMD scanning (r = −0.728, p < 0.05), but for treatment, the relationship became statistically significant (r = −0.644, p < 0.05).

Discussion

We conducted a theory-based analysis of the interventions from nine randomised controlled trials (RCTs) included in a systematic review to assess the effectiveness of a variety of interventions to improve the investigation and management of osteoporosis following fragility fracture. Although there are many examples of the prospective use of the TDF in implementation research, to our knowledge, this is the first time that the TDF has been used as a coding framework to retrospectively analyse the factors targeted by implementation interventions in a systematic review.

The theory-based analysis using the TDF highlighted five key domains that appeared to be targeted most frequently by the interventions: “Memory, attention and decision processes”, “knowledge”, “environmental context and resources”, “social influences” and “beliefs about consequences”. For each of the ten interventions from the nine studies, we coded a combination of at least four of these five domains. The results of the exploratory quantitative analysis suggested an inverse relationship between both the number of times the domains were coded and the number of different domains coded and the effect size of the intervention for BMD scanning, but the relationship was less clear with regards to treatment with anti-resorptive therapy.

Frequently coded domains

“Memory, attention and decision processes” was by far the most frequently coded domain. This suggests that the study authors believed that PCPs need reminders, prompts or decision aids to enable them to perform the behaviours, indicating that they believed that PCPs were either forgetting to perform the behaviour or had impaired decision processes with regard to performing the behaviour. This also addressed the identified barrier of PCPs failing to make the connection between a fracture and osteoporosis.

“Knowledge” was the second most frequently coded domain. For all the interventions that included the patient as a recipient, the “knowledge” domain was coded with respect to the patient. This indicates that the authors believed that in order to ensure that the patient could influence the PCP’s behaviour, they first required a certain amount of knowledge about the investigation and management of osteoporosis following fragility fracture. The use of “knowledge” with regards to the PCP was less consistent (five out of ten interventions) which suggests that the study authors differed in their views about PCPs’ existing knowledge of the condition and its management. This domain encompasses the barriers of a lack of awareness by patients and physicians of the treatment guidelines and efficacy of medications for osteoporosis following fragility fracture.

“Environmental context and resources” was the third most frequently coded domain. It was interesting that in the three studies with the greatest effect sizes for BMD scanning (Miki [44], Rozental [45] and Majumdar [40], with post-intervention risk differences of 71, 62 and 51 %, respectively), a large part of the intervention was coded within this domain. In the Miki study, the BMD scan was ordered by the orthopaedic surgeon and carried out whilst the patient was still in hospital. In Rozental the BMD scan was ordered by the orthopaedic surgeon during the first outpatient clinic visit; and in Majumdar, a case manager arranged the BMD scan. This was coded as a resource, but one could argue that rather than changing the behaviour of the PCP, the effectiveness of the interventions stemmed from the fact that the behaviour was taken completely out of the hands of the PCP and was actually a service delivery change—someone else performed the behaviour instead. In these three examples, the barrier of inadequate access to BMD scanning was addressed. It is worth noting that this domain was also coded for studies with smaller effect sizes for BMD scanning, including Solomon which had the smallest effect size (4 %) [41], and in which it was coded once for the patient, four times for the PCP and once for the pharmacist. This highlights a key point when using the TDF: it is not just which domains you target but how they are targeted that is important. Just because one targets “environmental context and resources” or “Memory, attention and decision processes’, it does not mean that it is done appropriately or effectively. However, the advantage of using the TDF is that it allows us to use a common language for describing those targets.

Finally, “Beliefs about consequences” was coded fifth most frequently. Interestingly, patient “beliefs about consequences” was targeted in all of the five studies for which this domain was coded but PCP “beliefs about consequences” was only targeted in two of them. This implies that the authors believed that patients had not considered or did not understand the consequences of failing to investigate for and treat osteoporosis post-fracture, and by remedying this, they would be able to change the behaviour of the PCP by, for example, using patient prompts. This addressed barriers such as concerns about whether bisphosphonate treatment might impair fracture-healing, concerns about adverse effects of medications or lack of awareness of the efficacy of medications following fracture.

Description of intervention and control groups

In addition to the poor reporting of the rationale for the interventions, from some of the descriptions given, it was difficult to extract sufficient detail to be confident that the interventions were being described in a way that would make them replicable. It was also difficult to disentangle what the investigators felt was the content of their intervention (the active ingredients; cf. [47]) from the method that they chose to deliver it (e.g. printed educational materials). Such distinction is important in order to promote greater clarity in the description of interventions [48].

The descriptions of the control groups were often underreported, and in some cases completely absent. This impacted on our ability to code certain domains with confidence. This is a consistent finding throughout the behaviour change literature. Reviews of nearly 1000 behaviour change outcome studies [4952] found that detailed descriptions of interventions were present in only 5 to 30 %. Failing to report the actual behaviour targeted for change by the intervention or describing the content of the intervention in sufficient detail makes it impossible to identify why an intervention did or did not work [53, 54]. This prevents the replication of successful interventions in wider settings; the introduction of the Template for Intervention Description and Replication checklist (TIDieR) [55] may improve the current situation.

Relationship between the number of domains targeted and the effect size

The exploratory analysis showed a statistically significant inverse relationship between the total number of times the domains were coded and the number of different domains coded and the effect size of the intervention for BMD scanning. However, the results for the equivalent analysis on anti-resorptive therapy were not statistically significant. This may be due to the fact that anti-resorptive therapy is itself partially dependent upon BMD scanning. We have shown that the study authors rarely documented the management guideline they were using, but in the majority of cases, the patient needed to have a BMD scan before treatment was commenced. Following the BMD scan, the patient may not have required treatment for osteoporosis so although the patient would have received appropriate care, it would appear as if the intervention had not been successful as the patient was not given subsequent anti-resorptive treatment.

Nevertheless, the inverse relationship demonstrated for BMD scanning was unexpected. We assumed that multifaceted interventions would prove to be associated with larger effect sizes. There may be a range of reasons that explain the inverse relationship, including that it is a chance finding given the small number of studies included in the analysis. Equally, it may be that targeting more domains may not be inherently better; what is likely more important may be to better match the interventions to the domains shown to be relevant for the behaviour, context and population under study [16].

Limitations and challenges

None of the studies employed the explicit use of theory, which meant that our coding was based on inference from the text. This is not unusual; studies in this area rarely employ theories of behaviour change, or if they do, they fail to report it [56].

The main limitation with the exploratory quantitative analysis of the relationship between domains coded and effect size of the intervention was that there were only 10 data points; outliers had a large influence on the results. Although there was only moderate agreement achieved (K = 0.507) following the initial coding, the multidisciplinary coding approach likely allowed for better sensitivity of both the clinical and theoretical content.

There are also challenges to using the TDF itself in this context. Not all domains are necessarily mutually exclusive, with some sharing certain constructs, for example, “action planning” is a part of both “goals” and “behavioural regulation”. Separating “intentions” and “goals” domains was sometimes a challenge. Given the inferential nature of the coding, there were instances when agreeing upon a target domain proved challenging (reflected in our inter-rater reliability). This was in line with previous research in the context of interview studies [57], perhaps reflecting the difficulty of clarifying the boundaries between some domains when using the TDF as a coding framework.

A final challenge involved coding interventions that included a service delivery change. In three studies, the behaviour of performing the BMD scan was taken out of the hands of the target PCP altogether and performed by another individual. We coded such instances as targeting “environmental context and resources” domain. However, the target of this part of the intervention was at an organisational level rather than an individual PCP or patient level. Nevertheless, someone’s behaviour higher in the organisation needed to change for this service delivery to take effect; the TDF could potentially be applied to describe their behaviour as well in future studies if descriptions in intervention reports provide such detail.

Conclusion

It is possible to use the TDF to retrospectively identify domains targeted by implementation interventions within systematic reviews. Even when the interventions themselves were not explicitly theory-based, the findings suggest that it is possible to attempt to make explicit the implicit theories that formed the basis for intervention. We identified five key domains that appeared to be most frequently targeted by the interventions. Interventions could be optimised by assessing whether these domains appear to be determinants of the target behaviour. We also identified a number of domains that had not been targeted, which could be considered as targets in future interventions if indicated to be barriers or facilitators. Unexpectedly, the results suggested that the effect size was inversely related to the number of domains targeted by an intervention, with the potential implication that focussing on less domains makes interventions more effective. The method proposed may serve as a basis for using the TDF as a means of better understanding the targeted factors in reviews of implementation interventions in other contexts when such factors are not explicitly identified within an existing theoretical framework.

References

  1. Albarracin D, Gillette JC, Earl AN, Glasman LR, Durantini MR, Ho MH. A test of major assumptions about behavior change: a comprehensive look at the effects of passive and active HIV-prevention interventions since the beginning of the epidemic. Psychol Bull. 2005;131(6):856–97.

    PubMed  PubMed Central  Google Scholar 

  2. Noar SM, Zimmerman RS. Health Behavior Theory and cumulative knowledge regarding health behaviors: are we moving in the right direction? Health Educ Res. 2005;20(3):275–90.

    PubMed  Google Scholar 

  3. Presseau J, Johnston M, Heponiemi T, Elovainio M, Francis JJ, Eccles MP, et al. Reflective and automatic processes in healthcare professional behavior: a dual process model tested across multiple behaviors. Ann Behav Med. 2014;48:347–58.

    PubMed  Google Scholar 

  4. Presseau J, Johnston M, Francis JJ, Hrisos S, Stamp E, Steen N, et al. Theory-based predictors of multiple clinician behaviors in the management of diabetes. J Behav Med. 2014;37:607–20.

    PubMed  Google Scholar 

  5. Walker AE, Grimshaw J, Johnston M, Pitts N, Steen N, Eccles M. PRIME—PRocess modelling in ImpleMEntation research: selecting a theoretical basis for interventions to change clinical practice. BMC Health Serv Res. 2003;19(3(1)):22.

    Google Scholar 

  6. Michie S, Abraham C. Identifying techniques that promote health behaviour change: evidence based or evidence inspired? Psychol Health. 2004;19:29–49.

    Google Scholar 

  7. Presseau J, Hawthorne G, Sniehotta FF, Steen N, Francis JJ, Johnston M, et al. Improving diabetes care through examining, advising, and prescribing (IDEA): protocol for a theory-based cluster randomised controlled trial of a multiple behaviour change intervention aimed at primary healthcare professionals. Implement Sci. 2014;9:61.

    PubMed  PubMed Central  Google Scholar 

  8. The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG). Designing theoretically-informed implementation interventions. Implement Sci. 2006;1:4.

    Google Scholar 

  9. Kim N, Stanton B, Li X, Dickersin K, Galbraith J. Effectiveness of the 40 adolescent AIDS-risk reduction interventions: a quantitative review. J Adolesc Health. 1997;20(3):204–15.

    CAS  PubMed  Google Scholar 

  10. Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58(2):107–12.

    PubMed  Google Scholar 

  11. Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Prof. 2006;29(1):126–53.

    PubMed  Google Scholar 

  12. Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R. What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005;5:50.

    CAS  PubMed  PubMed Central  Google Scholar 

  13. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14:26–33.

    CAS  PubMed  PubMed Central  Google Scholar 

  14. Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37.

    PubMed  PubMed Central  Google Scholar 

  15. Francis JJ, O’Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci. 2012;7:35.

    PubMed  PubMed Central  Google Scholar 

  16. French SD, Green SE, O’Connor D, McKenzie JE, Francis J, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7:38.

    PubMed  PubMed Central  Google Scholar 

  17. McSherry LA, Dombrowski SU, Francis JJ, Murphy J, Martin CM, O’Leary JJ, et al. ‘It’s a can of worms’: understanding primary care practitioners’ behaviours in relation to HPV using the Theoretical Domains Framework. Implement Sci. 2012;7:73.

    PubMed  PubMed Central  Google Scholar 

  18. Duncan EM, Francis JJ, Johnston M, Davey P, Maxwell S, McKay GA, et al. Learning curves, taking instructions, and patient safety: using a theoretical domains framework in an interview study to investigate prescribing errors among trainee doctors. Implement Sci. 2012;7:86.

    PubMed  PubMed Central  Google Scholar 

  19. Curran JA, Brehaut J, Patey AM, Osmond M, Stiell I, Grimshaw JM. Understanding the Canadian adult CT head rule trial: use of the theoretical domains framework for process evaluation. Implement Sci. 2013;8:25.

    PubMed  PubMed Central  Google Scholar 

  20. Amemori M, Michie S, Korhonen T, Murtomaa H, Kinnunen TH. Assessing implementation difficulties in tobacco use prevention and cessation counselling among dental providers. Implement Sci. 2011;6:50.

    PubMed  PubMed Central  Google Scholar 

  21. Giangregorio L, Papaioannou A, Cranney A, Zytaruk N, Adachi JD. Fragility fractures and the osteoporosis care gap: an international phenomenon. Semin Arthritis Rheum. 2006;35(5):293–305.

    CAS  PubMed  Google Scholar 

  22. Elliot-Gibson V, Bogoch ER, Jamal SA, Beaton DE. Practice patterns in the diagnosis and treatment of osteoporosis after a fragility fracture: a systematic review. Osteoporos Int. 2004;15(10):767–78.

    CAS  PubMed  Google Scholar 

  23. Freedman KB, Kaplan FS, Bilker WB, Strom BL, Lowe RA. Treatment of osteoporosis: are physicians missing an opportunity? J Bone Joint Surg Am. 2000;82-A(8):1063–70.

    CAS  PubMed  Google Scholar 

  24. Kamel HK, Hussain MS, Tariq S, Perry HM, Morley JE. Failure to diagnose and treat osteoporosis in elderly patients hospitalized with hip fracture. Am J Med. 2000;109(4):326–8.

    CAS  PubMed  Google Scholar 

  25. Colon-Emeric C, Yballe L, Sloane R, Pieper CF, Lyles KW. Expert physician recommendations and current practice patterns for evaluating and treating men with osteoporotic hip fracture. J Am Geriatr Soc. 2000;48(10):1261–3.

    CAS  PubMed  Google Scholar 

  26. Gehlbach SH, Bigelow C, Heimisdottir M, May S, Walker M, Kirkwood JR. Recognition of vertebral fracture in a clinical setting. Osteoporos Int. 2000;11(7):577–82.

    CAS  PubMed  Google Scholar 

  27. Andrade SE, Majumdar SR, Chan KA, Buist DS, Go AS, Goodman M, et al. Low frequency of treatment of osteoporosis among postmenopausal women following a fracture. Arch Intern Med. 2003;22(163(17)):2052–7.

    Google Scholar 

  28. Feldstein A, Elmer PJ, Orwoll E, Herson M, Hillier T. Bone mineral density measurement and treatment for osteoporosis in older individuals with fractures: a gap in evidence-based practice guideline implementation. Arch Intern Med. 2003;13(163(18)):2165–72.

    Google Scholar 

  29. Siris ES, Bilezikian JP, Rubin MR, Black DM, Bockman RS, Bone HG, et al. Pins and plaster aren’t enough: a call for the evaluation and treatment of patients with osteoporotic fractures. J Clin Endocrinol Metab. 2003;88(8):3482–6.

    CAS  PubMed  Google Scholar 

  30. Torgerson DJ, Dolan P. Prescribing by general practitioners after an osteoporotic fracture. Ann Rheum Dis. 1998;57(6):378–9.

    CAS  PubMed  PubMed Central  Google Scholar 

  31. Cosman F, Beur SJ, LeBoff MS, Lewiecki EM, Tanner B, Randall S, et al. Clinician’s Guide to Prevention and Treatment of Osteoporosis. Osteoporos Int. 2014;25(10):2359–81.

  32. Brown JP, Josse RG, Scientific Advisory Council of the Osteoporosis Society of Canada. 2002 clinical practice guidelines for the diagnosis and management of osteoporosis in Canada. CMAJ. 2002;12(167(10 Suppl)):S1–34.

    Google Scholar 

  33. Scottish Intercollegiate Guidelines Network: management of osteoporosis. Edinburgh; 2003.

  34. National Osteoporosis Guideline Group (NOGG): Guideline for the diagnosis and management of osteoporosis in postmenopausal women and men from the age of 50 years in the UK. Executive Summary; 2008, updated 2010.

  35. NICE. Alendronate, etidronate, risedronate, raloxifene, strontium ranelate and teriparatide for the secondary prevention of osteoporotic fragility fractures in postmenopausal women. 2008.

    Google Scholar 

  36. Little EA, Eccles MP. A systematic review of the effectiveness of interventions to improve post-fracture investigation and management of patients at risk of osteoporosis. Implement Sci. 2010;5:80.

    PubMed  PubMed Central  Google Scholar 

  37. Gardner MJ, Brophy RH, Demetrakopoulos D, Koob J, Hong R, Rana A, et al. Interventions to improve osteoporosis treatment following hip fracture. A prospective, randomized trial. J Bone Joint Surg Am. 2005;87(1):3–7.

    PubMed  Google Scholar 

  38. Feldstein A, Elmer PJ, Smith DH, Herson M, Orwoll E, Chen C, et al. Electronic medical record reminder improves osteoporosis management after a fracture: a randomized, controlled trial. J Am Geriatr Soc. 2006;54(3):450–7.

    PubMed  Google Scholar 

  39. Davis JC, Guy P, Ashe MC, Liu-Ambrose T, Khan K. HipWatch: osteoporosis investigation and treatment after a hip fracture: a 6-month randomized controlled trial. J Gerontol A Biol Sci Med Sci. 2007;62(8):888–91.

    PubMed  Google Scholar 

  40. Majumdar SR, Beaupre LA, Harley CH, Hanley DA, Lier DA, Juby AG, et al. Use of a case manager to improve osteoporosis treatment after hip fracture: results of a randomized controlled trial. Arch Intern Med. 2007;22(167(19)):2110–5.

    Google Scholar 

  41. Solomon DH, Polinski JM, Stedman M, Truppo C, Breiner L, Egan C, et al. Improving care of patients at-risk for osteoporosis: a randomized controlled trial. J Gen Intern Med. 2007;22(3):362–7.

    PubMed  PubMed Central  Google Scholar 

  42. Cranney A, Lam M, Ruhland L, Brison R, Godwin M, Harrison MM, et al. A multifaceted intervention to improve treatment of osteoporosis in postmenopausal women with wrist fractures: a cluster randomized trial. Osteoporos Int. 2008;19(12):1733–40.

    CAS  PubMed  Google Scholar 

  43. Majumdar SR, Johnson JA, McAlister FA, Bellerose D, Russell AS, Hanley DA, et al. Multifaceted intervention to improve diagnosis and treatment of osteoporosis in patients with recent wrist fracture: a randomized controlled trial. CMAJ. 2008;26(178(5)):569–75.

    Google Scholar 

  44. Miki RA, Oetgen ME, Kirk J, Insogna KL, Lindskog DM. Orthopaedic management improves the rate of early osteoporosis treatment after hip fracture. A randomized clinical trial. J Bone Joint Surg Am. 2008;90(11):2346–53.

    PubMed  Google Scholar 

  45. Rozental TD, Makhni EC, Day CS, Bouxsein ML. Improving evaluation and treatment for osteoporosis following distal radial fractures. A prospective randomized intervention. J Bone Joint Surg Am. 2008;90(5):953–61.

    PubMed  Google Scholar 

  46. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.

    CAS  PubMed  Google Scholar 

  47. Presseau J, Ivers NM, Newham JJ, Knittle K, Danko KJ, Grimshaw JM. Using a behaviour change techniques taxonomy to identify active ingredients within trials of implementation interventions for diabetes care. Implement Sci. 2015;10:55.

    PubMed  PubMed Central  Google Scholar 

  48. Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40.

    PubMed  PubMed Central  Google Scholar 

  49. Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18(1):23–45.

    CAS  PubMed  Google Scholar 

  50. Gresham FM, Gansle KA, Noell GH. Treatment integrity in applied behavior analysis with children. J Appl Behav Anal. 1993;26(2):257–63.

    CAS  PubMed  PubMed Central  Google Scholar 

  51. Moncher FJ, Prinz RJ. Treatment fidelity in outcome studies. Clin Psychol Rev. 1991;11.

  52. Odom SI, Brown WH, Frey T, Karasu N, Smith-Canter LL, Strain PS. Evidence-based practices for young children with autism: contributions for single-subject design research. Focus on Autism and Other Developmental Disabilities. 2003;18:166–75.

    Google Scholar 

  53. Dombrowski S, Sniehotta F, Avenell A, Coyne J. Towards a cumulative science of behavior change: do current conduct and reporting of behavioral interventions fall short of best practice? Psychol Health. 2007;22:869–74.

    Google Scholar 

  54. Riley B, MacDonald J, Mansi O, Kothan A, Kurtz D, von Tettenborn L, et al. Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars. Implement Sci. 2008;3:27.

    PubMed  PubMed Central  Google Scholar 

  55. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;7(348):g1687.

    Google Scholar 

  56. Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:14.

    PubMed  PubMed Central  Google Scholar 

  57. Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, et al. Evidence-based selection of theories for designing behaviour change interventions: using methods based on theoretical construct domains to understand clinicians’ blood transfusion behaviour. Br J Health Psychol. 2009;14(Pt 4):625–46.

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Justin Presseau.

Additional information

Competing interests

MPE is the founding Editor-in-Chief of Implementation Science. JP is an editorial board member of Implementation Science. Neither was involved in the editorial decisions for this manuscript.

Authors’ contributions

MPE conceived of the study. EAL and JP coded the intervention and control groups: EAL conducted the quantitative analysis under JP’s supervision. EAL wrote the first draft of the manuscript, and all authors commented on it and the subsequent drafts. All authors read and approved the final manuscript.

Additional files

Additional file 1:

Data extraction form for theory-based analysis.

Additional file 2:

Detailed coding of domains targeted in the intervention and control groups.

Rights and permissions

Open Access  This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.

The Creative Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Little, E.A., Presseau, J. & Eccles, M.P. Understanding effects in reviews of implementation interventions using the Theoretical Domains Framework. Implementation Sci 10, 90 (2015). https://doi.org/10.1186/s13012-015-0280-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-015-0280-7

Keywords