Skip to main content
Download PDF
Download ePub
  • Study protocol
  • Open access
  • Published:

The Ontario printed educational message (OPEM) trial to narrow the evidence-practice gap with respect to prescribing practices of general and family physicians: a cluster randomized controlled trial, targeting the care of individuals with diabetes and hypertension in Ontario, Canada

Implementation Science volume 2, Article number: 37 (2007) Cite this article

Abstract

Background

There are gaps between what family practitioners do in clinical practice and the evidence-based ideal. The most commonly used strategy to narrow these gaps is the printed educational message (PEM); however, the attributes of successful printed educational messages and their overall effectiveness in changing physician practice are not clear. The current endeavor aims to determine whether such messages change prescribing quality in primary care practice, and whether these effects differ with the format of the message.

Methods/design

The design is a large, simple, factorial, unblinded cluster-randomized controlled trial. PEMs will be distributed with informed, a quarterly evidence-based synopsis of current clinical information produced by the Institute for Clinical Evaluative Sciences, Toronto, Canada, and will be sent to all eligible general and family practitioners in Ontario. There will be three replicates of the trial, with three different educational messages, each aimed at narrowing a specific evidence-practice gap as follows: 1) angiotensin-converting enzyme inhibitors, hypertension treatment, and cholesterol lowering agents for diabetes; 2) retinal screening for diabetes; and 3) diuretics for hypertension.

For each of the three replicates there will be three intervention groups. The first group will receive informed with an attached postcard-sized, short, directive "outsert." The second intervention group will receive informed with a two-page explanatory "insert" on the same topic. The third intervention group will receive informed, with both the above-mentioned outsert and insert. The control group will receive informed only, without either an outsert or insert.

Routinely collected physician billing, prescription, and hospital data found in Ontario's administrative databases will be used to monitor pre-defined prescribing changes relevant and specific to each replicate, following delivery of the educational messages. Multi-level modeling will be used to study patterns in physician-prescribing quality over four quarters, before and after each of the three interventions. Subgroup analyses will be performed to assess the association between the characteristics of the physician's place of practice and target behaviours.

A further analysis of the immediate and delayed impacts of the PEMs will be performed using time-series analysis and interventional, auto-regressive, integrated moving average modeling.

Trial registration number

Current controlled trial ISRCTN72772651.

Peer Review reports

Background

There are gaps between the evidence-based, ideal clinical practice and what family practitioners (FPs) actually do. We understand very little about the reasons for these gaps [1]. Printed educational messages (PEMs), ranging from short directive statements to long guidelines, have often been used in the hope of narrowing these gaps [2], but there is profound uncertainty around their usefulness [3–5]. PEMs fell into disfavour among researchers in this field after a 1997 systematic review found their effects to be uncertain [6]. A recent larger overview found a median absolute improvement of 8% (range 4–17%) [7].

However, no review can overcome the limitations of the primary evidence: the small number of trials (each one of which is small in size), and their continued methodological weaknesses (insufficient power to detect modest effects, and unit of analysis errors).

Aims and objectives

  1. 1.

    To conduct a large, reliable and relevant (pragmatic), randomized controlled trial of the effect of printed educational messages (PEMs) on guideline adherence among Ontario primary care physicians.

  2. 2.

    To determine whether there is any difference in impact on physician guideline adherence between: 1) a postcard-sized, short, directive message, 2) a two-page, longer, explanatory message, or 3) a combination of both.

  3. 3.

    To determine the relative effectiveness of PEMs in narrowing gaps for different health problems.

A randomised trial will help define the role of PEMs, while increasing our understanding of the process of implementing evidence of effectiveness into daily clinical care [8, 9].(In Canadian research, the word 'translation' is used, in place of 'implementation'.)

Methods/design

Pragmatic, randomized controlled trials are reliable evaluations of the effectiveness of often complex health care interventions carried out under real-world conditions [8, 9].

Effectiveness of the intervention usually is assessed by impact on simple outcomes of importance to users of the intervention, such as: death, disability, user satisfaction, utilization of care, and quality of life. Pragmatic trials are attuned to the same criteria of effectiveness as those used by policymakers – important and visible outcomes in usual health service planning entities, and under typical service limitations. Pragmatic trials take into account the varied ways that interventions are implemented in the real world. In contrast, classic explanatory randomized trials (efficacy trials) test the effects of an intervention, often a drug, under idealised and tightly controlled conditions, and on narrowly defined groups of individual patients. Classic efficacy trials usually are carried out to advance medical knowledge, whereas pragmatic trials are concerned with assessing the effects of interventions as they are usually used, in typical settings, and on typical users.

Choice of target physician practices

We used several criteria to identify evidence/practice gaps important in primary care: the gap involves a common disorder in Canadian primary care; evidence-based practice is not constrained by structural, financial or other barriers; the evidence/practice gap is large and may cause patient harm or unnecessary cost; well-tested process indicators exist that are measurable using administrative datasets; and the gaps span a range of clinical practice behaviours.

As a result, we selected three evidence-practice gaps leading to clinical choices that family doctors should make more often. These gaps are based upon Ontario administrative data.

  1. 1.

    Prescription of angiotensin-converting enzyme (ACE) inhibitors, aggressive hypertension treatment, and cholesterol-lowering treatment for persons with diabetes (each falls short of guideline targets by at least 30%) [10–33].

  2. 2.

    Referral of persons with diabetes for eye screening by an optometrist or ophthalmologist (50% below guideline-recommended levels) [34–40].

  3. 3.

    Prescription of diuretics as first-line therapy for newly diagnosed hypertension (~40% below guideline-recommended levels) [41–50].

Trail intervention: the printed educational messages

We will develop PEMs to address each of the three identified evidence/practice gaps, using input from a diverse group of physicians to identify barriers to evidence-based practice and from a communications consultant to inform design of the messages [51].

The PEMs will be distributed along with informed, a peer-reviewed, evidence-based practice synopsis, which has been mailed quarterly since 1994 to nearly 15,000 primary care providers in Ontario. Subscription is voluntary and is at no cost to the subscriber. Articles for each eight-page issue are developed by clinical and research staff from the Institute for Clinical Evaluative Sciences (ICES), Toronto, Canada.

Two PEMs will be developed for each of the three evidence/practice gaps:

  • A short, directive, evidence-based PEM on a postcard-sized card (referred to as an outsert) stapled to the lower-left quarter of the front page of informed.

  • A longer two-page insert (indistinguishable from the rest of the periodical in size, style and editing) focusing on the same topic as the outsert, but excluding the directive statements and including more background, evidence-based guidelines and references.

Research design

The research design is a factorial, cluster-randomized controlled trial with three replicates [52, 53]. informed is published four times per year. We will conduct three replicates of the trial to cover the three evidence-practice gaps over a nine-month period (three successive mailouts of informed). We will test the effects of short (directive) and long (discursive) PEMs compared with no PEM on the clinical practices of primary care physicians, and on related patient outcomes. Table 1 describes the intervention groups for each of the three replicates. In the first replicate (ACE inhibitors, hypertension treatment, and cholesterol-lowering agents for diabetes), the first intervention group will receive a copy of informed with both the short, directive, evidence-based outsert stapled to the lower-left quarter of the front page, and the longer two-page insert focusing on the same topic as the outsert. The second intervention group will receive the identical informed, with only the above-mentioned outsert. The third intervention group will receive the identical copy of informed with the above-mentioned insert. The control group will receive the identical informed only, without the insert or the outsert. The health care topic shared by the insert and outsert will not be covered elsewhere in that issue of informed. The outsert for this first replicate is shown in Figure 1 and the insert in Figures 2 and 3.

Figure 1
figure 1

Printed educational message "outsert" for replicate 1.

Full size image
Figure 2
figure 2

Printed Educational Message "Insert" for Replicate 1 (part 1).

Full size image
Figure 3
figure 3

Printed Educational Message "Insert" for Replicate 1 (part 2).

Full size image
Table 1 Description of the intervention groups within each of the three replicates
Full size table

For the second replicate (retinal screening in patients with diabetes), in addition to the short, directive outsert and the longer, explanatory insert, we will add a reminder note that physicians could give to their patients to supplement the verbal reminder that we encourage physicians to give. Because it is not clear whether this patient-held reminder to make an appointment with their eye care provider is any more effective than the verbal reminder that we will encourage physicians to give, we will randomize those physicians receiving an outsert to receive a pad of the patient-aimed reminder slips.

For the third replicate (using thiazides as first-line treatment for hypertension), we will use two different short-directive outsert messages (in addition to the long, explanatory insert message). Our OPEM team will develop the first outsert message, whereas a team of psychologists with experience in knowledge implementation and the use of psychological theories will develop the second outsert message. With the addition of a theory-based outsert, we will be able to determine whether a message that is based on psychological theory, specifically on the Theory of Planned Behaviour, will be more effective in changing clinical behaviour toward more evidence-based practice than a message that is based on 'standard' methods, which are uninformed by an explicit theoretical basis[54]. (See "Ancillary Studies" below.)

Allocating participants to trial groups

Trials of interventions aimed at changing clinical practices must be randomized at the level at which they are directed – that is, at the level of the doctor, not his or her patients. In group practices, however, doctors may well share information. To prevent contamination, randomization must take place at the level of the group rather than the individual practitioner. A group practice is defined here as all primary care physicians who share a common street address, or who share a common office number in a multi-office building. The eligible Ontario primary care doctors will be fee-for-service family physicians (FPs) and general practitioners (GPs) (Ontario Health Insurance Program [OHIP] billing code 00).

These practitioners will be identified from the health care providers database held at ICES. They will be verified to be in active practice. In order to enable prescribing outcomes to be measured, we will ensure that they have an adequate volume of seniors among their patients by requiring that they write at least 100 prescriptions appearing in the ODB (Ontario Drug Benefit Program) database in the year prior to enrollment. The physician identifier obtained from these ODB claims first will be linked to the physician's College of Physicians and Surgeons of Ontario (CPSO) number at ICES. Addresses of practitioners will be obtained by hand-linking the CPSO number to the CPSO database, which is publicly available on the Internet. The CPSO website can be queried by CPSO number and will supply physician name and practice address.

All FPs and some GPs are already on the informed mailing list. Those who are not currently on the list will be added for the three intervention issues of informed. This list will be sorted by addresses of practitioners into practices, in order to prevent practitioners with the same address, who may share administrative staff or communicate readily with each other, from being randomized to different groups (i.e., to reduce contamination). Using a computer-generated sequence of random numbers, the practices will then be randomized to one of the intervention groups. For each of the three replicates, we will re-randomize physician practices to one of the intervention groups.

The relevant patients for each practice are defined as any patient attending that practice who meets study entry criteria. For each of the gaps, we are using a different algorithm to identify relevant patients (see Table 2). A patient may be counted multiple times, as they are free to attend more than one primary care practice. This approach is conservative, and gives all physicians "credit" for appropriate prescribing or referral decisions made by any of the physicians who saw that patient during the study period. In a sensitivity analysis, we will use a more rigorous rule for defining physician-patient relationships, whereby patients will be assigned only to the primary care provider with whom they had a plurality of their visits. In a tie, the patient will be assigned to the primary care physician who wrote the greatest number of their prescriptions during the study period. Patients who still cannot be unambiguously assigned will be allocated randomly to one of the practitioners who have written prescriptions for them during the study period.

Table 2 Patient population and primary outcome for each of 3 replicates
Full size table

The Registered Persons Database (RPDB) identifies all persons in the province who are eligible for OHIP coverage. It will be used to link patient participants to the administrative databases, and to detect death and out-migration of patients over the course of the study. Claims from the ODB Program will be used to measure the prescribing changes that result from the interventions. These data are available only for people 65 years of age and older. Accordingly, the two drug-related replicates are restricted to that age group of the Ontario population. The ODB data are delivered to ICES within two weeks of the end of the month of the claim. Claims data from OHIP will be used to identify physician patient linkages, and to measure the delivery of ophthalmologic and optometric screening. All of these datasets are available at ICES, and all bear encrypted health card numbers that are unique to patients but common over time and across data sets.

Outcome measurement

Follow-up by means of routine data will cover four quarters before and after each prescribing-related PEM intervention. Each of the process-of-care measures has been used in large-scale studies using databases held at ICES.

Proposed sample size

We wished to have adequate power to detect modest changes in the way physicians practice. Based on the median absolute effectiveness of PEMs estimated from the Grimshaw review (8%) [7], it would be important to detect 5% and 10% absolute improvements in our target behaviours. Even 5% improvements in the prevalence of evidence-based care for these common conditions will be an important achievement, with significant health benefits for many Ontarians.

In pilot data, the baseline-prescribing rate of ACE inhibitors in persons with diabetes was 36%, and the intra-class correlation for ACE inhibitor use by patients clustered within physicians was 9.2%. With an assumption that one-half of doctors work in solo practices, we ran these data testing power at a mean of three patients and ten patients per practice. Monte Carlo simulations demonstrated that a trial with 1250 practices per arm, with 10 patients per practice and an alpha of 0.05 will provide more than 98% power to detect a 10% absolute increase in the rate of ACE inhibitor use, more than 97% power to detect a 5% absolute increase, and more than 98% power to distinguish between the effects of the combined intervention and either alone, assuming the combined effect to be additive.

Because the baseline rates of the other interventions are comparable or lower (screening for retinopathy, diuretic use, aggressive blood pressure-reducing, and cholesterol-lowering therapies), and the number of patients per practitioner with these conditions is the same or higher, we will have adequate power to detect similar absolute increases for those endpoints.

Later, with the addition (see Table 1) of two groups in the second (patient reminder note) and third (theory-based outsert) replicates, a less comprehensive, but approximate simulation suggested that the impact on power would be minor and would most certainly be greater than the often used target of 80%. The research opportunity that this modification presented was judged to outweigh the likely loss of power. Therefore, we maintained 1,250 practices in the two groups that did not receive an outsert with informed, and assigned 625 practices to each of the four groups who were sent an outsert.

Recruitment, compliance, loss to follow-up, and drop-out

Practitioners may of course decide to ignore the PEMs or never open the envelope containing informed. We will not know what practitioners will do with the intervention, a normal feature of the pragmatic trial philosophy that tests interventions under real-world conditions. informed will be mailed in the usual fashion to all identified practitioners. Any practitioners who subsequently remove themselves from the mailing list for informed will be analysed in the allocated arm on an intention-to-treat basis.

While the unit of analysis is the physician, loss of patients is important to detect in order to maintain accurate denominators for the determination of outcome rates. Patients may be lost due to removal from the system (death or out-migration), or change of provider. The former will be detected in the RPDB, the latter by a plurality rule for prescriptions. For the baseline analysis (pre-intervention period), the initially assigned patients for each physician will be used. For each of the succeeding observation periods (three pre- and four post-intervention), initial patients will be confirmed by eliminating patients no longer eligible according to the RPDB, and ensuring that assigned patients are still being cared for by the study physician through a requirement that the study physician must have written the plurality of the patient's prescriptions in that period.

Analyses

We hypothesize that the active intervention arms will be superior to control, similarly effective to each other, and with some additive effect when both are delivered. Analyses will be concentrated on this hypothesis.

The study employs a cluster randomized design. The analysis will be carried out using multi-level, hierarchical, logistic regression models, with the trial arm being a physician-level variable, and the prescribing (or screening) outcome a patient-level variable. These models account for clustering of patients within practices, and the consequent lack of independence of prescribing outcomes within a given physician's place of practice [55]. No place-of-practice characteristics, aside from the arm of the trial and baseline adherence to guidelines, will be entered into the model in the primary analysis. With so many physicians randomized to each arm, we anticipate that measured and unmeasured physician factors that might affect the outcome will be equally distributed between the arms. Moreover, including more place-of-practice characteristics in the model would reduce the statistical power to detect the primary outcome.

Subgroup analyses

Failure to consistently implement evidence into improved prescribing decisions has been associated with older physicians and those without specialty certification [56]. While we would like to test the impact of certification, no data exists describing this status that can be linked to our datasets.

Evidence-practice gaps also have been associated with physician reimbursement arrangements, patient volumes, physician gender, site and extent of training, group size, and work load [57]. Thus, we plan subgroup analyses of male versus female physicians, location of practice (urban or rural), practice volume, solo versus group practice, and years since graduation. As before, multilevel, logistic regression models will be used to assess the association between place-of-practice characteristics and target behaviours.

A further analysis of the immediate and delayed impacts of the printed educational material will be performed using time-series analysis and interventional, autoregressive, integrated moving average (ARIMA) modeling [58]. The group to which the patient's practitioner was randomized will be included as a covariate. An immediate change will be defined as a significant shift in prescribing patterns from projected estimates within four months of the intervention. Delayed effects will be measured with simple time-series analysis, such as exponential smoothing and ARIMA models by comparing actual with predicted utilization estimates. Stationarity will be assessed using the autocorrelation function and the augmented Dickey-Fuller test [59]. The auto-correlation, partial autocorrelation, and inverse autocorrelation functions will be assessed for model parameter appropriateness and seasonality. The presence of white noise will be assessed by examining the autocorrelations at various lags using the Ljung-Box test [60].

The question of whether there are differences in response to PEMs for different diseases patient health status levels and health care problems is addressed in the replicates. Differences between these replicates will be discussed, and will not a priori be subjected to meta-analysis. In the event of substantial homogeneity of outcomes, we will consider meta-analysis across the replicates.

There will be one analysis for each replicate upon receipt of one year of follow-up data.

Ancillary studies

Two smaller studies will be conducted in conjunction with the OPEM study. Both will take advantage of the infrastructure, which will already be in place for the main study to obtain additional, related information about PEMs – namely information about the causal mechanisms through which PEMs lead to behaviour changes.

The Testing a TheoRY-informed Message (TRY-ME) study will be associated with the third intervention (prescription of diuretics as first-line therapy for newly diagnosed hypertension) [64]. Two outserts will be developed. The wording of the first outsert containing a 'standard' message will be developed by a team of clinical researchers experienced in implementation research and in the development of short educational messages directed to clinicians. The wording of the second, theory-based message will be developed by a team of psychologists with experience in implementation research, and clinical researchers experienced in the use of psychological theories. Otherwise, the two messages will use similar styles, font sizes and colours. As indicated in the above "Proposed Sample Size" sub-section, the OPEM study will retain sufficient power for the primary outcomes, while also permitting a comparison of 'standard' and theory-based outserts.

The interpretation of the results of the OPEM trial and assessment of its likely generalisability would be enhanced if we had additional information about the causal mechanisms through which the interventions worked, and how these were modified in the presence of different barriers and enablers. The second ancillary study will conduct a theory-based process evaluation alongside the OPEM trail. "Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials" [65] will develop surveys, based upon the Theory of Planned Behaviour [56], for the second and third OPEM interventions, and survey a sub-sample of recipients from each arm of the trial two months before and six months after the dissemination of the relevant edition of informed.

Ethical approval

This study has received approval from the Research Ethics Board at Sunnybrook and Women's College Health Sciences Centre. The data linkage processes described above have been used at ICES previously, and meet the requirements of the ICES research agreement with the Ontario Ministry of Health and Long-Term Care, under which ICES has access to the administrative data.

Discussion

We understand very little about the reasons for the gaps between what family practitioners do in clinical practice, and what the evidence-based ideal says they should do. The simplest intervention to narrow these gaps is the PEM, ranging from a one-sentence directive to a long guideline; and they have often been used, but in an intuitive fashion, with neither an underlying theory of behaviour change nor a deep understanding of physicians' barriers to change.

After a 1997 systematic review found their effects to be uncertain, PEMs fell into disfavour. However, a more recent and larger overview found a median improvement of 8% in comparison with no PEM – a result which was similar in effect to more expensive and intensive strategies. Nevertheless, this review cannot overcome the limitations of the primary evidence: the small number of trials (each one of which is small in size), and their continued methodological weaknesses (insufficient power to detect modest effects, and unit of analysis errors). More evidence is needed in order to decide whether PEMs can be used to help change clinical practice.

We have proposed a trial that is designed to address these shortcomings. The large size of the trial provides enough power to confidently and precisely delineate modest effects. Modest effects are important, given the large absolute impact that is achievable when the intervention is applied to a common health problem. By randomizing at the level of the physician place-of-practice, the trial avoids contamination and unit of analysis error. In addition to answering the question of whether PEMs change primary care practitioners' therapeutic decisions, this study, along with its two ancillary studies, also will compare the impact of two types of PEMs (the short, directive versus a two-page descriptive message), and will examine the contextual and sociological factors (e.g., health problems, location, style of physician practice and duration of practice) which may influence the impact of PEMs.

If passive dissemination of PEMs is shown to be effective, this study may give professional, administrative, and patient organizations interested in change toward evidence-based practice the impetus to develop systematic programs for practice change using PEMs. If shown to be ineffective, use of PEMs as a single practice change intervention would be discouraged, thereby eliminating waste and turning research attention toward other interventions, including a possible role for PEMs as one element in a multi-faceted intervention. If effectiveness is shown to vary by disease problem, barrier, subgroup of practitioner, or any other factor, this study will help inform how different kinds of PEMs should be used in different situations and health problems.

While no economic analysis has been proposed, pending a determination of the effectiveness of PEMs in changing practice, we will collect all costs attributable solely to PEM development, design and dissemination. If the intervention is effective, we will work to set up an initial cost analysis, in which the health care utilization and prescribing changes, if any, of the intervention will be assessed in view of the marginal costs of the PEM intervention. We also will approach professional bodies and patient advocacy groups to offer help in developing PEM strategies for health care quality improvement.

Abbreviations

ACE:

Angiotensin Converting Enzyme

ARIMA:

Auto-Regressive Integrated Moving Average

CFPC:

College of Family Physicians of Canada

CIHI:

Canadian Institute for Health Information

CPSO:

College of Physicians and Surgeons of Ontario

FP:

Family Physician

GP:

General Practitioner

ICES:

Institute for Clinical Evaluative Sciences

ODB:

Ontario Drug Benefit Program

OHIP:

Ontario Health Insurance Plan

OPEM:

Ontario Printed Educational Message

PEM:

Printed Educational Message

RPDB:

Registered Persons Database

TRY-ME:

TheoRY-based MEssage

References

  1. Gill P, Dowell AC, Neal RD, Smith N, Heywood P, Wilson AE: Evidence based general practice: a retrospective study of interventions in one training practice. BMJ. 1996, 312: 819-821.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Hibble A, Kanka D, Pencheon D, Pooles F: Guidelines in general practice: the new Tower of Babel?. BMJ. 1998, 317: 862-863.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O'Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39: II2-45. 10.1097/00005650-200108002-00002.

    Article  CAS  PubMed  Google Scholar 

  4. Medicine I: Guidelines for clinical practice: From development to use. Edited by: MJ F and KN L. 1992, Washington, DC, National Academy Press

  5. Oxman AD, Thomson MA, Davis DA, Haynes RB: No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. Can Med Assoc J. 1995, 153: 1423-1431.

    CAS  Google Scholar 

  6. Freemantle N, Harvey EL, JM G, Grilli R, Bero LA: Printed Educational Materials: effects on professional practice and health care outcomes. (Cochrane Review). The Cochrane Library. 2000, Oxford, Update Software

    Google Scholar 

  7. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: iii-72.

    Article  CAS  PubMed  Google Scholar 

  8. Grol R: Personal paper. Beliefs and evidence in changing clinical practice. BMJ. 1997, 315: 418-421.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Worrall G, Chaulk P, Freake D: The effects of clinical practice guidelines on patient outcomes in primary care: a systematic review. Can Med Assoc J. 1997, 156: 1705-1712.

    CAS  Google Scholar 

  10. G H: Epidemiology of arthritis and osteoporosis. Patterns of Health Care in Ontario: Arthritis and Related Conditions. Edited by: JI W and Badley EM. 1998, Toronto, Institute for Clinical Evaluative Sciences, 1-10.

    Google Scholar 

  11. Blanchard JF, Ludwig S, Wajda A, Dean H, Anderson K, Kendall O, Depew N: Incidence and prevalence of diabetes in Manitoba, 1986-1991. Diabetes Care. 1996, 19: 807-811. 10.2337/diacare.19.8.807.

    Article  CAS  PubMed  Google Scholar 

  12. Tan MH, MacLean DR: Epidemiology of diabetes mellitus in Canada. Clin Invest Med. 1995, 18: 240-246.

    CAS  PubMed  Google Scholar 

  13. Hux JE, Ivis F, Flintoft V, Bica A: Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002, 25: 512-516. 10.2337/diacare.25.3.512.

    Article  PubMed  Google Scholar 

  14. Adler AI, Stratton IM, Neil HA, Yudkin JS, Matthews DR, Cull CA, Wright AD, Turner RC, Holman RR: Association of systolic blood pressure with macrovascular and microvascular complications of type 2 diabetes (UKPDS 36): prospective observational study. BMJ. 2000, 321: 412-419. 10.1136/bmj.321.7258.412.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Hansson L, Zanchetti A, Carruthers SG, Dahlof B, Elmfeldt D, Julius S, Menard J, Rahn KH, Wedel H, Westerling S: Effects of intensive blood-pressure lowering and low-dose aspirin in patients with hypertension: principal results of the Hypertension Optimal Treatment (HOT) randomised trial. HOT Study Group. Lancet. 1998, 351: 1755-1762. 10.1016/S0140-6736(98)04311-6.

    Article  CAS  PubMed  Google Scholar 

  16. Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 38. UK Prospective Diabetes Study Group. BMJ. 1998, 317: 703-713.

  17. Effects of ramipril on cardiovascular and microvascular outcomes in people with diabetes mellitus: results of the HOPE study and MICRO-HOPE substudy. Heart Outcomes Prevention Evaluation Study Investigators. Lancet. 2000, 355: 253-259. 10.1016/S0140-6736(99)12323-7.

  18. Estacio RO, Jeffers BW, Hiatt WR, Biggerstaff SL, Gifford N, Schrier RW: The effect of nisoldipine as compared with enalapril on cardiovascular outcomes in patients with non-insulin-dependent diabetes and hypertension. N Engl J Med. 1998, 338: 645-652. 10.1056/NEJM199803053381003.

    Article  CAS  PubMed  Google Scholar 

  19. Tatti P, Pahor M, Byington RP, Di Mauro P, Guarisco R, Strollo G, Strollo F: Outcome results of the Fosinopril Versus Amlodipine Cardiovascular Events Randomized Trial (FACET) in patients with hypertension and NIDDM. Diabetes Care. 1998, 21: 597-603. 10.2337/diacare.21.4.597.

    Article  CAS  PubMed  Google Scholar 

  20. Efficacy of atenolol and captopril in reducing risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 39. UK Prospective Diabetes Study Group. BMJ. 1998, 317: 713-720.

  21. Should all patients with type 1 diabetes mellitus and microalbuminuria receive angiotensin-converting enzyme inhibitors? A meta-analysis of individual patient data. Ann Intern Med. 2001, 134: 370-379.

  22. Shepherd J, Cobbe SM, Ford I, Isles CG, Lorimer AR, MacFarlane PW, McKillop JH, Packard CJ: Prevention of coronary heart disease with pravastatin in men with hypercholesterolemia. West of Scotland Coronary Prevention Study Group. N Engl J Med. 1995, 333: 1301-1307. 10.1056/NEJM199511163332001.

    Article  CAS  PubMed  Google Scholar 

  23. Pfeffer MA, Sacks FM, Moye LA, Brown L, Rouleau JL, Hartley LH, Rouleau J, Grimm R, Sestier F, Wickemeyer W: Cholesterol and Recurrent Events: a secondary prevention trial for normolipidemic patients. CARE Investigators. Am J Cardiol. 1995, 76: 98C-106C. 10.1016/S0002-9149(99)80478-0.

    Article  CAS  PubMed  Google Scholar 

  24. Prevention of cardiovascular events and death with pravastatin in patients with coronary heart disease and a broad range of initial cholesterol levels. The Long-Term Intervention with Pravastatin in Ischaemic Disease (LIPID) Study Group. N Engl J Med. 1998, 339: 1349-1357. 10.1056/NEJM199811053391902.

  25. Pyorala K, Pedersen TR, Kjekshus J, Faergeman O, Olsson AG, Thorgeirsson G: Cholesterol lowering with simvastatin improves prognosis of diabetic patients with coronary heart disease. A subgroup analysis of the Scandinavian Simvastatin Survival Study (4S). Diabetes Care. 1997, 20: 614-620. 10.2337/diacare.20.4.614.

    Article  CAS  PubMed  Google Scholar 

  26. Downs JR, Clearfield M, Weis S, Whitney E, Shapiro DR, Beere PA, Langendorfer A, Stein EA, Kruyer W, Gotto AM: Primary prevention of acute coronary events with lovastatin in men and women with average cholesterol levels: results of AFCAPS/TexCAPS. Air Force/Texas Coronary Atherosclerosis Prevention Study. JAMA. 1998, 279: 1615-1622. 10.1001/jama.279.20.1615.

    Article  CAS  PubMed  Google Scholar 

  27. Fodor JG, Frohlich JJ, Genest JJ, McPherson PR: Recommendations for the management and treatment of dyslipidemia. Report of the Working Group on Hypercholesterolemia and Other Dyslipidemias. Can Med Assoc J. 2000, 162: 1441-1447.

    CAS  Google Scholar 

  28. Executive Summary of The Third Report of The National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, And Treatment of High Blood Cholesterol In Adults (Adult Treatment Panel III). JAMA. 2001, 285: 2486-2497. 10.1001/jama.285.19.2486.

  29. Haffner SM, Lehto S, Ronnemaa T, Pyorala K, Laakso M: Mortality from coronary heart disease in subjects with type 2 diabetes and in nondiabetic subjects with and without prior myocardial infarction. N Engl J Med. 1998, 339: 229-234. 10.1056/NEJM199807233390404.

    Article  CAS  PubMed  Google Scholar 

  30. Mykkanen L, Kuusisto J, Pyorala K, Laakso M: Cardiovascular disease risk factors as predictors of type 2 (non-insulin-dependent) diabetes mellitus in elderly subjects. Diabetologia. 1993, 36: 553-559. 10.1007/BF02743273.

    Article  CAS  PubMed  Google Scholar 

  31. Bog-Hansen E, Lindblad U, Bengtsson K, Ranstam J, Melander A, Rastam L: Risk factor clustering in patients with hypertension and non-insulin-dependent diabetes mellitus. The Skaraborg Hypertension Project. J Intern Med. 1998, 243: 223-232. 10.1046/j.1365-2796.1998.0327h.x.

    Article  CAS  PubMed  Google Scholar 

  32. Lunetta M, Barbagallo A, Crimi S, Di Mauro M, Sangiorgio L, Mughini L: Hypertension and related risk factors in type 2 diabetes mellitus. Panminerva Med. 1998, 40: 169-173.

    CAS  PubMed  Google Scholar 

  33. Moore WV, Fredrickson D, Brenner A, Childs B, Tatpati O, Hoffman JM, Guthrie R: Prevalence of hypertension in patients with type II diabetes in referral versus primary care clinics. J Diabetes Complications. 1998, 12: 302-306. 10.1016/S1056-8727(98)00009-9.

    Article  CAS  PubMed  Google Scholar 

  34. Klein R, Klein BE: Diabetic eye disease. Lancet. 1997, 350: 197-204. 10.1016/S0140-6736(97)04195-0.

    Article  CAS  PubMed  Google Scholar 

  35. Early photocoagulation for diabetic retinopathy. ETDRS report number 9. Early Treatment Diabetic Retinopathy Study Research Group. Ophthalmology. 1991, 98: 766-785.

  36. Photocoagulation for diabetic macular edema. Early Treatment Diabetic Retinopathy Study report number 1. Early Treatment Diabetic Retinopathy Study research group. Arch Ophthalmol. 1985, 103: 1796-1806.

  37. Ferris FL: How effective are treatments for diabetic retinopathy?. JAMA. 1993, 269: 1290-1291. 10.1001/jama.269.10.1290.

    Article  PubMed  Google Scholar 

  38. Meltzer S, Leiter L, Daneman D, Gerstein HC, Lau D, Ludwig S, Yale JF, Zinman B, Lillie D: 1998 clinical practice guidelines for the management of diabetes in Canada. Canadian Diabetes Association. Can Med Assoc J. 1998, 159 Suppl 8:S1-29.: S1-29.

    Google Scholar 

  39. CP W, MA B, EY C: Diabetic Retinopathy - Preferred Practice Pattern. 1998, American Ophthalmology Society

    Google Scholar 

  40. J H: Diabetes in Ontario: An ICES Practice Atlas. 2003, Toronto, Institute for Clinical Evaluative Sciences, (in press)-

    Google Scholar 

  41. Logan AG: Report of the Canadian Hypertension Society's consensus conference on the management of mild hypertension. Can Med Assoc J. 1984, 131: 1053-1057.

    CAS  PubMed  PubMed Central  Google Scholar 

  42. Messerli FH, Grossman E, Goldbourt U: Are beta-blockers efficacious as first-line therapy for hypertension in the elderly? A systematic review. JAMA. 1998, 279: 1903-1907. 10.1001/jama.279.23.1903.

    Article  CAS  PubMed  Google Scholar 

  43. Staessen JA, Fagard R, Thijs L, Celis H, Arabidze GG, Birkenhager WH, Bulpitt CJ, de Leeuw PW, Dollery CT, Fletcher AE, Forette F, Leonetti G, Nachev C, O'Brien ET, Rosenfeld J, Rodicio JL, Tuomilehto J, Zanchetti A: Randomised double-blind comparison of placebo and active treatment for older patients with isolated systolic hypertension. The Systolic Hypertension in Europe (Syst-Eur) Trial Investigators. Lancet. 1997, 350: 757-764. 10.1016/S0140-6736(97)05381-6.

    Article  CAS  PubMed  Google Scholar 

  44. Hansson L, Lindholm LH, Ekbom T, Dahlof B, Lanke J, Schersten B, Wester PO, Hedner T, de Faire U: Randomised trial of old and new antihypertensive drugs in elderly patients: cardiovascular mortality and morbidity the Swedish Trial in Old Patients with Hypertension-2 study. Lancet. 1999, 354: 1751-1756. 10.1016/S0140-6736(99)10327-1.

    Article  CAS  PubMed  Google Scholar 

  45. Neal B, MacMahon S, Chapman N: Effects of ACE inhibitors, calcium antagonists, and other blood-pressure-lowering drugs: results of prospectively designed overviews of randomised trials. Blood Pressure Lowering Treatment Trialists' Collaboration. Lancet. 2000, 356: 1955-1964. 10.1016/S0140-6736(00)03307-9.

    Article  CAS  PubMed  Google Scholar 

  46. McAlister FA, Levine M, Zarnke KB, Campbell N, Lewanczuk R, Leenen F, Rabkin S, Wright JM, Stone J, Feldman RD, Lebel M, Honos G, Fodor G, Burgess E, Tobe S, Hamet P, Herman R, Irvine J, Culleton B, Petrella R, Touyz R: The 2000 Canadian recommendations for the management of hypertension: Part one--therapy. Can J Cardiol. 2001, 17: 543-559.

    CAS  PubMed  Google Scholar 

  47. Major outcomes in moderately hypercholesterolemic, hypertensive patients randomized to pravastatin vs usual care: The Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial (ALLHAT-LLT). JAMA. 2002, 288: 2998-3007. 10.1001/jama.288.23.2998.

  48. Tu K, Mamdani MM, Tu JV: Hypertension guidelines in elderly patients: is anybody listening?. Am J Med. 2002, 113: 52-58. 10.1016/S0002-9343(02)01144-0.

    Article  PubMed  Google Scholar 

  49. Meier JL, Lopez J, Siegel D: Prevalence and Treatment of Hypertension Complicated by Comorbid Conditions. J Clin Hypertens. 1999, 1: 209-211.

    Google Scholar 

  50. Tu K, Davis D: Can we alter physician behavior by educational methods? Lessons learned from studies of the management and follow-up of hypertension. J Contin Educ Health Prof. 2002, 22: 11-22. 10.1002/chp.1340220103.

    Article  PubMed  Google Scholar 

  51. MA B, G K, T W: Designing a quality improvement intervention: a systematic approach. Qual Saf Health Care. 2003,

    Google Scholar 

  52. Donner A, N K: Design and Analysis of Cluster Ramdomization Trials in Health Research. 2003, London, Arnold

    Google Scholar 

  53. DM M: Design and Analysis of Group-Randomized Trials. 1998, New York, Oxford University Press, 1-467.

    Google Scholar 

  54. I A: The Theory of Planned Behaviour. Organizational Behaviour and Human Decision Processes. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.

    Article  Google Scholar 

  55. Austin PC, Goel V, van Walraven C: An introduction to multilevel regression models. Can J Public Health. 2001, 92: 150-154.

    CAS  PubMed  Google Scholar 

  56. Anderson GM, Beers MH, Kerluke K: Auditing prescription practice using explicit criteria and computerized drug benefit claims data. J Eval Clin Pract. 1997, 3: 283-294. 10.1046/j.1365-2753.1997.t01-1-00005.x.

    Article  CAS  PubMed  Google Scholar 

  57. Davidson W, Molloy DW, Somers G, Bedard M: Relation between physician characteristics and prescribing for elderly people in New Brunswick. Can Med Assoc J. 1994, 150: 917-921.

    CAS  Google Scholar 

  58. RS P, DL R: Econometric Models and Economic Forecasts. 1998, New York, Irwin McGraw-Hill, 15: 4th

    Google Scholar 

  59. DA D, WA F: Distribution of the estimators for autoregressive time series with a unit root. J Am Stat Assoc. 1979, 74: 427-431. 10.2307/2286348.

    Google Scholar 

  60. GM L, GEP B: On a measure of lack of fit in time series models. Biometrika. 1978, 65: 297-303. 10.1093/biomet/65.2.297.

    Article  Google Scholar 

Download references

Acknowledgements

We wish to acknowledge input of Peter Ziedins, communications consultant, in the design of the outsert PEMs.

The OPEM trial is funded by the Canadian Institute of Health Research (CIHR).

Author information

Authors and Affiliations

  1. Institute for Clinical Evaluative Sciences, Toronto, Canada

    Merrick Zwarenstein, Janet E Hux, Diane Kelsall, Michael Paterson, Andreas Laupacis, Peter C Austin, Pamela M Slaughter, Susan K Shiller, Ruth Croxford & Karen Tu

  2. Clinical Epidemiology, Sunnybrook Health Sciences Centre, Toronto, Canada

    Merrick Zwarenstein, Janet E Hux & Andreas Laupacis

  3. Faculty of Medicine, University of Toronto, Toronto, Canada

    Merrick Zwarenstein, Janet E Hux, Diane Kelsall, Dave Davis & Andreas Laupacis

  4. Clinical Epidemiology Program, Ottawa Health Research Institute, Ottawa, Canada

    Jeremy Grimshaw

  5. Faculty of Medicine, University of Ottawa, Ottawa, Canada

    Jeremy Grimshaw

  6. Keenan research centre, Li Ka Shing Knowledge Instititue, St Michaels hopsital, Toronto, Canada

    Merrick Zwarenstein & Michael Evans

  7. Department of Public Health Sciences, University of Toronto, Toronto, Canada

    Peter C Austin

  8. Department of Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada

    Merrick Zwarenstein & Peter C Austin

  9. Canada Research Chair in Health Knowledge Transfer and Uptake, Ottawa, Canada

    Jeremy Grimshaw

Authors
  1. Merrick Zwarenstein
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Janet E Hux
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Diane Kelsall
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael Paterson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jeremy Grimshaw
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Dave Davis
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Andreas Laupacis
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Michael Evans
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Peter C Austin
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Pamela M Slaughter
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Susan K Shiller
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Ruth Croxford
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Karen Tu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Merrick Zwarenstein.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

All authors contributed to the development of the study.

All authors read and approved the final manuscript.

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Zwarenstein, M., Hux, J.E., Kelsall, D. et al. The Ontario printed educational message (OPEM) trial to narrow the evidence-practice gap with respect to prescribing practices of general and family physicians: a cluster randomized controlled trial, targeting the care of individuals with diabetes and hypertension in Ontario, Canada. Implementation Sci 2, 37 (2007). https://doi.org/10.1186/1748-5908-2-37

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1748-5908-2-37

Keywords

Implementation Science

ISSN: 1748-5908