Skip to main content

Effectiveness of a strategy that uses educational games to implement clinical practice guidelines among Spanish residents of family and community medicine (e-EDUCAGUIA project): a clinical trial by clusters

Abstract

Background

Clinical practice guidelines (CPGs) have been developed with the aim of helping health professionals, patients, and caregivers make decisions about their health care, using the best available evidence. In many cases, incorporation of these recommendations into clinical practice also implies a need for changes in routine clinical practice. Using educational games as a strategy for implementing recommendations among health professionals has been demonstrated to be effective in some studies; however, evidence is still scarce. The primary objective of this study is to assess the effectiveness of a teaching strategy for the implementation of CPGs using educational games (e-learning EDUCAGUIA) to improve knowledge and skills related to clinical decision-making by residents in family medicine. The primary objective will be evaluated at 1 and 6 months after the intervention. The secondary objectives are to identify barriers and facilitators for the use of guidelines by residents of family medicine and to describe the educational strategies used by Spanish teaching units of family and community medicine to encourage implementation of CPGs.

Methods/design

We propose a multicenter clinical trial with randomized allocation by clusters of family and community medicine teaching units in Spain. The sample size will be 394 residents (197 in each group), with the teaching units as the randomization unit and the residents comprising the analysis unit. For the intervention, both groups will receive an initial 1-h session on clinical practice guideline use and the usual dissemination strategy by e-mail. The intervention group (e-learning EDUCAGUIA) strategy will consist of educational games with hypothetical clinical scenarios in a virtual environment.

The primary outcome will be the score obtained by the residents on evaluation questionnaires for each clinical practice guideline. Other included variables will be the sociodemographic and training variables of the residents and the teaching unit characteristics. The statistical analysis will consist of a descriptive analysis of variables and a baseline comparison of both groups. For the primary outcome analysis, an average score comparison of hypothetical scenario questionnaires between the EDUCAGUIA intervention group and the control group will be performed at 1 and 6 months post-intervention, using 95 % confidence intervals. A linear multilevel regression will be used to adjust the model.

Discussion

The identification of effective teaching strategies will facilitate the incorporation of available knowledge into clinical practice that could eventually improve patient outcomes. The inclusion of information technologies as teaching tools permits greater learning autonomy and allows deeper instructor participation in the monitoring and supervision of residents. The long-term impact of this strategy is unknown; however, because it is aimed at professionals undergoing training and it addresses prevalent health problems, a small effect can be of great relevance.

Trial registration

ClinicalTrials.gov: NCT02210442.

Peer Review reports

Background

Clinical practice guidelines (CPGs) are a set of “systematically developed statements to assist practitioner and patient decisions about appropriate health care for specific clinical circumstances” [1]. CPGs are developed with the aim of helping health professionals, patients, and caregivers make decisions about their health care, using the best available evidence. Several studies have proven that following the recommendations of certain CPGs improves patients’ health outcomes [2, 3]. In Spain, the National Health System Quality Plan of the Spanish Ministry of Health and Social Policy (GuiaSalud) has developed high-quality CPGs and made them available to all health professionals; these guidelines demonstrate great teaching potential that could improve health care. Many of these CPGs specifically target primary care health professionals [4].

Greater publication and dissemination of a CPG does not necessarily result in its systematic use. In many cases, incorporation of the CPG recommendations into clinical practice also implies a need for changes in routine clinical practice [5, 6]; thus, a subsequent implementation stage must be planned. Implementing a CPG involves launching a process aimed at the successful understanding and application of set recommendations through the use of effective communication strategies to promote change. This process constitutes one of the basic phases of creating a CPG and requires a planning stage, in which special attention must be given to the context—both institutional and social—and the identification of barriers and facilitators that will determine later use of the CPG [5]. Several studies [79] have assessed factors that could influence implementation of evidence-based CPGs as well as selection of the best implementation strategies. CPGs are considered excellent teaching tools for acquiring skills and assessing clinical practice [1012]. They provide information on the usefulness of diagnostic tests and their application in clinical practice. The important role played by CPGs in enabling resident doctors to prescribe appropriately and to identify potential conflicts of interest must be highlighted [13]. The educational program for family and community medicine was the first in Spain to incorporate CPGs as tools to enable the acquisition of essential competencies. In this program, understanding the conceptual basis of clinical practice is considered the first priority (i.e., an essential competence must be acquired by all residents, whose absence would result in doubt about the resident’s aptitude) [14], along with knowledge of evidence-based medicine (EBM) as a tool for clinical management through the use of CPGs, focusing on the patient.

There is evidence of limited CPG use by both residents and their mentors [15]. Several studies have confirmed the limited use of CPGs by resident doctors in various areas, such as the prescription of antibiotics, preventive health activities, or handling prevalent pathologies such as hypertension or diabetes. A study evaluating antibiotic prescription in the treatment of urinary tract infections by family medicine residents at the Mayo Clinic found that only 30 % of prescriptions had been prescribed in accordance with the recommendations provided in the corresponding CPG [16]. Another study used a sample of 376 residents and explored how to approach renal failure treatment using a CPG that contained hypothetical clinical scenarios. The authors reported a significant lack of knowledge of the relevant risk factors, with the exception of hypertension [17]. In addition, the majority of the 127 residents included in a study assessing subjects’ knowledge regarding screening for colon cancer reported family history of colorectal cancer as a screening factor; however, their knowledge regarding screening recommendations in cases of familial colon polyposis was limited [18]. The effectiveness of the different strategies aimed at increasing adherence to CPG recommendations has previously been evaluated, and most have been shown to improve adherence; the implementation of educational programs, mostly as part of more complex interventions, has also been shown to improve outcomes [1921]. Some of these strategies specifically targeted resident doctors [17].

The teaching potential of educational games in stimulating learning and individuals’ ability to analyze, synthesize, and evaluate information has been widely studied [22]. In previous years, we have witnessed the incorporation of games as virtual educational tools for supporting the training of students and resident doctors [23, 24]. The inclusion of educational games as a strategy for implementing recommendations among health professionals and resident doctors counts on broad acceptance and helps students acquire new knowledge and abilities, in addition to improving attitudes in an interactive, playful way, thus improving adherence to recommendations [25, 26]. A Cochrane collaboration review concluded that there was no evidence supporting the effectiveness of educational games in the training of health professionals, and given their potential, it seems necessary to perform quality research on the impact of these games on health professional training. Research must include the evaluation of results regarding professional performance, decision-making, the clinical care process, and, if possible, patient outcomes [27, 28].

Our proposal regarding educational games [29] focuses on the guidelines approved by the National Health System Quality Plan of the Spanish Ministry of Health and Social Policy. The selection criteria of guidelines include their applicability to severe or chronic, highly prevalent pathologies in primary health care that are included in the relevant areas within which residents must acquire competencies. Several members of this trial’s research team have been part of the working groups that developed these guidelines and have participated in their subsequent dissemination and implementation [30].

Teaching strategies that improve resident doctors’ application of the CPG recommendations could have a direct impact on the improvement of health care. This impact would be particularly significant in the case of family medicine residents because more than 40 % of doctors who start their residency in Spain will train as family medicine doctors. These professionals will address the health problems of more than 90 % of the population; hence, any effective intervention in this group could have a significant effect.

Hypothesis

A teaching strategy based on the incorporation of educational games for the implementation of CPGs, compared with the usual dissemination strategy, will improve knowledge and abilities related to clinical decision-making by residents in family medicine. A difference of at least 10 points between the EDUCAGUIA intervention group and the control group in the evaluation questionnaires will be considered statistically significant.

Objectives

Primary

The primary objective of this study is to assess the effectiveness of a teaching strategy for the implementation of CPGs using educational games (e-learning EDUCAGUIA) to improve knowledge and abilities related to clinical decision-making by residents in family medicine, in contrast with typical CPG dissemination. The primary outcome will be evaluated at 1 and 6 months after the intervention.

Secondary

  1. 1.

    To describe the adherence to educational games and their acceptance by resident doctors

  2. 2.

    To describe the educational strategies used by Spanish family and community medicine teaching units to encourage CPG implementation

  3. 3.

    To identify barriers and facilitators for the use of CPGs by residents in family medicine

Methods/design

Design

A multicenter clinical trial with randomized allocation by clusters.

Phase I will consist of a survey collected from family medicine residency program directors in Spain, the development of the educational games interface, and the elaboration of the competence tests.

Phase II will comprise a qualitative study to identify barriers and facilitators to the guideline implementation (Fig. 1).

Fig. 1
figure 1

Flow diagram

Setting

Teaching units of family and community medicine (TUFCM) in Spain.

Study population

  1. 1.

    Teaching units of family and community medicine inclusion criteria

    1. a.

      Legal criteria: having Spanish Ministry of Health approval for family medicine teaching to resident doctors and nurses

    2. b.

      Residency program director agreement for trial participation

  2. 2.

    Family medicine residents’ inclusion criteria

    1. c.

      Third- and fourth-year residents belonging to teaching units of family and community medicine

    2. d.

      Not opposed to participation

Recruitment

All Spanish teaching units will be contacted by mail offering participation via an agreement form to participate in the EDUCAGUIA study. TUFCM agreeing to participate to the study will be randomly assigned to one of the two groups: the intervention or the control group.

Sample size

The sample size has been calculated considering a relevant post-intervention average difference of 10 points on a 100-point evaluation questionnaire between groups and a standard deviation of 0.5 [31]. Assuming an alpha error of 0.05 and a beta error of 0.10, 84 subjects are required for each group. Because randomization is performed by clusters, the sample size has been adjusted to take into account the design effect. Thus, for an average of 30 residents per teaching unit, and an intraclass correlation coefficient (ICC) of 0.03 (literature shows an ICC of 0–0.052 for similar teaching interventions) [32], a design effect of 1.87 has been obtained. With these assumptions, and expecting a 25 % loss to follow-up after a 6-month period, the required sample size is 394 (197 per group).

Randomization

Allocation will be performed by clusters, and the randomizing unit will be the teaching units. The analysis unit will be the residents. Randomization will be performed by using the Epidat 4.1 software module to assign patients’ treatments. The intervention “e-learning EDUCAGUIA” will be regarded as the treatment, and the routine CPG dissemination system will be used as a control variable. To obtain the same number of centers in both the intervention and control groups, the option of balanced groups will be chosen.

Intervention

Both groups will attend an initial 60-min session comprising the following content: CPGs—what they are and where to find them; information on and presentation of the GuiaSalud website and a link to the guidelines library; and instructions for downloading guidelines.

For the control group

Routine dissemination of clinical guidelines will be sent via e-mail. The link to the CPGs from the GuiaSalud website will be provided.

For the e-EDUCAGUIA intervention group

The e-learning EDUCAGUIA is a complex intervention that combines several components based on an educational game with a ranking and a competitive combination of game styles. It has been designed by a multidisciplinary team of primary healthcare professionals with experience in training students and residents, elaborating CPGs and developing new technologies as teaching tools. After routine disseminations of clinical guidelines via e-mail, as in the control group, residents belonging to the teaching units allocated in this intervention arm will be invited to access the educational games’ online training demo by e-mail. They will then have access to the e-learning EDUCAGUIA application software for one month.

Each guideline comprises different clinical scenarios related to several recommendation areas, each encompassing five dimensions (e.g., diagnosis, treatment, referral, information, and patient health education). The application will generate a report for each “game” or training session completed by the residents and will rank them accordingly to enable comparisons with the rest of the guideline users. Figure 2 shows the various components of both the control and the e-EDUCAGUIA intervention groups [33, 34].

Fig. 2
figure 2

Complex intervention pat plot. e-EDUCAGUIA

Competence assessment in both groups

An evaluation of baseline competence will be performed for each guideline prior to its presentation, and two further tests will be carried out at 1 and 6 months after the intervention. The test will evaluate the level of knowledge and decision-making in relation to ten hypothetical cases of routine clinical practice that are related to the content of each guideline; the test will yield a maximum score of 100 and will be completed within 45 min.

Variables

The primary outcome variable will be the participant score obtained in the test assessing competence 1 month after the intervention. The secondary outcome variable will be the competence test score 6 months after the intervention.

  1. (a)

    Teaching unit variables

    • Sociodemographic characteristics of the program director and technician: sex, age, specialty, academic level, time spent in that position, experience in elaborating guidelines or recommendation, and training in EBM

    • Unit characteristics: total number of residents (R1, R2, R3, R4); position of the teaching unit in the ranking, obtaining residency positions in the last three contests; a teaching plan that includes training on EBM/CPG in the unit; and the number of EBM/CPG training hours in the past year

  2. (b)

    Resident doctor variables

    • Sociodemographic: age, sex, nationality, residency year

    • Position in the national exams to access specialty (MIR number); grades obtained in R-1 and R-2 residency years (apt, outstanding, excellent); completion of other specialties; year of obtaining a university degree in medicine; and PhD (yes/no)

    • Training: specific training on EBM in the past 5 years and corresponding hours of training, training on critical reading capabilities and corresponding hours of training, having attended formative sessions on how to use CPGs, and corresponding hours of training

    • Other variables to achieve secondary objectives: adherence to CPGs, measured as time spent using the application.

All variables will be collected in an electronic case report form

For secondary objective 3, each teaching unit and mentor will receive an e-mail containing information on the project and inviting them to complete the survey with the link included. The questionnaire has been developed by the research team.

For secondary objective 4, a study using a qualitative methodology was performed in a phase prior to the beginning of the trial, including discussion groups that studied the barriers and facilitators in the use of CPGs. Using the results from that study, along with the questionnaire developed by Sola et al. [35] for Spanish doctors, a new questionnaire will be created that will be sent to the family medicine residents by the teaching units.

Statistical analysis

  1. 1.

    Descriptive and exploratory analysis: This analysis will include participants’ baseline characteristics and outcomes, means and standard deviations (SD) for continuous variables, and proportions for categorical variables with its corresponding 95 % confidence interval (CI). Baseline comparison between the two groups in terms of the score competence test and descriptive and prognostic factors will be performed by bi-variant statistical tests.

  2. 2.

    Inferential analysis: Student’s t test with a 95 % CI will be performed to compare both groups’ results in the competence test in terms of score at baseline and 1- and 6-month post-implementation of each CPG recommendation.

  3. 3.

    Multilevel analysis: a mixed model will be constructed for the evaluation of the influence of the teaching unit on the effectiveness of the intervention. The dependent variable will be the score obtained in the competence test. The model will consist of two levels: resident doctors will comprise the first level and the teaching unit will comprise the second.

  4. 4.

    Dropouts and missing data

Because this trial will use an online system to allocate participants and collect baseline and outcome data, participants can leave the study at any time. To minimize the possibility of dropouts and missing data, several strategies will be considered. If a participant leaves the study before randomization, the participant will be excluded and we will not consider this as missing participant data.

All statistical tests will be performed with an intention-to-treat analysis. The last observation carried forward will be used for missing data imputation, and there will be report analyses with and without imputation [36].

Significance will be set at p < .05. Calculations will be performed using MLwiN and STATA v.12 software with specific related modules.

Ethical and legal aspects

The trial will fulfill the standards of Good Clinical Practice and the principles of the last Helsinki Declaration (Brazil, 2013). The project has been approved by the Clinical Research Ethics Committee of the Alcorcón Foundation University Hospital in Madrid and the Central Committee for Research of the Primary Care Management of the Community of Madrid. In accordance with Spanish Law 15/1999 on personal data protection, confidentiality and anonymity will be guaranteed both at the execution phase of the trial and during the presentations or publications derived from it.

Discussion

Teaching units from across Spain will participate in this clinical trial, which anticipates high external outcome validity. Additionally, this intervention might provide information to consider for training in other specialties.

The intervention to be assessed cannot be masked, which could influence its effect. Because there is a possibility of contamination bias among residents, randomization by clusters has been proposed, under the assumption that the number of clusters will be sufficient for each group. Geographic dispersion of the teaching units reduces the possibility of contamination.

Teaching strategies are complex interventions; the design of educational games as an interactive, self-learning application allows for standardization of the intervention.

The considerable variability foreseen between teaching units regarding training in CPGs could imply that some residents have better training with some of these CPGs, which could result in a lack of improvement in these residents’ decision-making scores (competency test score). However, this possibility will be adjusted using the training variables of both the teaching units and the residents.

To evaluate the intervention’s effectiveness, the primary measurement will take place 1 month after implementation; at this time, our primary objective will be to confirm the effectiveness of the e-learning EDUCAGUIA strategy as a learning tool. Its effect at 6 months after the intervention might not remain, which would lead to a study on the effectiveness of reinforcement interventions. Measuring the primary response at 6 months was considered an option, but the characteristics of training during residency periods make it possible for the residents to acquire the knowledge and abilities of the intervention during rotations or other courses within that time period, thus hindering the isolation of the intervention effect.

Our proposal, which follows the recommendations by the Cochrane review, attempts to overcome the intervention effectiveness measured solely as an increase in knowledge. Therefore, our proposed outcome measure is clinical decision-making in hypothetical scenarios, which is a more realistic approach toward the implementation of guideline recommendations in the decision-making processes of health professionals. Currently, we cannot measure the outcome for all patients being attended by all residents who will receive training for all CPGs. Therefore, our aim is to evaluate at least a representative sample; in the case of recommendations for antibiotic prescription guidelines, we will evaluate the use of computerized clinical records and isolate the decisions of residents and mentors.

The identification of effective teaching strategies will facilitate the incorporation of available knowledge into clinical practice that could eventually improve patient outcomes. The inclusion of information technologies as teaching tools, adapted to training methodologies for adults, permits greater learning autonomy and simultaneously acts as a teaching tool by allowing greater instructor participation in the monitoring and supervision of residents in the relevant knowledge area. The long-term impact of this strategy is unknown; however, because it is aimed at professionals undergoing training (who must acquire the correct habits and abilities) and it addresses prevalent health problems, a small effect can be of great relevance.

Abbreviations

CI:

confidence interval

CPG:

clinical practice guideline

EBM:

evidence-based medicine

References

  1. Institute of Medicine. Clinical Practice Guidelines: Directions for a new program. 1st ed. Field MJ,Lohr KN, editors. Committee to Advise the Public Health Service on Clinical Practice Guidelines. Washington DC: The National Academies Press; 1990.

  2. Bahtsevani C, Udén G, Willman A. Outcomes of evidence-based clinical practice guidelines: a systematic review. Int J Technol Assess Health Care. 2004;20:427–33.

    Article  PubMed  Google Scholar 

  3. Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30.

    Article  PubMed  Google Scholar 

  4. Portal GuiaSalud [Internet]. Available from:http://portal.guiasalud.es/web/guest/home. Accessed 9 May 2016.

  5. Grupo de trabajo sobre implementación de GPC. Implementación de Guías de Práctica Clínica en el Sistema Nacional de Salud. Manual Metodológico. Plan de Ca. Volumen 129. Madrid: Guías de Práctica Clínica en el SNS: I + CSNo 2007/02-02; 2009.

  6. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess (Rockv). 2004;8:iii–iv. 1-72.

    CAS  Google Scholar 

  7. Graham B. Clinical practice guidelines: what are they and how should they be disseminated? Hand Clin. 2014;30:361–5. vii.

    Article  PubMed  Google Scholar 

  8. Abdel-Kader K, Greer RC, Boulware LE, Unruh ML. Primary care physicians’ familiarity, beliefs, and perceived barriers to practice guidelines in non-diabetic CKD: a survey study. BMC Nephrol. 2014;15:64.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Kotzeva A, Guillamõn I, Gracia J, Díaz Del Campo P, Gich I, Calderõn E, Gaminde I, Louro-González A, Martínez F, Orrego C, Rotaeche R, Salcedo F, Alonso-Coello P. Use of clinical practice guidelines and factors related to their uptake: a survey of health professionals in Spain. J Eval Clin Pract. 2014;20:216–24.

    Article  PubMed  Google Scholar 

  10. Staton LJ, Kraemer SM, Patel S, Talente GM, Estrada CA. Peer chart audits: a tool to meet Accreditation Council on Graduate Medical Education (ACGME) competency in practice-based learning and improvement. Implement Sci. 2007;2:24.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Bachman KH, Mazur DJ. Using practice guidelines to teach residents. Acad Med . 1998;73:118–9.

    Article  CAS  PubMed  Google Scholar 

  12. Akl EA, Mustafa R, Wilson MC, Symons A, Moheet A, Rosenthal T, Guyatt GH, Schünemann HJ. Curricula for teaching the content of clinical practice guidelines to family medicine and internal medicine residents in the US: a survey study. Implement Sci. 2009;4:59.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Rubin EB, Bernat JL. Conflicts of interest between physicians and the pharmaceutical industry: focus on headache medicine. Headache. 2008;48:1545–9.

    Article  PubMed  Google Scholar 

  14. Ministerior Sanidad y Consumo: Orden SCO/1198/2005, de 3 de marzo, por la que se aprueba y publica el Programa Formativo de la Especialidad de Medicina Familiar y Comunitaria. 2005:15182–15225.

  15. Feder G, Eccles M, Grol R, Griffiths C, Grimshaw J. Clinical guidelines: using clinical guidelines. BMJ. 1999;318:728–30.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Grover ML, Bracamonte JD, Kanodia AK, Bryan MJ, Donahue SP, Warner A-M, Edwards FD, Weaver AL. Assessing adherence to evidence-based guidelines for the diagnosis and management of uncomplicated urinary tract infection. Mayo Clin Proc. 2007;82:181–5.

    Article  PubMed  Google Scholar 

  17. Geiger WJ, Neuberger MJ, Bell GC. Implementing the US preventive services guidelines in a family practice residency. Fam Med. 1993;25:447–51.

    CAS  PubMed  Google Scholar 

  18. Barrison AF, Smith C, Oviedo J, Heeren T, Schroy PC. Colorectal cancer screening and familial risk: a survey of internal medicine residents’ knowledge and practice patterns. Am J Gastroenterol. 2003;98:1410–6.

    Article  PubMed  Google Scholar 

  19. Shekelle P, Eccles MP, Grimshaw JM, Woolf SH. When should clinical guidelines be updated? BMJ. 2001;323:155–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Kryworuchko J, Stacey D, Bai N, Graham ID. Twelve years of clinical practice guideline development, dissemination and evaluation in Canada (1994 to 2005). Implement Sci. 2009;4:49.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Grimshaw J, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, Vale L. Toward evidence-based quality improvement: Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. J Gen Intern Med. 2006;2006 Suppl. 2:14–20.

    Google Scholar 

  22. Allery LA. Educational games and structured experiences. Med Teach. 2004;26:504–5.

    Article  PubMed  Google Scholar 

  23. Akl EA, Pretorius RW, Sackett K, Erdley WS, Bhoopathi PS, Alfarah Z, Schünemann HJ. The effect of educational games on medical students’ learning outcomes: a systematic review: BEME Guide No 14. Med Teach. 2010;32:16–27.

    Article  PubMed  Google Scholar 

  24. Blakely G, Skirton H, Cooper S, Allum P, Nelmes P. Use of educational games in the health professions: a mixed-methods study of educators’ perspectives in the UK. Nurs Heal Sci. 2010;12:27–32.

    Article  Google Scholar 

  25. Akl EA, Mustafa R, Slomka T, Alawneh A, Vedavalli A, Schünemann HJ. An educational game for teaching clinical practice guidelines to Internal Medicine residents: development, feasibility and acceptability. BMC Med Educ. 2008;8:50.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Akl EA, Gunukula S, Mustafa R, Wilson MC, Symons A, Moheet A, Schünemann HJ. Support for and aspects of use of educational games in family medicine and internal medicine residency programs in the US: a survey. BMC Med Educ. 2010;10:26.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Akl EA, Sackett K, Pretorius R, Erdley S, Bhoopathi PS, Mustafa R, Schünemann HJ: Educational games for health professionals. Cochrane Database Syst Rev 2008:CD006411.

  28. Akl EA, Sackett KM, Erdley WS, Mustafa RA, Fiander M, Gabriel C, Schuenemann H: Educational games for health professionals. Cochrane Database Syst Rev 2013:CD006411.

  29. Levac DE, Miller PA. Integrating virtual reality video games into practice: clinicians’ experiences. Physiother Theory Pract. 2013;29:504–12.

    Article  PubMed  Google Scholar 

  30. Bhoopathi PS, Sheoran R, Adams CE. Educational games for mental health professionals: a Cochrane review. Int J Psychiatr Nurs Res. 2007;12:1497–502.

    CAS  PubMed  Google Scholar 

  31. Cohen J. A power primer. Psychol Bull. 1992;112:155–9.

    Article  CAS  PubMed  Google Scholar 

  32. Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ. Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol. 2004;57:785–94.

    Article  PubMed  Google Scholar 

  33. Perera R, Heneghan C, Yudkin P. Graphical method for depicting randomised trials of complex interventions. BMJ Br Med J. 2007;334:127–9.

    Article  Google Scholar 

  34. Hooper R, Froud RJ, Bremner SA, Perera R, Eldridge S. Cascade diagrams for depicting complex interventions in randomised trials. BMJ. 2013;347:f6681.

    Article  PubMed  Google Scholar 

  35. Solà I, Carrasco JM, Díaz Del Campo P, Gracia J, Orrego C, Martínez F, Kotzeva A, Guillamón I, Calderón E, de Gaminde I, Louro A, Rotaeche R, Salcedo F, Velázquez P, Alonso-Coello P. Attitudes and perceptions about clinical guidelines: a qualitative study with Spanish physicians. PLoS One. 2014;9:e86065.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Altman DG. Missing outcomes in randomized trials: addressing the dilemma. Open Med.2009;3(2):e51–3.

Download references

Acknowledgements

We would like to thank Yolanda Rodriguez Pachon and Pilar Pamplona for their administrative support.

We would like to thank Pablo Alonso, Rafa Rotaeche, Javier Gracia (National Health System Quality Plan of the Spanish Ministry of Health and Social Policy (GuiaSalud)) and Grupo de Infecciosas de la Sociedad Madrileña de Medicina de Familia y comunitaria (Somamfyc) for their input in the design phase of this study.

Thanks to vibra and atento TM for their patience and support in the development of the project.

Funding

This study was funded by the Fondo de Investigaciones Sanitarias FIS Grant Number PI11/0477 ISCIII.-REDISSEC Proyecto RD12/0001/0012 AND FEDER Funding.

EDUCAGUIA GROUP (GROUP AUTHORSHIP)

Araceli Garrido Barral, AGB. Centro De Salud Barrio del Pilar. Calle de Finisterre, 18, 28029 Madrid. Servicio Madrileño de Salud. Madrid, Spain. araceli.garrido@salud.madrid.org

Aurora Fernández Moreno, AFM. Unidad Docente Multiprofesional Atención Familiar y Comunitaria Centro. Gerencia de Atención Primaria. Servicio Madrileño de Salud, (Calle San Martín de Porres, 6), 28035, Spain. Departamento de Medicina. Universidad Complutense de Madrid. afernandezmoreno@salud.madrid.org

Emilio Cervera Barba, ECB. Unidad Docente Multiprofesional Atención Familiar y Comunitaria Noroeste. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), 28035, Madrid. Spain. Departamento de Medicina. Universidad Complutense de Madrid. emilio.cervera@salud.madrid.org

María Teresa Rodríguez Monje, MTRM. Unidad Docente Multiprofesional Atención Familiar y Comunitaria Sur. Gerencia de Atención Primaria. Servicio Madrileño de Salud, (Calle San Martín de Porres, 6), Madrid (28035), Spain. mrmonje@salud.madrid.org

Ana Gorroñogoitia Iturbe, AGI. Unidad Docente Multiprofesional de Atención Familiar y Comunitaria de Bizkaia. Ambulatorio de Deusto C/Luis Power 48014, Bilbao. anaisabel.gorronogoitiaiturbe@osakidetza.eus

M Eulalia Mariñelarena Mañeru, MEMM. Unidad Docente Multiprofesional de Atención Familiar y Comunitaria de Gipuzkoa. P° Doctor Beguiristain s/n H Universitario de Donostia. Buzón 60. eulalia.marinelarenamaneru@osakidetza.eus

Luis Ignacio Mendibil Crespo, LIMC. Unidad Docente Multiprofesional de Atención Familiar y Comunitaria de Bizkaia. Ambulatorio de Deusto C/Luis Power 48014, Bilbao. luisignacio.mendibilcrespo@osakidetza.eus

Mª Josefa Gil de Gómez Barragan, MJGGB. Hospital San Pedro. Unidades Docentes de la Rioja. c/Piqueras 98, 26006 Logroño. La Rioja. Spain. jggomez@riojasalud.es

Sofía Garrido Elustondo, SGE. Unidad Docente Multiprofesional de Atención Familiar y Comunitaria Sureste. Unidad de Apoyo a la Investigación. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), Madrid (28035), Madrid, Spain. Red de Investigacion en Servicios de Salud en enfermedades crónicas (REDISSEC) sgarrido@salud.madrid.org

Rosario Riesgo Fuertes, RRF. Unidad Docente Multiprofesional de Atención Familiar y Comunitaria Sur. Unidad de Apoyo a la Investigación. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), 28035, Madrid, Spain. Red de Investigacion en Servicios de Salud en enfermedades crónicas (REDISSEC) rosario.riesgo@salud.madrid.org

Luisa María Cabello Ballesteros, LMCB. Unidad Docente Multiprofesional. Unidad de Apoyo a la Investigación. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), 28035, Madrid, Spain. luisa.cabello@salud.madrid.org

Rocío Álvarez Nido, RAN. Centro de Salud San Blas. Calle de San Blas, 24A, 28981 Parla, Madrid, Madrid. 28981 Parla, Madrid. Gerencia Atención Primaria. Servicio Madrileño de Salud ralvarez.gapm10@salud.madrid.org

Paloma Casado Pérez, PCP. AFM. Unidad Docente Multiprofesional Atención Familiar y Comunitaria Centro. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), Madrid (28035), Spain. pcasado@salud.madrid.org

Cruz Bartolome Moreno, CBM. Unidad Docente Multiprofesional Atención Familiar y Comunitaria de Zaragoza Sector Zaragoza I. C/Eugenio Lucas, 31–33. 50018. Zaragoza. Spain. cbartolomem@hotmail.com

Guillermo Cairo Rojas, GCR. Unidad Docente Multiprofesional de Atención Familiar y Comunitaria de Bizkaia. Ambulatorio de Deusto C/Luis Power 48014, Bilbao guillermo.cairo@osakidetza.eus

Jose Luis Lopez Rivas, JLLR. Unidad Docente Multiprofesional de Atención Familiar y Comunitaria de Bizkaia. Ambulatorio de Deusto C/Luis Power 48014, Bilbao. joseluis.lopezrivas@osakidetza.eus

Amaya Zenarutzabeitia Pikatza, AZP. Unidad Docente de Atención Familiar y Comunitaria de Bizkaia. Ambulatorio de Deusto C/Luis Power 48014, Bilbao. amaya.zenarutzabeitiapikatza@osakidetza.eus

Carmen Sánchez Celaya, CSC. Unidad Docente Multiprofesional Atención Familiar y Comunitaria de Alcañiz. Sector Zaragoza II. Servicio Aragonés de Salud. C/Andres Vives s/n, 44600 Alcañiz. Teruel. Spain. mcscelaya@yahoo.com

Mariel Morey Montalvo, MMM. Unidad de Apoyo a la Investigación. Gerencia de Atención Primaria, Servicio Madrileño de Salud, (Calle San Martín de Porres, 6), Madrid (28035). Madrid, Spain. Red de Investigación en Servicios de salud en enfermedades crónicos (REDISSEC). mariel.morey@salud.madrid.org

Lizzy Paola Cisneros Almeida, LPCA. Servicio Medicina Preventiva. Hospital Puerta del Hierro. Majadahonda. Madrid. Spain. lizzypaola.cisneros@salud.madrid.org

Manuel Del Álamo Rodríguez, MDAR. Servicio Microbiología. Servicio Medicina Preventiva. Hospital Universitario Severo Ochoa, Leganés. Madrid, Spain malamo.hsvo@salud.madrid.org

Alberto López García-Franco, ALGF. Centro De Salud Mendiguchía-Carriche. Plaza de la Comunidad de Madrid s/n, 28914 Leganés, Madrid. Gerencia Atención Primaria. Servicio Madrileño de Salud. Presidencia Sociedad Madrileña de Medicina Familiar y Comunitaria. algarciafranco@salud.madrid.org

Elisa Ceresuela Weismann, ESW. Centro De Salud Gregorio Marañón. Calle Escolares, S/N, 28923 Alcorcón, Madrid. Gerencia Atención Primaria. Servicio Madrileño Salud. elisacw@yahoo.es

Remedios Martín Álvarez, RMA. EBA Vallcarca-Sant Gervasi. Edifici Pedraforca i Edifici Montseny. Av. Vallcarca, 169–205. Servicio Catalán de Salud. martin@perevirgili.catsalut.net

Beatriz Medina Bustillo, BMB. Servicio Farmacia Dirección Asistencial Sur. Av. de los Reyes Católicos, 37, 28901 Getafe, Madrid Gerencia de Atención Primaria. Servicio Madrileño de Salud. beatriz.medina@salud.madrid.org

Marta Sánchez-Celaya del Pozo, MSCP. Gerencia Asistencial Atención Primaria. Servicio Madrileño de Salud. Red de Investigacion en Servicios de Salud en enfermedades crónicas (REDISSEC) marta.sanchezcelaya@salud.madrid.org

Luis Sánchez Perruca. Dirección Sistemas de Información. Gerencia Atención Primaria. Servicio Madrileño Salud. Red de Investigación en Servicios de Salud en enfermedades crónicas (REDISSEC). Luis.sanchez@salud.madrid.org

Miguel Ángel Salinero Fort.MSF. Gerencia de Atención Primaria. Servicio Madrileño de Salud, (Calle San Martín de Porres, 6), Madrid (28035), Spain. Instituto de Investigación Sanitaria La Paz (Idipaz). Red de Investigación en Servicios de Salud en enfermedades crónicas (REDISSEC). miguel.salinero@salud.madrid.org

Carmen de Burgos Luna CBL. Subdirección de Promoción. Dirección General de Salud Pública. Instituto de Investigación Sanitaria La Paz (Idipaz). Red de Investigacion en Servicios de Salud en enfermedades crónicas (REDISSEC). Carmen.deburgos@salud.madrid.org

Angel Mataix SanJuan AMS, Subdirección General de Farmacia. Servicio Madrileño de Salud. Red de Investigacion en Servicios de Salud en enfermedades crónicas (REDISSEC). angel.mataix@salud.madrid.org

Marta Alcaraz Borrajo MAB, Subdirección General de Farmacia. Servicio Madrileño de Salud. Red de Investigación en Servicios de Salud en enfermedades crónicas (REDISSEC). Marta.alcaraz@salud.madrid.org

Javier de Miguel Díaz. Servicio de Neumología. Hospital General Universitario Gregorio Marañón, Instituto de Investigación Sanitaria Gregorio Marañón (IiSGM), Universidad Complutense de Madrid, C/Doctor Esquerdo 46, 28007, Madrid, Spain. Red de Investigacion en Servicios de Salud en enfermedades crónicas (REDISSEC). javier.miguel@salud.madrid.org

Nerea Fernández Larrea NFL. Centro Nacional de Epidemiologia. Instituto de Salud Carlos III. Red de Investigación en Servicios de Salud en enfermedades crónicas (REDISSEC) nerea.fernandez@salud.madrid.org

Tomas Gómez Gascón. TGG. Centro Salud Guayaba. Gerencia Atención Primaria. Servicio Madrileño Salud. Red de Investigación en Servicios de Salud en enfermedades crónicas (REDISSEC) tomas.gomez@salud.madrid.org

Ana Pastor Rodriguez-Moñino, APRM. Unidad de Apoyo Gerencia Asistencial Atención Primaria. Servicio Madrileño de Salud. Pza. Carlos Trías Bertrán, 7. Edificio Sollube II, 28020 Madrid apastor@salud.madrid.org

Sonia Soto Díaz, SSD. Unidad Docente Multiprofesional Atención Familiar y Comunitaria Oeste. Unidad de Apoyo a la Investigación. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), 28035, Madrid, Spain. sonia.soto@salud.madrid.org

Silvia Pulido Fernández, SPF. Unidad Docente Multiprofesional Atención Familiar y Comunitaria Norte Unidad de Apoyo a la Investigación. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), 28035, Madrid, Spain. silvia.pulido@salud.madrid.org

Angel Alberquilla Menéndez-Asenjo, AAMA. Unidad Docente Multiprofesional Atención Familiar y Comunitaria Centro. Unidad de Apoyo a la Investigación. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), 28035, Madrid, Spain. Red de Investigacion en Servicios de Salud en enfermedades crónicas (REDISSEC) angel.alberquilla@salud.madrid.org

Luis García Olmos LGO. Unidad Docente Multiprofesional Atención Familiar y Comunitaria Sureste. Unidad de Apoyo a la Investigación. Gerencia de Atención Primaria. Servicio Madrileño de Salud. (Calle San Martín de Porres, 6), 28035, Madrid, Spain. Red de Investigación en Servicios de Salud en enfermedades crónicas (REDISSEC) lgarciao@salud.madrid.org

Author information

Authors and Affiliations

Authors

Consortia

Corresponding author

Correspondence to Isabel del Cura-González.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

ICG conceived the study and participated in its design and coordination. TSC, RRB, JMF, GAC, EPC, BRC, EEM, MRB, VHS, AIGG, JALR, EOR, AAL, AGB, JFAT, AFM, ECB, MTRM, AGI, MEMM, LIMC, MJGGB, RFP, JMG, METB, and MTM participated in different phases of the protocol study design. ICG wrote the final manuscript, and JALR, EOR, AAL, TSC, RRB, JMF, GAC, EPC, BRC, EEM, MRB, JBC, and LPCA collaborated in the writing of the manuscript. All authors and authors from the EDUCAGUIA group have read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

del Cura-González, I., López-Rodríguez, J.A., Sanz-Cuesta, T. et al. Effectiveness of a strategy that uses educational games to implement clinical practice guidelines among Spanish residents of family and community medicine (e-EDUCAGUIA project): a clinical trial by clusters. Implementation Sci 11, 71 (2015). https://doi.org/10.1186/s13012-016-0425-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-016-0425-3

Keywords