Skip to main content
Download PDF
Download ePub
  • Research article
  • Open access
  • Published:

The European Society of Human Reproduction and Embryology guideline for the diagnosis and treatment of endometriosis: an electronic guideline implementability appraisal

Implementation Science volume 6, Article number: 7 (2011) Cite this article

Abstract

Background

Clinical guidelines are intended to improve healthcare. However, even if guidelines are excellent, their implementation is not assured. In subfertility care, the European Society of Human Reproduction and Embryology (ESHRE) guidelines have been inventoried, and their methodological quality has been assessed. To improve the impact of the ESHRE guidelines and to improve European subfertility care, it is important to optimise the implementability of guidelines. We therefore investigated the implementation barriers of the ESHRE guideline with the best methodological quality and evaluated the used instrument for usability and feasibility.

Methods

We reviewed the ESHRE guideline for the diagnosis and treatment of endometriosis to assess its implementability. We used an electronic version of the guideline implementability appraisal (eGLIA) instrument. This eGLIA tool consists of 31 questions grouped into 10 dimensions. Seven items address the guideline as a whole, and 24 items assess the individual recommendations in the guideline. The eGLIA instrument identifies factors that influence the implementability of the guideline recommendations. These factors can be divided into facilitators that promote implementation and barriers that oppose implementation. A panel of 10 experts from three European countries appraised all 36 recommendations of the guideline. They discussed discrepancies in a teleconference and completed a questionnaire to evaluate the ease of use and overall utility of the eGLIA instrument.

Results

Two of the 36 guideline recommendations were straightforward to implement. Five recommendations were considered simply statements because they contained no actions. The remaining 29 recommendations were implementable with some adjustments. We found facilitators of the guideline implementability in the quality of decidability, presentation and formatting, apparent validity, and novelty or innovation of the recommendations. Vaguely defined actions, lack of facilities, immeasurable outcomes, and inflexibility within the recommendations formed barriers to implementation. The eGLIA instrument was generally useful and easy to use. However, assessment with the eGLIA instrument is very time-consuming.

Conclusions

The ESHRE guideline for the diagnosis and treatment of endometriosis could be improved to facilitate its implementation in daily practice. The eGLIA instrument is a helpful tool for identifying obstacles to implementation of a guideline. However, we recommend a concise version of this instrument.

Peer Review reports

Background

Clinical guidelines are important tools for improving the quality, effectiveness, and appropriateness of healthcare [1–5]. They are intended to bridge the gap between research and practice and to assist clinicians and patients in clinical decision making [2, 6, 7]. Moreover, they can reduce the use of unnecessary diagnostic tests and treatments [8]. However, adherence to guidelines is often poor and not self-evident [9–13]. Implementation of guidelines requires 'turning changes in attitude and knowledge into changes in medical practice' [14]. To improve guideline adherence and consequently healthcare, the implementability of the guidelines should be taken into account [15, 16].

Factors that influence the implementability of guidelines can be divided into facilitators that promote implementation and barriers that oppose implementation [17]. Various studies describe these factors [17–20], which can be classified as factors relating to physicians or patients, to the methodological quality of a guideline (including the clarity and applicability of its recommendations), and to the external context (e.g., legislation and required facilities) [21].

Implementation of guidelines is significant in many medical disciplines and is especially important in subfertility care because it is concerned with social, financial, legal, and ethical implications [22]. Subfertility is defined as lack of conception after at least one year of unprotected intercourse [23]. Approximately 80 million people worldwide suffer from this disorder [24]. More than half of subfertile couples seek medical care [25]. Clinical guidelines can be helpful to set standards and to organise the care properly. Emslie and coworkers showed improvements in the process of subfertility care with the use of guidelines [1]. Collaboration in developing the European subfertility guidelines could improve their scientific validity and promote international consensus on their clinical content [4, 26, 27]. This may help reduce practice variation and quality defects at an international level.

The European Society for Human Reproduction and Embryology (ESHRE) is one of the international organisations that participates in the process of developing international clinical practice guidelines in the area of reproductive medicine [28]. Nelen and coworkers evaluated 11 ESHRE guidelines with the validated Appraisal of Guidelines for Research and Evaluation (AGREE) instrument [29, 30]. The methodological quality of most of these clinical ESHRE guidelines was poor, while the quality of five of the guidelines was better. The ESHRE guideline for the diagnosis and treatment of endometriosis had the highest methodological quality. However, data about the implementability of these guidelines are not available. Such data are crucial for better application of the ESHRE guidelines.

Various methods have been developed for assessing guideline implementability [31, 32]. Shiffman and coworkers recently developed an instrument, the guideline implementability appraisal (GLIA) instrument, for which evidence of content validity and support for construct validity were obtained [33]. The instrument contains a series of validated questions for assessing the relative ease of implementation of guideline recommendations. It identifies potential obstacles to implementation that are primarily intrinsic to the guideline. This makes the instrument useful for guideline developers to remedy defects in guidelines and for guideline implementers to identify barriers [33]. Moreover, an electronic version of this tool has been developed: the eGLIA instrument.

We investigated the implementability of the ESHRE guideline on endometriosis with the eGLIA instrument to identify potential barriers to implementation and to refine the guideline. We also evaluated the eGLIA instrument for its usefulness and feasibility as an appraisal tool for improving the implementability of a guideline.

Methods

Clinical practice guideline

We reviewed the ESHRE guideline for the diagnosis and treatment of endometriosis, which contains 36 recommendations (Additional File 1, Appendix 1). We used the published paper version of the guideline for our appraisal [34].

Appraisal instrument

The GLIA instrument, developed by Shiffman and coworkers, was used to identify obstacles to implementation [33] (Additional file 2, Appendix 2). The first part of the GLIA instrument consists of seven global dimension questions (Q1-Q7) that relate to the guideline as a whole. The second part of the instrument consists of 24 questions for assessing the implementability of each individual recommendation (Q8-Q31). These questions are grouped into nine dimensions: decidability (n = 3), executability (n = 2), effect on process of care (n = 2), presentation and formatting (n = 2), measurable outcomes (n = 2), apparent validity (n = 2), novelty (n = 3), flexibility (n = 4), and computability (n = 4). The last four questions rating computability are optional and only apply when an electronic implementation is planned. All items have four response categories: 'Y' (yes), 'N' (no), 'NA' (not applicable), and '?' (unsure). The GLIA instrument provides additional space for comments about how a recommendation fulfils or fails to fulfil a criterion. Additional File 3, Appendix 3 gives an example of scoring. The GLIA instrument does not provide an overall judgement of the implementability of the guideline as a whole. Therefore, we added an extra question to seek the general opinion of the appraisers about the implementability of the guideline. We used a five-point Likert scale (1 = definitely not implementable, 5 = definitely implementable) to assess the rating.

We used eGLIA, the electronic version of the GLIA instrument http://nutmeg.med.yale.edu/eglia/. This electronic tool has an advantage over the paper version because it is useful and feasible to use with limited training and time [35]. Moreover, the electronic version offers automatic data storage, which was especially advantageous for our appraisers coming from different countries.

Composition of the panel of appraisers

We composed a balanced panel of 10 clinical and methodology experts. We selected six clinical experts: two developers of the guideline about endometriosis (TD and GD), one expert on endometriosis (AS), and three experts in subfertility care from the Special Interest Group on Safety and Quality in Assisted Reproductive Technology (SIG SQUART) from ESHRE (CB, KN, and PS). Furthermore, two researchers from the department of Obstetrics and Gynaecology (LD and WN) and two experts in quality of care (JB and CM), one of whom had special expertise with the eGLIA instrument (CM), participated in this study. The appraisers came from Belgium, Sweden, the Netherlands, and New Zealand.

Appraisal of the guideline

We asked the panel members to read the ESHRE guideline for the diagnosis and treatment of endometriosis and to assess it with the eGLIA instrument using their own computers.

We collected the individual scores of the participants and determined the discrepancies in scoring. We sent every appraiser an overview of his or her answers and the frequencies in the other participants' scores. This overview made differences in scoring clear for each assessor. There was a one-hour telephone conference to discuss the discrepancies between assessments and to come to a final score, as the eGLIA tool indicates to do. The content experts helped resolve questions answered with '?' (unsure) in this phone conference. Then the participants decided conclusively whether a recommendation had met a particular criterion or failed it. Each final decision was based on agreement reached by an absolute majority of the participants (difference ≥2).

Analysis

Items voted for by an absolute majority of participants were marked. Items with the answer 'No' were seen as barriers. Items with the answer 'Yes' were seen as facilitators. Items with a slight majority (one-point difference) were treated as borderline barriers. Questions that were answered 'No' and did not satisfy the criterion were listed as barriers, and recommendations for adjustments or changes were made.

Process evaluation of eGLIA

The appraisers individually completed a questionnaire (12 questions) about their experience with the eGLIA instrument immediately after they used it. The questionnaire included items about time investment, clarity and usability of the instrument, and relevance of the eGLIA tool questions. The questions were evaluated on a five-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). We performed descriptive statistical analyses with SPSS for Windows Release 14.0 Standard Version (SPSS Inc., Chicago, IL, USA).

Results

Appraisal of the guideline

Eight of the 10 participants appraised all 36 recommendations with 24 questions. One appraiser assessed 25 recommendations, and one participant appraised only 7 recommendations because of lack of time.

In the final report (Additional File 4, Appendix 4), 69 questions are marked as barriers (in red) and 501 as facilitators (in green). Twelve borderline barriers (doubtful items with only one-point difference) were marked separately (in orange) with inside in the table written the tendency toward which answer.

The guideline included five 'recommendations' (R14, R26, R31, R34, and R36) that did not have a described condition or action, the so-called nonrecommendations. These nonrecommendations were statements or observations that could not be appraised with the eGLIA instrument. Therefore, we excluded them from further analyses.

When we analysed the global dimension, we found three barriers to implementation (Q3-Q5). First, the guideline did not address strategies for implementation (Q3), although it seemed that dissemination of the guideline had been undertaken with an online version. Second, there was no tool for application (Q4) available, such as a summary document. The electronic version on the ESHRE website http://www.guidelines.endometriosis.org/ provided access to a concise summary and supporting documentation, but the paper version of the guideline did not refer to this. Third, the differences in the importance of the recommendations (Q5) were only described at the level of evidence. A clear presentation or formatting reflecting the differences was lacking.

Regarding the individual recommendations, two were straightforward to implement (R1 and R12). The remaining 29 recommendations contained one or more barriers.

Facilitators

The guideline scored very well on four dimensions, which can be considered implementation facilitators. First, the dimension of decidability (Q8-Q10) had positive scores for almost all recommendations. The description of the conditions and their mutual relations were very clear. All recommendations were easily identifiable because they were summarised in frames. Only two recommendations (R19 and R32) had a vague definition of the stated condition. For instance, the phrase 'depending on the severity of the disease' would need further specification (R19).

Second, the recommendations were as concise as possible and their presentation and formatting (Q15 and Q16) provided good visibility.

Third, the apparent validity (Q19 and Q20) was scored as a facilitator due to the structured reporting of the evidence and its quality linked to the individual recommendations.

Fourth, in the dimension of novelty/innovation (Q21-Q23), almost all recommendations were feasible without the need of new skills or knowledge (Q21). Moreover, the guideline considered the existing attitudes and beliefs of the intended users of the guideline (Q22 and Q23). However, R35 appeared incompatible with existing attitudes and beliefs of the guideline's intended users because it favoured complementary medicine.

Barriers

Four barriers to implementation were identified. First, the appraisers found that executability (Q11 and Q12) was a barrier in various recommendations (R7, R9, R10, R13, R15, and R33) because they were vague in their descriptions of the recommended actions. Formulations such as 'consideration should be given' did not make clear whether the action should be carried out or not. In addition, information about how a certain action should be performed was missing. Measuring adherence to such recommendations is difficult.

Second, the effect on the process of care (Q13 and Q14) was identified as a barrier. Four recommendations (R9, R11, R21, and R30) included actions that needed extra equipment, staff, or provider time to make them implementable. For example, not all hospitals have magnetic resonance imaging or facilities for in vitro fertilisation available.

Third, the lack of clear measures (Q17 and Q18) was a barrier in seven recommendations (R5, R8, R10, R19, R23, R24, and R35). There were no criteria for measuring adherence to these recommendations, which could complicate the monitoring of endometriosis care.

Fourth, the flexibility (Q24-Q27) was found to be a barrier. Some recommendations (R7, R8, R10, R11, R15-R17, R19, R33, and R35) lacked specific patient or practice characteristics to enable individualisation of care (Q24). Most recommendations (R2-R10, R13, R15-R25, R27-R30, R32, R33, and R35) did not consider coincident drug therapy and common comorbid conditions (Q25). Furthermore, the incorporation of patient preference (Q27) formed a barrier. R33 and R35 considered this preference but did not propose any mechanisms to implement the preference in practice. An exception to flexibility as a barrier was the strength of the recommendations (Q26), which the guideline developers stated explicitly with the classification of the recommendations.

We excluded the four optional items from the dimension computability (Q28-Q31) from further analysis because no electronic implementation was planned. At the time of our study, information technology support systems were not available to implement the guideline.

Of the 36 recommendations, 15 were graded with evidence strength A. These recommendations (R6-R8, R16-R18, R20, R22, R24, R25, R27-R29, R31, and R33) had significantly fewer individual barriers for implementation than the remaining recommendations did (Table 1). Recommendations graded A had 26 barriers in 260 items (10%) versus 52 barriers in 315 items (16.5%) at levels B, C, D and the good practice points (p = .02; odds ratio = 0.5 [95% confidence interval, 0.3-0.9]).

Table 1 Barriers related to the grade strength of the evidence
Full size table

General implementability of the guideline

The median score for the additional question assessing the implementability of the guideline was 4, ranging from 2 (probably not implementable) to 5 (definitely implementable). Six appraisers (60%) thought that the guideline was probably implementable (with some adjustments) or definitely implementable. One participant considered the guideline as probably not implementable.

Process evaluation of eGLIA

On average, the time the participants spent completing the appraisal (response 8 of 10) was four hours (range: three to eight hours). The average time needed to complete one recommendation was 10 minutes (range: 5 to 24 minutes). The answering became easier and quicker as more recommendations were appraised.

Most participants (60%) found the explanation of the GLIA dimensions and the use of the eGLIA tool clear (Table 2). However, they commented that more scoring examples would have been helpful. The general opinion was that the eGLIA tool was easy to use (70%) and functional for its purpose. Most questions were appraised with an agreement of more than 60% (for the answers 'agree' or 'strongly agree'). Identifying obstacles to implementation and judging the recommendations systematically were consistently appraised with close agreement (80% and 90%, respectively). There was wide variation in the understanding and application of the tool questions. Appraisers reported that several questions in the eGLIA instrument were not very clear or that they had to read them several times to understand the meaning. In addition, the participants stated that appraising a large number of questions was boring and too time consuming.

Table 2 Process evaluation of eGLIA
Full size table

Discussion

The aim of this study was to investigate the implementability of the ESHRE guideline for the diagnosis and treatment of endometriosis with the aid of the eGLIA tool. In general, the appraisers considered the guideline implementable in daily practice. However, they identified important barriers to implementation for some recommendations. This shows that barriers to implementation exist even in guidelines that are rated as high-quality guidelines. Nonetheless, implementability must be differentiated from guideline quality. Quality is generally assessed for the guideline as a whole and determines the scientific validity of guidelines. Implementability is one component of guideline quality, and its assessment is applied to individual recommendations within a guideline.

Implementation of the guideline would be improved if a description of the implementation strategies was included. The addition of an application tool for physicians as well as for patients, e.g., a summary document and a 'coping with endometriosis' leaflet, would also likely enhance implementation. Furthermore, we advise clearly displaying the most important recommendations as key recommendations at the end of the guideline.

Appraisal of the implementability of individual recommendations revealed important barriers that could be useful in designing implementation strategies and in updating the guideline. Recommendations could be reformulated to optimise their use in daily practice. Using a standard format or template for formulating recommendations could improve their implementability. The ESHRE has produced a manual on guideline development http://www.eshre.eu/ESHRE/English/Specialty-Groups/SIG/Safety-Quality-in-ART/Manual-for-ESHRE-Guideline-Development/page.aspx/254 comparable to the manuals of the National Institute for Health and Clinical Excellence [36] and the American Heart Association [37]. The manual states that recommendations should be stand-alone texts (i.e., independent from headings), and they should be as concise but as detailed as possible. Each recommendation should be a description about who does what for whom, when, and how. Standard phrases are suggested to overcome misunderstandings and confusion. A guiding structure of developing guidelines and writing recommendations will help prevent vaguely formulated recommendations and 'nonrecommendations'. Ideally, a nonrecommendation should be restated as a recommendation with conditions and actions if possible. If this is not possible, the information in the statement of the nonrecommendation can be added in the supporting text. This way, the information is retained but not listed as a recommendation. Furthermore, conditions and actions should be defined concretely so that only one interpretation is possible. For example, in R33, 'prolonged treatment' does not specify what duration of treatment could be classified as 'prolonged'. As seen from the results, grade A recommendations have fewer barriers than those with a lower grade. This is most likely because a grade A recommendation has a clearer evidence base and can therefore be written unambiguously. A recommendation should include clearly defined, measurable outcomes. For example, in R24, 'the effectiveness of hormonal treatment' could be stated more explicitly, e.g., 'its effectiveness on achieving pregnancy' or 'its effectiveness on giving birth'.

The implementability of a guideline should be considered in all phases of its development, including the scoping phase; the evidence review; and the dissemination, adoption, and use of the guideline in practice [15, 38]. Applying guidelines requires good preparation, with a detailed analysis of the target group, patient involvement, systematic approach, and structured phrasing of the recommendations [7, 12, 39].

Process evaluation of eGLIA

The second aim of this study was to evaluate the usefulness and feasibility of the eGLIA instrument. The results of this study indicate that the tool is useful in identifying barriers to implementation and in appraising the individual recommendations systematically. This is in line with Hill and coworkers' study [40]. Moreover, the web-based eGLIA appraisal facilitates international collaboration and the availability of international guidelines. The appraisers were widely distributed geographically. However, the eGLIA tool made it easy to collect and analyse the scores and to create a final report. This report is helpful for the adjustment of certain recommendations in a guideline to improve their implementability without the need for developing a new guideline. This obviates duplication of effort [41]. The eGLIA instrument is a tool that should be applied to each individual recommendation. It gives good insight into the barriers for implementation per recommendation. The eGLIA instrument is not intended for assessment of the implementability of the whole guideline, however, such an assessment would be an interesting addition. A ranking of the implementability of the individual recommendations could be considered, but this alone would not be accurate because some recommendations are substantially more important than others.

A limitation of the eGLIA tool is the time necessary for assessment. The eGLIA tool is probably unsuitable for guidelines with many recommendations. This leads to the question of practical use, in other words, the implementability of the eGLIA instrument itself for guidelines with many recommendations. To reduce the appraisal time, we suggest the development of a concise version of the current eGLIA instrument. For example, some of the tool's specific questions could be stated as general questions in the global dimension of the guideline as a whole (Q15, Q16, Q19, Q20, and Q23) because these questions -about format, validity, and patient expectations- often have equal scores for all recommendations. Other questions could be removed, as they have limited additional value. For example, Q27 is about patient preference, which is always considered and need not be asked generally. Another possibility is short questions with marking of keywords, which would reduce the reading time. Providing examples of 'good' recommendations and 'bad' recommendations would facilitate the scoring process.

Limitations of the study

First, most participants did not have any experience with the eGLIA instrument. Therefore, they needed time to understand the items and to learn about assessing the recommendations. This is evident in the results: answering became easier and quicker as more recommendations were appraised. One participant (CM) had more experience with the eGLIA instrument. She could give directions and explain common problems in interpreting the questions. A training workshop might be helpful before starting a formal appraisal with the eGLIA instrument.

Second, the process evaluation of the eGLIA instrument was limited by the number of users (10) and the number of guidelines (one). Formal validation would need a larger group of appraisers and more guidelines in different health areas. For international validation, translations of the instrument and translation protocols should be developed. However, the study questionnaire has revealed an interesting view of the use and feasibility of the appraisal instrument.

Third, we investigated primarily factors intrinsic to the guideline. We did not consider external factors, such as organisational factors and environmental factors (e.g., lack of time and lack of resources). A supplementary study could investigate these factors, possibly with a focus group or individual interviews of patients and professionals.

Fourth, both the appraisal of the guideline and the evaluation of the eGLIA tool were involved. Negative criticism of the eGLIA instrument may have interfered with the reliability of the guideline evaluation. However, the appraisers found the eGLIA tool useful and feasible for its purpose. We therefore consider the appraisal of the guideline valid.

The guideline developers and the eGLIA developers received feedback. The ESHRE guideline for the diagnosis and treatment of endometriosis will be revised in light of the results of this study.

Conclusions

The ESHRE guideline for the diagnosis and treatment of endometriosis has some intrinsic barriers to implementation, which could be overcome by more accurate and systematic phrasing of the recommendations. For the future development of ESHRE guidelines and other guidelines, we recommend taking implementability issues into account at the time of the drafting of the guideline. The eGLIA tool might be useful and feasible for this purpose. However, we also advise development of a concise version of the eGLIA instrument.

References

  1. Emslie C, Grimshaw J, Templeton A: Do clinical guidelines improve general practice management and referral of infertile couples?. BMJ. 1993, 306: 1728-1731. 10.1136/bmj.306.6894.1728.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J: Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999, 318: 527-530.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N: Guidelines in professions allied to medicine. Cochrane Database Syst Rev. 2000, CD000349

    Google Scholar 

  4. Burgers JS, Grol R, Klazinga NS, Makela M, Zaat J: Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs. Int J Qual Health Care. 2003, 15: 31-45. 10.1093/intqhc/15.1.31.

    Article  PubMed  Google Scholar 

  5. Lugtenberg M, Burgers JS, Westert GP: Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Health Care. 2009, 18: 385-392. 10.1136/qshc.2008.028043.

    Article  CAS  PubMed  Google Scholar 

  6. Field M, Lohr K: Clinical Practice Guidelines: Directions for a new Program. Committee to advise the Public-Health Service on Clinical Practice Guidelines, Institute of Medicine. 1990, Washington DC: National Academy Press

    Google Scholar 

  7. Grol R, Wensing M, Eccles M: Improving patient care; The Implementation of Change in Clinical Practice. 2005, Oxford: Elsevier

    Google Scholar 

  8. Mourad SM, Hermens RP, Nelen WL, Braat DD, Grol RP, Kremer JA: Guideline-based development of quality indicators for subfertility care. Hum Reprod. 2007, 22: 2665-2672. 10.1093/humrep/dem215.

    Article  CAS  PubMed  Google Scholar 

  9. Grimshaw JM, Russell IT: Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993, 342: 1317-1322. 10.1016/0140-6736(93)92244-N.

    Article  CAS  PubMed  Google Scholar 

  10. Grilli R, Lomas J: Evaluating the message: the relationship between compliance rate and the subject of a practice guideline. Med Care. 1994, 32: 202-213. 10.1097/00005650-199403000-00002.

    Article  CAS  PubMed  Google Scholar 

  11. Nicopoullos JD, Croucher CA: Audit of primary care and initial secondary care investigations set against RCOG guidelines as standard in cases of subfertility. J Obstet Gynaecol. 2003, 23: 397-401. 10.1080/0144361031000120905.

    Article  CAS  PubMed  Google Scholar 

  12. Grol R: Personal paper. Beliefs and evidence in changing clinical practice. BMJ. 1997, 315: 418-421.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Franssen MT, Korevaar JC, van d V, Boer K, Leschot NJ, Goddijn M: Management of recurrent miscarriage: evaluating the impact of a guideline. Hum Reprod. 2007, 22: 1298-1303. 10.1093/humrep/dem014.

    Article  CAS  PubMed  Google Scholar 

  14. Partridge MR: Translating research into practice: how are guidelines implemented?. Eur Respir J Suppl. 2003, 39: 23s-29s. 10.1183/09031936.0.00054503.

    Article  CAS  PubMed  Google Scholar 

  15. Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.

    Article  PubMed  Google Scholar 

  16. Shiffman RN, Michel G, Essaihi A, Thornquist E: Bridging the guideline implementation gap: a systematic, document-centered approach to guideline implementation. J Am Med Inform Assoc. 2004, 11: 418-426. 10.1197/jamia.M1444.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA: Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999, 282: 1458-1465. 10.1001/jama.282.15.1458.

    Article  CAS  PubMed  Google Scholar 

  18. Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. BMJ. 1998, 317: 465-468.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39: II2-45. 10.1097/00005650-200108002-00002.

    Article  CAS  PubMed  Google Scholar 

  20. Haagen EC, Nelen WL, Hermens RP, Braat DD, Grol RP, Kremer JA: Barriers to physician adherence to a subfertility guideline. Hum Reprod. 2005, 20: 3301-3306. 10.1093/humrep/dei220.

    Article  CAS  PubMed  Google Scholar 

  21. Pennings G: Legal harmonization and reproductive tourism in Europe. Hum Reprod. 2004, 19: 2689-2694. 10.1093/humrep/deh486.

    Article  PubMed  Google Scholar 

  22. Benyamini Y, Gozlan M, Kokia E: Variability in the difficulties experienced by women undergoing infertility treatments. Fertil Steril. 2005, 83: 275-283. 10.1016/j.fertnstert.2004.10.014.

    Article  PubMed  Google Scholar 

  23. Evers JL: Female subfertility. Lancet. 2002, 360: 151-159. 10.1016/S0140-6736(02)09417-5.

    Article  PubMed  Google Scholar 

  24. World Health Organization. WHO: Current Practices and Controversies in Assisted Reproduction. 2001, Ref Type: Report

    Google Scholar 

  25. Boivin J, Bunting L, Collins JA, Nygren KG: International estimates of infertility prevalence and treatment-seeking: potential need and demand for infertility medical care. Hum Reprod. 2007, 22: 1506-1512. 10.1093/humrep/dem046.

    Article  PubMed  Google Scholar 

  26. Fervers B, Philip T, Haugh M, Cluzeau F, Browman G: Clinical-practice guidelines in Europe: time for European co-operation for cancer guidelines. Lancet Oncol. 2003, 4: 139-140. 10.1016/S1470-2045(03)01017-9.

    Article  PubMed  Google Scholar 

  27. Haagen EC, Hermens RP, Nelen WL, Braat DD, Grol RP, Kremer JA: Subfertility guidelines in Europe: the quantity and quality of intrauterine insemination guidelines. Hum Reprod. 2006, 21: 2103-2109. 10.1093/humrep/del100.

    Article  CAS  PubMed  Google Scholar 

  28. Brown S: SQUART Guidelines Conference. Time for a rethink on ESHRE's guidelines. Focus on Reproduction. 2008

    Google Scholar 

  29. Nelen WL, van der Pluijm RW, Hermens RP, Bergh C, de SP, Nygren KG: The methodological quality of clinical guidelines of the European Society of Human Reproduction and Embryology (ESHRE). Hum Reprod. 2008, 23: 1786-1792. 10.1093/humrep/den120.

    Article  CAS  PubMed  Google Scholar 

  30. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003, 12: 18-23. 10.1136/qhc.12.1.18.

  31. Palda VA, Davis D, Goldman J: A guide to the Canadian Medical Association handbook on clinical practice guidelines. CMAJ. 2007, 177: 1221-1226.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Shiffman RN, Shekelle P, Overhage JM, Slutsky J, Grimshaw J, Deshpande AM: Standardized reporting of clinical practice guidelines: a proposal from the Conference on Guideline Standardization. Ann Intern Med. 2003, 139: 493-498.

    Article  PubMed  Google Scholar 

  33. Shiffman RN, Dixon J, Brandt C, Essaihi A, Hsiao A, Michel G: The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Inform Decis Mak. 2005, 5: 23-10.1186/1472-6947-5-23.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Kennedy S, Bergqvist A, Chapron C, D'Hooghe T, Dunselman G, Greb R: ESHRE guideline for the diagnosis and treatment of endometriosis. Hum Reprod. 2005, 20: 2698-2704. 10.1093/humrep/dei135.

    Article  PubMed  Google Scholar 

  35. Shiffman RN, Codish S, Michel G, Hsiao A: e-GLIA: A Computer-based system for Appraisal of Guideline Implementability.

  36. National Institute for Health and Clinical Excellence. NICE: The guidelines manual. 2007, Ref Type: Report

    Google Scholar 

  37. American College of Cardiology Foundation and American Heart Association: Methodologies and Policies from the ACC/AHA Task Force on Practice Guidelines. 2006, Ref Type: Report

    Google Scholar 

  38. Wollersheim H, Burgers J, Grol R: Clinical guidelines to improve patient care. Neth J Med. 2005, 63: 188-192.

    CAS  PubMed  Google Scholar 

  39. Grol R, Wensing M: Implementatie. Effectieve verandering in de patientenzorg. 2001, Maarssen: Elsevier, 2

    Google Scholar 

  40. Hill KM, Lalor EE: How useful is an online tool to facilitate guideline implementation? Feasibility study of using eGLIA by stroke clinicians in Australia. Qual Saf Health Care. 2009, 18: 157-159. 10.1136/qshc.2007.025635.

    Article  CAS  PubMed  Google Scholar 

  41. Fervers B, Burgers JS, Haugh MC, Latreille J, Mlika-Cabanne N, Paquet L: Adaptation of clinical guidelines: literature review and proposition for a framework and procedure. Int J Qual Health Care. 2006, 18: 167-176. 10.1093/intqhc/mzi108.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Obstetrics & Gynaecology, Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands

    Lotte JEW van Dijk, Willianne LDM Nelen & Jan AM Kremer

  2. Department of Obstetrics & Gynaecology, University Fertility Center, Gasthuisberg University Hospital, Leuven, Belgium

    Thomas M D'Hooghe

  3. Department of Obstetrics & Gynaecology, Maastricht University Medical Centre and Research Institute GROW, Maastricht University, Maastricht, The Netherlands

    Gerard AJ Dunselman

  4. Scientific Institute for Quality of Healthcare and Dutch Institute for Healthcare Improvement CBO, Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands

    Rosella PMG Hermens & Jako S Burgers

  5. Department of Obstetrics & Gynaecology, Institution of Clinical Sciences, Sahlgrenska Academy, Göteborg University, Göteberg, Sweden

    Christina Bergh

  6. IVF Clinic, Queen Sophia Hospital, Stockholm, Sweden

    Karl G Nygren

  7. Department of Obstetrics & Gynaecology, University Medical Centre, Groningen, The Netherlands

    Arnold HM Simons

  8. Department of Obstetrics & Gynaecology, Infertility Centre, Gent University Hospital, Gent, Belgium

    Petra de Sutter

  9. Independent Guideline Adviser, New Zealand

    Catherine Marshall

Authors
  1. Lotte JEW van Dijk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Willianne LDM Nelen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Thomas M D'Hooghe
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gerard AJ Dunselman
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rosella PMG Hermens
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Christina Bergh
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Karl G Nygren
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Arnold HM Simons
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Petra de Sutter
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Catherine Marshall
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Jako S Burgers
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Jan AM Kremer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Willianne LDM Nelen.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

LD participated in the design of the study and elaborated it, appraised the guideline with eGLIA, participated in the telephone conference, did the statistical analysis, and drafted the manuscript. WN conceived of the study, participated in its design and coordination, appraised the guideline with eGLIA, and participated in the telephone conference and the revision the manuscript. TD, GD, CB, KN, AS, PS, and CM appraised the guideline with eGLIA and participated in the telephone conference and the revision of the manuscript. RH participated in the design of the study and the revision of the manuscript. JB participated in the design of the study, appraised the guideline with eGLIA, and participated in the telephone conference and the revision of the manuscript. JK coordinated the study, approached participants, presided over the telephone conference, and took part in the revision of the manuscript. All authors read and approved the final version of the manuscript.

Electronic supplementary material

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

van Dijk, L.J., Nelen, W.L., D'Hooghe, T.M. et al. The European Society of Human Reproduction and Embryology guideline for the diagnosis and treatment of endometriosis: an electronic guideline implementability appraisal. Implementation Sci 6, 7 (2011). https://doi.org/10.1186/1748-5908-6-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1748-5908-6-7

Keywords

Implementation Science

ISSN: 1748-5908