Skip to main content

Use of health systems and policy research evidence in the health policymaking in eastern Mediterranean countries: views and practices of researchers

Abstract

Background

Limited research exists on researchers' knowledge transfer and exchange (KTE) in the eastern Mediterranean region (EMR). This multi-country study explores researchers' views and experiences regarding the role of health systems and policy research evidence in health policymaking in the EMR, including the factors that influence health policymaking, barriers and facilitators to the use of evidence, and the factors that increase researchers' engagement in KTE.

Methods

Researchers who published health systems and policy relevant research in 12 countries in the EMR (Bahrain, Egypt, Iran, Jordan, Lebanon, Libya, Morocco, Oman, Palestine, Sudan, Syria, and Yemen) were surveyed. Descriptive analysis and Linear Mixed Regression Models were performed for quantitative sections and the simple thematic analysis approach was used for open-ended questions.

Results

A total of 238 researchers were asked to complete the survey (response rate 56%). Researchers indicated transferring results to other researchers (67.2%) and policymakers in the government (40.5%). Less than one-quarter stated that they produced policy briefs (14.5%), disseminated messages that specified possible actions (24.4%), interacted with policymakers and stakeholders in priority-setting (16%), and involved them in their research (19.8%). Insufficient policy dialogue opportunities and collaboration between researchers and policymakers and stakeholders (67.9%), practical constraints to implementation (66%), non-receptive policy environment (61.3%), and politically sensitive findings (57.7%) hindered the use of evidence. Factors that increase researchers' engagement in KTE activities in the region were associated with involving policymakers and stakeholders at various stages such as priority-setting exercises and provision of technical assistance.

Conclusions

Researchers in the EMR recognize the importance of using health systems evidence in health policymaking. Potential strategies to improve the use of research evidence emphasize two-way communication between researchers and policymakers. Findings are critical for the upcoming World Health Report 2012, which will emphasize the significance of conducting and translating health research to inform health policies.

Peer Review reports

Introduction

The role of research in improving health systems and healthcare delivery is becoming increasingly recognized by policymakers and researchers worldwide. Despite global calls for promoting research and its application [1–3], the gap between health systems research evidence and the use of evidence in policymaking and practice continues to exist. Examining efforts to bridge this gap and monitoring changes in the nature and extent of researchers' engagement in bridging efforts provides a valuable tool for those calling for and funding these efforts and those designing and implementing effective bridging strategies [4]. Knowledge transfer and exchange (KTE), which is an interactive process involving the interchange of knowledge between research users and researcher producers, emerged as a result of growing evidence that the successful uptake of knowledge requires more than one-way communication but rather genuine interaction among researchers, decision makers, and other stakeholders [5].

In the Eastern Mediterranean Region (EMR), the role of research in policymaking has been repeatedly emphasized [6–8]. In its recent strategic directions for research for health, WHO Eastern Mediterranean Regional Office (WHO EMRO) emphasized the forceful implementation and expansion of research for health as a fundamental tool for health development and informing health policy changes [1]. Health research systems in the EMR are not yet well developed to generate and use knowledge to improve health, reduce inequality, and contribute to economic development [9]. The region also suffers from the paucity in health systems research and systematic reviews [10, 11]. It has a lower average number (213) of research for health publications compared to the global average (551) [12]. Moreover, a recent print media analysis in 44 low- to middle-income countries (LMICs), which included several countries from the EMR, showed that the region is among the lowest in terms of the articles that describe or use health systems research [13]. Furthermore, the number of researchers in research and development who are trained to work in any field of science from the EMR is relatively low (ranging from 29 to 1,927 per million people) compared to the United States (4,484 per million) [14]. Even in parts of the region where there is significant human capital to conduct research for health, the production, dissemination, and utilization of evidence remains weak mainly due to insufficient demand for research [15], El-Jardali et al., unpublished manuscript]. In a recent priority-setting exercise conducted with policymakers, stakeholders, and researchers from the region, participants called for further exploration of health systems research into policy, engaging policymakers in health systems research, and conducting surveys to better understand the policymaking context and design effective KTE strategies for the region [10].

Limited research exists on researchers' KTE activities in the EMR [16–20]. We are not aware of a survey that has been conducted about the KTE activities of researchers in the region. The objective of this study is to explore how researchers view and experience the role of health systems research in health policymaking in the EMR, including the factors that influence health policymaking and the factors that increase researchers' engagement in KTE activities. This paper also details the barriers and facilitators to the use of evidence in the policymaking process.

Methods

A cross-sectional survey of researchers who published health systems and policy-relevant research in 12 countries in the EMR was conducted. The survey was developed based on several sources [4, 21, 22]. The main themes and most of the questions were adapted from the questionnaire by Lavis et al.[4]. Additional questions were adapted from the questionnaires by Campbell et al.[21] and Tehran University of Medical Sciences [22]. The wording of questions was retained whenever possible; however, some questions were customized to fit the context of the region. Open-ended questions were also added to the questionnaire. The survey was translated to Arabic by a professional translator and back-translated to English with minimal differences. The survey was piloted with a health systems and policy researcher from the region and was further modified. Institutional review board (IRB) approval was obtained prior to data collection from the American University of Beirut (AUB).

The survey consisted of a demographics section, four main quantitative scales, and seven open-ended questions. In the quantitative section, the first scale consisted of 25 items that assessed researchers' activities with regards to KTE including their KTE audience, research products, dissemination, and contact and exchange with policymakers and stakeholders. In addition, six yes/no items requested participants to indicate whether they have the skills and necessary KTE training and have undertaken KTE activities (Tables 1 and 2). The second scale consisted of 13 items that assessed the investments/resources available to researchers to support their KTE activities (Table 3). The third scale consisted of 11 items that explored researchers' views on policymakers' usage of evidence in addition to the factors the influence the use of evidence in policymaking (Table 3). The fourth and final scale consisted of researchers' views on the health policymaking context in the region (Tables 3). Additionally, a series of yes/no items asked participants to indicate their needs to ensure that research is transferred to health policymakers and stakeholders (Table 4).

Table 1 Demographic information of respondents
Table 2 KTE activities that researchers frequently or always undertook in their research domains
Table 3 Skills and training to undertake KTE activities
Table 4 Support available for KTE, practices of health policymakers and stakeholders, investments and resources available for KTE, factors that influence the use of evidence in health policymaking and that influence health policymaking

For the open-ended questions, respondents were asked to list their recent KTE activities and another question asked them to list the knowledge transfer strategy that had the greatest impact on influencing decisions. In the third question, respondents were asked to list examples on: where evidence was available but was not used; the formulation of a policy where evidence was available and used; and where evidence was not available but was needed. In addition, three open-ended questions asked respondents to list at least three major barriers and facilitators of the use of evidence in policymaking in their respective countries, as well as three major suggestions to improve the use of evidence in policymaking. Open-ended items also asked participants to indicate whether their engagement with policymakers and stakeholders compromised their intellectual and academic independence and to indicate whether they have undertaken KTE activities, as well as to list three top factors that exerted the strongest influence in the policymaking process in their respective countries.

Sampling

There is no inventory of health systems and policy researchers in the EMR. As such, purposive sampling was conducted to identify researchers who published health systems and policy-relevant research from the region or conducting research in the region. Corresponding authors who had published relevant articles between the years 2000 and 2008 in local or international journals indexed on Medline or EMBASE were sampled. This was done through a search strategy for health systems and policy research that has been developed to optimize sensitivity and specificity [23]. The EMR countries included in the search strategy were: Bahrain, Egypt, Iran, Jordan Lebanon, Libya, Morocco, Oman, Palestine, Sudan, Syria, and Yemen. Countries were selected based on their interest and participation in the launch meeting of the Evidence Informed Policy Network East Mediterranean Region (EVIPNet EMR) that took place in January 2009. EVIPNet EMR is a social network that encourages the use of evidence in the policymaking process. It includes researchers, policymakers, and civil society members from the EMR.

After identification of corresponding authors, information along with their emails was extracted. A thorough internet search was conducted to obtain for authors if they were not available in the publication.

Authors of these articles were not limited to study countries. The sampling frame therefore included authors who had at least one health systems and policy publication pertaining to one of the above countries published in a local or international journal.

To supplement our list of sampled authors, an optional question was added at the end of the survey asking respondents to indicate whether they think we should contact specific researchers who may be interested in completing the survey. This technique helped increase our sample size and identify 16 more researchers from the region who may not have been identified otherwise.

In total, 282 researchers were identified through this sampling process. Upon sending invitations to complete the survey, 44 emails were identified as inactive or incorrect. As such, a total of 238 researchers received the invitation to complete the survey, 133 responded giving a response rate of approximately 56%.

Survey administration

The survey was administered online using the software LimeSurvey 1.90. LimeSurvey does not require respondents to provide their names or any personal information. It randomly generates and assigns respondents with a unique token, which cannot be matched with participants' responses and is only used to avoid duplicate responses. Respondents were approached by an email, in both English and Arabic, with the link to the online survey. They were informed that they could complete the survey in either English or Arabic. The survey link allowed respondents to choose their language preference using a drop-down list. Non-respondents were sent automated reminders two weeks after the first contact and four weeks after the first reminder. It is worth noting that only three respondents completed the survey in Arabic.

Data analysis

Responses were exported from LimeSurvey to the Statistical Package for Social Sciences (SPSS) 19.0 for analysis. All analyses were carried out at a significance level of 0.05. Descriptive analysis was performed. For items assessing researchers' views and attitudes, a five-point scale of strongly agree, agree, neither agree or disagree, disagree, and strongly disagree was used. Whereas, for items assessing the frequency with which researchers undertook KTE activities, the scale ranged from never, rarely, occasionally, frequently, to always.

For closed-ended questions, the uppermost and lowermost ends of the scale were combined i.e., strongly agree with agree and strongly disagree with disagree; never with rarely and frequently with always. Descriptive analysis was performed for closed-ended questions. Confidence Intervals (95%) were constructed for scale-based questions.

Linear Regression Models were used to examine whether transferring research results or undertaking KT activities was affected by selected independent variables. Three dependant variables were constructed using exploratory factor analysis; two related to the transfer of research results and the third related to undertaking KT activities (henceforth referred to as production and dissemination of evidence). The questions relating to transfer of research to potential users (eight items) loaded on three factors; the first related to transfer of results to policymakers, directors of NGOs, and donor agencies; the second related to transfer of results to directors of health institutions, professional associations, and service providers. Eigen values and % variance explained were acceptable and, as such, two scores were computed relating to these two factors by summation of the score of items. This resulted in two dependant variables, the first related to policymakers (those associated with government, NGOs, and donor agencies) and the second related to provider organizations (those associated with syndicates, orders, healthcare institutions, and service providers).

The third factor related to production and dissemination of evidence from the samples' own research (six items). Exploratory factor analysis showed loading on one factor and acceptable eigen values and % variance explained. Similarly to the first two factors, a score was created for this factor by summation of the scores of items.

The independent variables included in this model related to undertaking KTE activities related to contact and exchange with health policymakers and stakeholders in addition to the investments/resources available for the production and transfer and exchange of evidence from health policy and systems research (HPSR). Multicollinearity between independent variables was tested for prior to data analysis using the Pearson correlation coefficient statistic, and no multicollinearity was detected.

Open-ended questions were analyzed using the simple thematic analysis approach. Responses were broken into similar concepts and ideas (open coding). Axial coding followed which involved organizing concepts into themes [24]. These data were then analyzed by recurring themes and emerging patterns. Analysis was conducted by two members of the research team with a high level of agreement between the two. Disagreements were discussed until consensus was reached.

Results

Quantitative section

Descriptive analysis

Male researchers comprised 62% of the sampled researchers. A total of 80% of the 133 respondents reported working in a country from the region, while the remaining 20% reported working outside the region. A total of 18% of researchers reported that their main research domain is health systems and policy research, while 57% reported that their main research domain is other public health-related domains including epidemiology, communicable diseases, maternal and child health, and 25% worked in both research domains (Table 1). Most researchers are currently working in an academic university (85%), 37% are working in a teaching hospital setting, and 17% in a government department (Table 1). Researchers indicated always or frequently transferring results to other researchers (67%), policymakers in the government (40%), and service providers (34%) (Table 1).

None of the KTE activities related to the production and dissemination of research and contact and exchange with policymakers and stakeholders were undertaken by more than one-half of the researchers (Table 2). Less than one-quarter of respondents stated that they produced policy briefs (15%), disseminated messages that specified possible actions (24%), provided research results through the web (20%), provided technical assistance through long-term formal collaborations with policymakers and stakeholders (23%), interacted with policymakers and stakeholders as part of a priority-setting process (16%), and involved policymakers and stakeholders in their research (20%) (Table 2). Although most researchers stated that they have sufficient skills and training to produce systematic reviews (66%), less than one-half have ever conducted or produced systematic reviews (48%) (Table 3).

More than one-half of researchers reported that lack of coordination between policymakers and researchers hindered the use of evidence in policymaking (65%) (Table 4). While most researchers indicated that funding sources encourage KTE activities (65%), less than one-quarter reported that policymakers and stakeholders provide adequate funding for priority research (20%) and clearly articulate priorities for health systems and policy research (21%) (Table 4).

Only some researchers stated that policymakers systematically access HPSR (21%), although around more than one-third of researchers stated that policymakers and stakeholders have access to HPSR through a searchable database with an internet connection (45%) or through a network of researchers or academic institutions (46%). Some also stated that they have the expertise for acquiring, assessing the quality and local applicability of HPSR, and applying it in health policymaking (31%). Researchers also indicated that policymakers and stakeholders show little regard for the value of evidence (43%) (Table 4).

Researchers reported that use of evidence in policymaking was hindered by insufficient policy dialogue opportunities, networking, and collaboration between researchers and policymakers and stakeholders (68%), practical constraints to implementation (66%), a non-receptive policy environment (61%), and findings that were politically sensitive (58%) (Table 4). In terms of researchers' views on the health policymaking process, they stated that there is insufficient information about how health policies are being made (73%) and that policy formulation is based on internal Ministry of Health discussions, donor preferences, and ad hoc process rather than evidence-based processes (76%). The majority stated that lack of coordination in relations across different ministries (82%) and between the government and health providers (70%) hindered the health policymaking process. Furthermore, limited health funding (62%), donor organizations (59%), values of governing parties were reported to exert a strong influence on the health policymaking process (50%) (Table 4). Researchers' responses to an open-ended question confirmed that values of governing political parties and political interests of policymakers, health funding and resources, and donor organizations and international organizations (e.g., WHO) are the top factors that influenced health policymaking processes in the region.

Some researchers stated that incentives for KTE activities were available (23%) (Table 4). Furthermore, the majority indicated that they need web support (78%), KTE support units or institutional mechanisms in academic institutions (68%), and funding for KTE as part of the research process (62%) (Table 5).

Table 5 Researchers' needs to ensure that evidence from research is transferred to health policy makers and stakeholders

Linear regression models

Results of the two linear regression models revealed several factors associated with the degree of researchers' engagement in transferring research and production and dissemination of research.

Researchers' engagement in transferring research to policymakers and providers organizations

Results showed that sampled researchers increased transfer of research results to policymakers by 0.229 (p = 0.026) for each unit increase on the item describing developing relationships with print, radio, and/or television journalists to promote use of evidence (Table 6). An increase of 0.346 (p = 0.001) was observed in transfer of research to policymakers for a one-unit increase in availability of international funding for undertaking HPSR (Table 6).

Table 6 Linear Regression Model for transfer of research to policymakers and service providers*

An increase of 0.301 (p = 0.002) in transfer of research to provider organizations was observed for a one-unit increase in trying to involve policymakers and stakeholders but facing difficulty. However, a decrease of 0.402 (p = 0.008) in transfer of research to provider organizations was observed for every unit increase in providing technical assistance through long-term formal collaborations with policymakers and stakeholders for sustained technical capacity development (Table 6). Finally, an increase of 0.203 (p = 0.028) in transfer of results to provider organizations was observed for every unit increase in having funding sources which encourage transfer and exchange activities (Table 6).

It was interesting to observe similar degrees of increase in transfer of research results to policymakers (beta = 0.314, p = 0.004) and provider organizations (beta = 0.314, p = 0.010) for every unit increase in involving policymakers and stakeholders in research (Table 6).

Researchers' engagement in the production and dissemination of evidence

Results of the linear regression model revealed that a one-unit increase in interacting with health policymakers and stakeholders as part of a priority-setting process to identify high-priority health policy issues and research themes, increased production and dissemination of evidence by 0.364 (p = 0.001). In addition, an increase of 0.190 (p = 0.023) was observed in production and dissemination of evidence for every unit increase in training health policymakers and stakeholders to acquire, assess, interpret, and apply health research. (Table 7).

Table 7 Linear Regression Model for production and dissemination of evidence*

Responses to Open-Ended Questions

Researchers' recent KTE activities and most effective strategies

More than one-half of researchers (58%) stated that they have undertaken KTE activities (Table 2). When asked to list their recent KTE activities, most researchers stated that they have conducted research relevant to priority policy issues. The majority reported that they have discussed their findings with their target audience in workshops and presented findings in conferences as well as in publications. Some researchers also stated that they have conducted capacity-building sessions for policymakers and stakeholders on research methods and interpretation of findings. Only a few researchers participated in joint research studies with policymakers, wrote newspaper articles and policy briefs, and disseminated findings to their target audience using the web and newsletters.

Most researchers stated that personal contacts with policymakers and direct face-to-face meetings are the knowledge transfer strategies with the greatest impact on influencing policymakers. One researcher explained that 'the main strategy is though personal contacts. If you know someone in charge, you can communicate the findings and help them develop the appropriate policy in line with evidence. If the person in charge is powerful enough policies and decisions are then influenced.' The media, including newspaper articles, was also mentioned by the majority of researchers as another strong KTE strategy. Some researchers also stated that presentations, conferences, and workshops, as well as enhanced funding for knowledge transfer activities can have a strong impact on influencing policymakers.

Examples on the formulation of a health policy where evidence was available but not used, available and used, or needed but not available

The most frequently cited examples by researchers on policies where evidence was used, where evidence was available but was not used, and where evidence was needed but was not available are presented in Table 8.

Table 8 Most frequently mentioned examples on the formulation of a health policy where evidence was available but not used, available and used, or needed but not available

Formulation of a health policy where evidence was available but not used

Most responses (21%) indicated that evidence from research on healthcare quality as well as evidence on best practices was not used for formulating policies related to healthcare quality. As one researcher from Lebanon stated 'data from indicators on the quality of maternal healthcare could have better informed hospital accreditation processes.' Responses (16%) also indicated that evidence was not used to formulate policies on health financing arrangements especially related to national health insurance policies. A researcher from Jordan stated that '[evidence] on an integrated national health insurance system was introduced to the ministry of health in Jordan [but was not taken into] consideration, despite its serious findings.' Several responses from Lebanon and Syria stated that although evidence was available, it was not used to formulate tobacco control policies (Table 8).

Formulation of a health policy where evidence was available and used

Most responses (28%) indicated that establishing screening programs for chronic diseases was based on evidence from the prevalence and cost-effectiveness of these programs. For example, a researcher from Oman stated that evidence on the 'high number of congenitally deaf children [led] to the [establishment] of a newborn hearing screening program.' Responses (18%) also indicated that evidence from research was used to establish prevention programs for infectious diseases. Furthermore, several responses demonstrated that evidence was used to formulate nutrition policies such as for ionization of salt, vitamin fortification, and food-handling guidelines (Table 8).

Formulation of a health policy where evidence was needed but not available

The majority of responses (18%) indicated that local research evidence on age maternal mortality and morbidity was needed to inform policies on reproductive and maternal health. Responses also indicated that evidence was needed on implementing healthcare quality procedures and measuring performance as well as on the transmission and prevalence of human immunodeficiency virus (Table 8).

Barriers and facilitators to the use of evidence in policymaking of health policymaking and strategies to improve evidence to policy

The majority of responses cited lack of funding (20%), overriding political forces (13%), lack of political will and corruption (10%), and lack of communication and insufficient dialogue with policymakers (9%), as well as lack of appropriately trained policymakers in using evidence (9%) as barriers to the use of research in health policymaking (Table 9).

Table 9 Most frequently mentioned barriers and facilitators to the use of evidence in policymaking and strategies to improve evidence to policy

Most responses indicated that communication and networking with policymakers (18%) and the availability of funding (18%) and health research on policy priorities (12%), political pressure to use research in policymaking in certain fields (8%), and the wide dissemination of research (6%) are facilitators to KTE activities. Several responses also indicated that policymakers' belief in the importance of evidence-informed policymaking and public opinion and stakeholders pressures to use evidence in policymaking also facilitate the use of research in health policymaking (Table 9).

The majority of responses suggested establishing easy methods for communication, networking, and dialogue with policymakers (20%), increasing funding and investments in health research (13%), building the capacity of policymakers in locating evidence, assessing its quality, cost effectiveness, and local applicability (8%), in addition to training researchers on conducting health systems and policy research and KTE strategies (6%), and improving the dissemination of research (6%). Responses also suggested conducting sensitization and awareness workshops on evidence informed policymaking as well as providing incentives or legislations for policymakers to use evidence in policymaking (Table 9).

Attitudes of researchers on KTE activities and academic independence

Only 14.4% of researchers stated that their engagement and exchange with policymakers and stakeholders compromises their intellectual and academic independence (Table 2). They explained that engaging with policymakers may result in policymakers' misinterpretations of sensitive findings to better suit their political agendas, which compromises the integrity of their work and their intellectual independence. As one researcher stated, 'there is sometimes an unwelcome pressure to 'spin' the findings to fit the view of the policymakers.'

Discussion

Study findings indicate that sampled researchers' engagement in a variety of KTE activities, including the production and dissemination of research as well as contact and exchange with policymakers and stakeholders, was undertaken by less than one-half of researchers in the EMR. The low level of engagement in KTE activities of the sampled researchers may be attributed to the little support available in their environment for engaging in KTE activities, including the lack of incentives in the form of performance incentives and proper criteria of promotion within their organizations for undertaking KTE activities. Factors that increase engagement in KTE activities were mainly associated with involving policymakers and stakeholders at various stages, such as in priority-setting exercises and in the provision of technical assistance. Results from regression analysis, particularly transfer of results to provider organizations, may indicate that researchers focus on this group when they have difficulty contacting policymakers or do not have the opportunity to provide technical assistance to them. It is worth noting that the findings of the factor analysis pertaining to this specific scale (transfer of research results) can also indicate the need to differentiate between groups of policymakers and stakeholders in future research, because researchers appeared to interact with them in different ways.

Furthermore, results from open-ended questions indicate that the utilization of evidence in policymaking varies depending on the type of evidence available. For example, certain types of research can often be overlooked in the region due to contextual factors and constraints that are more relevant for the decision-making process, such as financial implications, lack of trust in the value of local research, and political influences.

Low level of researchers' engagement in KTE activities was also reported from a survey of researchers from LMICs and from Iran [4, 17, 25]. Researchers' perceived barriers to the use of research in policymaking, and their views on the factors that compete with research in the health policymaking process are also aligned with those previously reported from the region [1, 16, 20] and further corroborate those reported from studies in LMICs [26, 27]. The existence of structures and processes to link researchers and their target audience as well as the stability in researchers' contracts and having managers and public (government) policymakers among their target audiences were also found to predict researchers' engagement in bridging activities in LMICs [4]. As in many LMICs, the local research capacity in the region in certain areas, specifically in health systems research, is still lacking [28]. Due to the scarcity of research capacity to undertake health systems and implementation research in the region, it is highly recommended that efforts be directed towards improving the design, robustness, and applicability of the evidence generated in one setting to allow its utilization in other settings [28].

Our study has three main strengths: it is among the very few studies (if not the first) to explore the views and practice of researchers on their KTE activities and the use of health systems evidence in the EMR; it combined different types of research methods and survey questions; and it provided data on the factors that predict researchers' engagement in KTE activities in the region. However, limitations related to challenges in identifying researchers in the region should be acknowledged. Specifically, only 282 researchers were identified given that we limited the search to health systems and policy research articles published between 2000 and 2008; therefore, researchers who published before or after this period were not contacted and included in our sampling frame. Because there is no inventory of public health systems researchers in the region, we only focused on researchers with published literature. Several researchers who develop reports and commissioned papers that do not get published may have been missed because we did not identify authors of grey literature. Despite these challenges, responses from researchers provide some insight about the policymaking process in general and use of evidence in policymaking in the region. Social desirability bias inherent with self-reported questionnaires is another limitation of this study. For example, the number of respondents who indicated producing systematic reviews is surprisingly high given the low number of systematic reviews from the region [10]. Respondents may have provided the answers they considered desirable by the investigators. Responses may present either true beliefs or perceptions of what respondents thought researchers wanted to hear, or a combination of both. However, it can be safely assumed that the results are not overly inflated because of the positive nature of most of the questions. Furthermore, self-reports of current behavior provide clear information on where improvements should be implemented [29].

Study implications and potential strategies for increasing the use of health systems evidence into health policymaking in the EMR

Knowledge translation (KT) was emphasized in WHO EMRO's recent strategic direction for research for health [1]. WHO EMRO strategic actions to ensure that quality evidence is translated into policy include access to unpublished scientific literature in the region, publishing of results in an understandable and accessible way, promoting importance of research and knowledge sharing, and strengthening EVIPNet in the region. Based on study findings, potential strategies for increasing the use of health systems evidence into health policies in the EMR were identified, which further advocate those established by WHO EMRO.

Increasing interaction and communication between researchers and policymakers was identified as key to improving the use of evidence in policymaking. This implication is further supported by a recent study conducted in Iran, which emphasized the need for a proper and logical connection between the production of scientific evidence, policymaking, and implementation [20]. Literature shows that communication and exchange between policymakers and stakeholders, especially in the form of interpersonal relationships, increases the prospects for research use [5, 30, 31]. Building partnerships between researchers and research users as well as involving policymakers in all stages of the research process, including conceptualization, design, and dissemination, offer a great potential for overcoming mistrust between researchers and policymakers and for increasing research use [32, 33]. A greater opportunity for interaction with policymakers has become available to researchers in the region through social networks, such as the WHO sponsored EVIPNet EMR. It is important to further expand on these networks to strengthen communication and exchange in the region as well as to empower rights to access knowledge and innovation [1].

Our findings show that there is a need for increased funding in KTE activities and in priority health research in the region. In fact, funding for scientific research in the majority of countries in the region is among the lowest in the world [34] and has been identified among the priorities for research centers from the region [21]. Funding bodies can also play a major role in enhancing research use by requiring that a detailed KTE component be present as part of the research process. This strategy has been previously shown to increase the uptake of research [5, 32]. Funders should also allocate resources to primary research dedicated to the evaluation of innovative KTE strategies [5]. They should also require grant proposals to build on systematic reviews of existing evidence in order to avoid duplication and reinventing the wheel and to encourage the production of research that can better inform health priorities [35]. For example, the National Institute for Health Research (NIHR) Health Technology Assessment Programme routinely requires or commissions systematic reviews before funding primary studies, publishes all research as web-accessible monographs, and has made all new protocols freely available [35].

However, it is important to note that funding by itself, even if provided by governments, is not enough to ensure effective involvement of the research community in policy development. It should be accompanied by strengthening the capacity of both policymakers and researchers to demand and provide evidence [36, 37]. While literature emphasizes the importance of training policymakers in fostering a more positive attitude towards the use of research findings and boosting its receptivity [37, 38], no established training and education programs that target policymakers and stakeholders in the EMR are available to date. Incentives in the form of legislations can also be established to encourage or even oblige policymakers to use evidence in policymaking, as also suggested in other countries from the region [20].

Support units to assist researchers in their KTE activities can provide capacity-building and information technology support for researchers including decision support tools, databases, and web technology [16]. The active engagement with policymakers and stakeholders requires that researchers acquire a set of novel skills. First, as our study revealed, it is often hard for some researchers in the region to balance the competing agendas of policymakers with their own research and their local organizations. Close integration may undermine the independence of research [21, 32]. Therefore, training should be provided to researchers on choosing whether and how to involve decision makers, who to involve, as well as on determining the goals for their involvement [32, 33].

Researchers should also be trained on increasing the relevance of their research including focusing on priority policy issues, providing actionable messages and information on the quality and local applicability of their research. Literature shows that clear summaries of findings with recommendations for action, good quality research, and research that include effectiveness data facilitate the use of research in policymaking [5, 31]. Furthermore, 'one-stop shops' for relevant, high-quality and optimally packaged systematic reviews and related products have recently gained more recognition for linking evidence to policymaking and are viewed as key elements for strategies to strengthen national health systems [39, 40]. Health Systems Evidence (HSE) was developed as a one-stop shop for policy- and management-related systematic reviews and related products, and is the only resource that answers questions about how to organise health systems in order to ensure that cost-effective programmes and services are provided to those who need them [39]. The Cochrane Library is a one-stop shop for clinical programmes and services or medicines, and 'health-evidence.ca' was developed for public health programmes and services [41]. To enhance their KTE skills, researchers should also be trained on developing policy briefs and conducting policy dialogues using the SUPPORT tools (SUPporting POlicy relevant Reviews and Trials) as guides [42, 43]. Researchers should also focus their efforts on the production of systematic reviews of the literature that could better inform the local health context [30]. For example, a study from the region suggested several interventions for promoting systematic reviews, including training of researchers on systematic reviews, mandatory education as part of the curricula for research degrees, the publication of specialized journals, as well as improving the quality of local primary research [18]. In addition, more training to researchers should be provided on using the media, including newspapers, websites, television, and radio, for presenting and discussing their research results and implications. Recent findings show that when researchers receive basic training for increasing their communication and KTE skills, better results regarding research transfer and utilization can be achieved [17, 44].

It is also necessary that policies and procedures of academic institutions in the EMR reflect that KTE is a priority. Efforts should be directed towards revising promotion and employment criteria so as to include researchers' KTE activities and research utilization. A strategy that can be employed by academic institutions to motivate researchers to engage in KTE is to develop a measure of the impact of research on policy. This would enable the inclusion of KTE in promotion and funding criteria and would incentivize researchers for engaging in KTE activities [22, 44, 45].

Literature shows that the success of KTE strategies highly depends on tailoring the approach to the barriers and facilitators found within a particular and unique setting [46–48]. In order to design effective KTE strategies, an increased understanding of the barriers and facilitators for the use of evidence is required from researchers. The current survey provides researchers and those interested in the design and implementation of KTE strategies with an overview of the barriers and facilitators found in the region as well as the contextual factors that compete with evidence in the policymaking environment, which can inform them in tailoring their KTE approach to the local setting.

The evidence base to support the effectiveness of KTE strategies is not definitive and is relatively scarce in developing countries generally [5], and in the EMR specifically. Currently, there is not enough evidence on which KTE strategy works best and in what context and where the responsibility for KTE rests [5]. Furthermore, limited evidence exists, especially in the EMR, on the effectiveness of utilizing knowledge brokers, intermediaries that enhance communication and exchange between researchers and policymakers. Therefore, additional research is needed to examine the effectiveness of KTE strategies and interventions in the region. Research is also needed to develop and test conceptual KTE models and frameworks that guide those undertaking KTE activities in tailoring their approach to the regional setting. Similar studies in the region should be repeated in a few years to measure changes in researchers' KTE activities and environment. Given that many organizations and funders, such as EVIPNet EMR, are currently mobilizing resources and efforts to support KTE platforms in the region, it will be interesting to examine the outcome of these organizational activities on researchers' KTE activities.

Conclusion

Health researchers in several countries from the EMR recognize the importance of using health systems evidence in health policymaking. However, more efforts are needed from the side of both researchers and policymakers as well as academic institutions to enhance the use of evidence in health policymaking in the region. This study provides baseline data on the practices and views of researchers in the region. Findings from this study may help guide strategies for enhancing the use of health systems evidence in policymaking with emphasis on the two-way communication and partnerships between researchers and policymakers. Study findings are critical in light of the upcoming World Health Report 2012, which will emphasize the significance of conducting and translating health research to help inform health policies.

Financial Disclosure

This study was jointly funded by the Global Health Research Initiative and the WHO EMRO. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  1. World Health Organization Regional Office for the Eastern Mediterranean: Strategic Directions for Research for Health: Scaling up in the Eastern Mediterranean Region. 2011

    Google Scholar 

  2. World Health Assembly: Resolution on health research. 2005, [http://www.who.int/rpc/meetings/58th_WHA_resolution.pdf]

    Google Scholar 

  3. World Health Organization: The Bamako call to action on research for health. 2008, [http://www.who.int/gb/ebwha/pdf_files/EB124/B124_12Add2-en.pdf]

    Google Scholar 

  4. Lavis JN, Guindon GE, Cameron D, Boupha B, Dejman M, Osei EJ, Sadana R, Research to Policy and Practice Study Team: Bridging the gaps between research, policy and practice in low- and middle-income countries: a survey of researchers. CMAJ. 2010, 182: E350-E361. 10.1503/cmaj.081164.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Mitton C, Adair CE, McKenzie E, Patten SB, Waye Perry B: Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007, 85: 729-768. 10.1111/j.1468-0009.2007.00506.x.

    Article  PubMed  PubMed Central  Google Scholar 

  6. World Health Organization Regional Office for the Eastern Mediterranean: Twenty-fourth session of the Eastern Mediterranean advisory committee on health research. Report to the regional director. 2009, [http://www.emro.who.int/rpc/pdf/who_em_rpc_029_e_en.pdf]

    Google Scholar 

  7. World Health Organization Regional Office for the Eastern Mediterranean: Bridging the gap between health researchers and policy-makers in the Eastern Mediterranean Region. 2008, Document EM/RC55/R.7. http://www.emro.who.int/RC55/media/pdf/EMRC5504En.pdf

    Google Scholar 

  8. World Health Organization Regional Office for the Eastern Mediterranean: Renewed health research for development. 2001, Document EM/RC48/R.8 (D). http://www.emro.who.int/rpc/pdf/RC48_RenewedHR.pdf

    Google Scholar 

  9. Kennedy A, Khoja TA, Abou-Zeid AH, Ghannem H, IJsselmuiden C, WHO-EMRO/COHRED/GCC NHRS Collaborative Group: National health research system mapping in 10 Eastern Mediterranean countries. East Mediterr Health J. 2008, 14: 502-517.

    CAS  PubMed  Google Scholar 

  10. El-Jardali F, Makhoul J, Jamal D, Ranson MK, Kronfol NM, Tchaghchagian V: Eliciting policymakers' and stakeholders' opinions to help shape health system research priorities in the Middle East and North Africa region. Health Policy Plan. 2010, 25: 15-27. 10.1093/heapol/czp059.

    Article  PubMed  Google Scholar 

  11. Law TJ, Lavis JN, Hamandi A, Cheung A, El-Jardali F, KT Platform Evaluation Team: Climate for evidence-informed health systems: A profile of systematic review production in 41 low- and middle-income countries, 1996-2008. J Health Serv Res Policy. 2011

    Google Scholar 

  12. World Health Organization Regional Office for the Eastern Mediterranean: Bridging the gap between health researchers and policymakers in the Eastern Mediterranean Region. 2008, Document EM/RC55/4. http://www.emro.who.int/rc55/media/pdf/EMRC55R6a.pdf

    Google Scholar 

  13. Cheung A, Lavis JN, Hamandi A, El-Jardali F, Sachs J, Sewankambo N, Knowledge-Translation Platform Evaluation Team: Climate for evidence-informed health systems: A print media analysis in 44 low- and middle-income countries that host knowledge-translation platforms. Health Res Policy Syst. 2011, 9: 7-10.1186/1478-4505-9-S1-S7.

    Article  PubMed  PubMed Central  Google Scholar 

  14. United Nations Development Programme: Human development report. 2006, Beyond scarcity: Power, poverty and the global water crisis, [http://www.undp.org.mk/content/Publications/HDR06-complete.pdf]

    Google Scholar 

  15. United Nations Development Programme: The arab human development report. Towards freedom in the arab world. 2004, [http://www.arab-hdr.org/publications/other/ahdr/ahdr2004e.pdf]

    Google Scholar 

  16. Majdzadeh R, Sadighi J, Nejat S, Mahani AS, Gholami J: Knowledge translation for research utilization: design of a knowledge translation model at Tehran University of Medical Sciences. J Contin Educ Health Prof. 2008, 28: 270-277. 10.1002/chp.193.

    Article  PubMed  Google Scholar 

  17. Nedjat S, Majdzadeh R, Gholami J, Nedjat S, Maleki K, Qorbani M, Shokoohi M, Ashoorkhani M: Knowledge transfer in Tehran University of Medical Sciences: an academic example of a developing country. Implement Sci. 2008, 3: 39-10.1186/1748-5908-3-39.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Yousefi-Nooraie R, Rashidian A, Nedjat S, Majdzadeh R, Mortaz-Hedjri S, Etemadi A, Salmasian H: Promoting development and use of systematic reviews in a developing country. J Eval Clin Pract. 2009, 15: 1029-34. 10.1111/j.1365-2753.2009.01184.x.

    Article  PubMed  Google Scholar 

  19. Majdzadeh R, Nedjat S, Denis JL, Yazdizadeh B, Gholami J: 'Linking research to action' in Iran: Two decades after integration of the Health Ministry and the medical universities. Public Health. 2010, 124: 404-411. 10.1016/j.puhe.2010.03.026.

    Article  CAS  PubMed  Google Scholar 

  20. Majdzadeh R, Yazdizadeh B, Nedjat S, Gholami1 J, Ahghari S: Strengthening evidence-based decision-making: is it possible without improving health system stewardship?. Health Policy Plan. 2011, doi: 10.1093/heapol/czr072

    Google Scholar 

  21. Campbell DM, Redman S, Jorm L, Cooke M, Zwi AB, Rychetnik L: Increasing the use of evidence in health policy: practice and views of policy makers and researchers. Aust New Zealand Health Policy. 2009, 6: 21-10.1186/1743-8462-6-21.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Tehran University of Medical Sciences: Center for Academic Health and Policy. TUMS-KTE Study Group: Self-assessment tool and discussion guide, [http://sit.tums.ac.ir/workshop/Backgroung%20paper%202%205.pdf]

  23. Wilczynski NL, Haynes RB, Lavis JN, Ramkissoonsingh R, Arnold-Oatley AE, HSR Hedges team: Optimal search strategies for detecting health services research studies in MEDLINE. CMAJ. 2004, 171: 1179-1185. 10.1503/cmaj.1040512.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Kendall J: Axial coding and the grounded theory controversy. West J Nurs Res. 1999, 21: 743-757.

    Article  CAS  PubMed  Google Scholar 

  25. Gholami J, Majdzadeh R, Nedjat S, Nedjat S, Maleki K, Ashoorkhani M, Yazdizadeh B: How should we assess knowledge translation in research organizations; designing a knowledge translation self-assessment tool for research institutes (SATORI). Health Res Policy Syst. 2011, 9: 10-10.1186/1478-4505-9-10.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Hyder AA, Corluka A, Winch PJ, El-Shinnawy A, Ghassany H, Malekafzali H, Lim MK, Mfutso-Bengo J, Segura E, Ghaffar A: National policy-makers speak out: are researchers giving them what they need?. Health Policy Plan. 2010, 26: 73-82.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Santesso N, Tugwell P: Knowledge translation in developing countries. J Contin Educ Health Prof. 2006, 26: 87-96. 10.1002/chp.55.

    Article  PubMed  Google Scholar 

  28. Remme JH, Adam T, Becerra-Posada F, D'Arcangues C, Devlin M, Gardner C, Ghaffar A, Hombach J, Kengeya JF, Mbewu A, Mbizvo MT, Mirza Z, Pang T, Ridley RG, Zicker F, Terry RF: Defining research to improve health systems. PLoS Med. 2010, 7: e1001000-10.1371/journal.pmed.1001000.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Guindon GE, Lavis JN, Becerra-Posada F, Malek-Afzali H, Shi G, Yesudian CA, Hoffman SJ, Research to Policy and Practice Study Team: Bridging the gaps between research, policy and practice in low- and middle-income countries: a survey of health care providers. CMAJ. 2010, 182: E362-E372. 10.1503/cmaj.081165.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005, 10 (Suppl 1): 35-48.

    Article  PubMed  Google Scholar 

  31. Innvaer S, Vist G, Trommald M, Oxman A: Health policy-makers' perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244. 10.1258/135581902320432778.

    Article  PubMed  Google Scholar 

  32. Walter I, Davies H, Nutley S: Increasing research impact through partnerships: evidence from outside health care. J Health Serv Res Policy. 2003, 8 (Suppl 2): 58-61.

    Article  PubMed  Google Scholar 

  33. Ross S, Lavis J, Rodriguez C, Woodside J, Denis JL: Partnership experiences: involving decision-makers in the research process. Journal of Health Services & Research Policy. 2003, 8 (Suppl 2): 26-34.

    Article  Google Scholar 

  34. United Nations Development Program: The arab human development report 2002: Creating opportunities for future generations. [http://www.arab-hdr.org/publications/other/ahdr/ahdr2002e.pdf]

  35. Chalmers I, Glasziou P: Avoidable waste in the production and reporting of research evidence. Lancet. 2009, 374: 86-89. 10.1016/S0140-6736(09)60329-9.

    Article  PubMed  Google Scholar 

  36. Gonzalez Block MA, Mills A: Assessing capacity for health policy and systems research in low and middle income countries. Health Res Policy Syst. 2003, 1: 1-10.1186/1478-4505-1-1.

    Article  PubMed  PubMed Central  Google Scholar 

  37. World Health Organization: Engaging for health: Eleventh general programme of work 2006-2015: A global health agenda. [http://whqlibdoc.who.int/publications/2006/GPW_eng.pdf]

  38. Hanney SR, Gonzalez-Block MA, Buxton MJ, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1: 2-10.1186/1478-4505-1-2.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Moat K, Lavis J: Supporting the use of cochrane reviews in health policy and management decision-making: Health systems evidence. The Cochrane Library 2011. [http://www.thecochranelibrary.com/details/editorial/1018237/Supporting-the-use-of-Cochrane-Reviews-in-health-policy-and-management-decision-.html]

  40. Lavis JN, Lomas J, Hamid M, Sewankambo NK: Assessing country-level efforts to link research to action. Bull World Health Organ. 2006, 84: 620-628. 10.2471/BLT.06.030312.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Dobbins M, DeCorby K, Robeson P, Husson H, Tirilis D, Greco L: A knowledge management tool for public health: health-evidence.ca. BMC Public Health. 2010, 10: 496-10.1186/1471-2458-10-496.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): 13-10.1186/1478-4505-7-S1-S13.

    Article  Google Scholar 

  43. Lavis JN, Boyko JA, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 14: Organising and using policy dialogues to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): 14-10.1186/1478-4505-7-S1-S14.

    Article  Google Scholar 

  44. Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J, Knowledge Transfer Study Group: How can research organizations more effectively transfer research knowledge to decision makers?. Milbank Q. 2003, 81: 221-248. 10.1111/1468-0009.t01-1-00052.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Council for Medical Sciences: The societal impact of applied health research. Towards a quality assessment system. 2002, [http://www.knaw.nl/Content/Internet_KNAW/publicaties/pdf/20021098.pdf]

    Google Scholar 

  46. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.

    Article  PubMed  Google Scholar 

  47. Graham ID, Tetroe J, KT Theories Research Group: Some theoretical underpinnings of knowledge translation. Acad Emerg Med. 2007, 14: 936-941.

    Article  PubMed  Google Scholar 

  48. Lavis JN: Research, public policymaking, and knowledge-translation processes: Canadian efforts to build bridges. J Contin Educ Health Prof. 2006, 26: 37-45. 10.1002/chp.49.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Global Health Research Initiative and the WHO EMRO for supporting this study. The authors wish to extend their appreciation to all the researchers who took the time to complete this survey. Special thanks are due to Ms. Mariam Itani for her assistance with translating the survey to Arabic.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fadi El-Jardali.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

All authors meet criteria for authorship. All authors approved this version of the article for submission. FJ contributed to the conception, design, and interpretation of the data as well as to drafting and critically revising the article. JNL contributed to the conception and analysis of the study as well as critically revising the article. NA and DJ contributed to acquisition of data, analysis, interpretation as well as drafting and critically revising the article.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

El-Jardali, F., Lavis, J.N., Ataya, N. et al. Use of health systems and policy research evidence in the health policymaking in eastern Mediterranean countries: views and practices of researchers. Implementation Sci 7, 2 (2012). https://doi.org/10.1186/1748-5908-7-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1748-5908-7-2

Keywords