Knowledge translation of research findings
© Grimshaw et al.; licensee BioMed Central Ltd. 2012
Received: 31 October 2011
Accepted: 31 May 2012
Published: 31 May 2012
One of the most consistent findings from clinical and health services research is the failure to translate research into practice and policy. As a result of these evidence-practice and policy gaps, patients fail to benefit optimally from advances in healthcare and are exposed to unnecessary risks of iatrogenic harms, and healthcare systems are exposed to unnecessary expenditure resulting in significant opportunity costs. Over the last decade, there has been increasing international policy and research attention on how to reduce the evidence-practice and policy gap. In this paper, we summarise the current concepts and evidence to guide knowledge translation activities, defined as T2 research (the translation of new clinical knowledge into improved health). We structure the article around five key questions: what should be transferred; to whom should research knowledge be transferred; by whom should research knowledge be transferred; how should research knowledge be transferred; and, with what effect should research knowledge be transferred?
We suggest that the basic unit of knowledge translation should usually be up-to-date systematic reviews or other syntheses of research findings. Knowledge translators need to identify the key messages for different target audiences and to fashion these in language and knowledge translation products that are easily assimilated by different audiences. The relative importance of knowledge translation to different target audiences will vary by the type of research and appropriate endpoints of knowledge translation may vary across different stakeholder groups. There are a large number of planned knowledge translation models, derived from different disciplinary, contextual (i.e., setting), and target audience viewpoints. Most of these suggest that planned knowledge translation for healthcare professionals and consumers is more likely to be successful if the choice of knowledge translation strategy is informed by an assessment of the likely barriers and facilitators. Although our evidence on the likely effectiveness of different strategies to overcome specific barriers remains incomplete, there is a range of informative systematic reviews of interventions aimed at healthcare professionals and consumers (i.e., patients, family members, and informal carers) and of factors important to research use by policy makers.
There is a substantial (if incomplete) evidence base to guide choice of knowledge translation activities targeting healthcare professionals and consumers. The evidence base on the effects of different knowledge translation approaches targeting healthcare policy makers and senior managers is much weaker but there are a profusion of innovative approaches that warrant further evaluation.
Globally we spend billions of dollars each year in both the public and private sectors on biomedical, clinical, and health services research, undergraduate healthcare professional training and continuing professional development, quality improvement, patient safety, and risk management. Despite this, healthcare systems fail to ensure that effective and cost-effective programs, services, and drugs get to all of those who need them; and healthcare professionals fail to provide the level of care to which they aspire. One of the most consistent findings from clinical and health services research is the failure to translate research into practice and policy. For example, McGlynn and colleagues observed that patients in the USA received 55% of recommended care, and that quality varied by medical condition ranging from 79% of recommended care for senile cataract to 11% of recommended care for alcohol dependence . Similar findings have been reported globally in both developed and developing settings, in both primary care and specialty-provided care and in care provided by all disciplines . As a result of these evidence-practice gaps, patients fail to benefit optimally from advances in healthcare resulting in poorer quality of life and loss of productivity both personally and at the societal level.
In addition to the limited use of effective treatments, there is also evidence that around 20% to 30% of patients may get care that is not needed or care that could be potentially harmful . Because of these evidence-practice gaps, patients are exposed to unnecessary risks of iatrogenic harms and healthcare systems are exposed to unnecessary expenditure resulting in significant opportunity costs.
Over the last 10 to 15 years, there has been increasing international policy and research attention on how to reduce the evidence-practice and policy gap. Across different healthcare systems, different terms describe these efforts including quality assurance, quality improvement, knowledge translation, knowledge utilisation, knowledge transfer and exchange, innovation diffusion, implementation research, research utilisation, evidence-informed policy, and evidence-informed health systems [4, 5]. These different terms often cover related and overlapping constructs. Commenting on the terminology of quality assurance in 1982, Donabedian noted that ‘we have used these words in so many different ways that we no longer clearly understand each other when we say them’ . Throughout this paper, we use the term ‘knowledge translation’ which has gained currency in Canada and globally over the last decade. There are two main types of translational research. T1 research refers to the translation of basic biomedical research into clinical science and knowledge, while T2 research refers to the translation of this new clinical science and knowledge into improved health . In this paper, we refer to T2 research. We define knowledge translation as ‘ensuring that stakeholders are aware of and use research evidence to inform their health and healthcare decision-making.’ This definition recognizes that there are a wide range of stakeholders or target audiences for knowledge translation, including policy makers, professionals (practitioners), consumers (i.e., patients, family members, and informal carers), researchers, and industry.
What should be transferred?
To whom should research knowledge be transferred?
By whom should research knowledge be transferred?
How should research knowledge be transferred?
With what effect should research knowledge be transferred?
What should be transferred?
The increased focus on knowledge translation has frequently emphasised individual studies as the unit for knowledge translation. While this may be appropriate when the targets for knowledge translation are other researchers or research funders (who need to be aware of primary research results), we argue that this is inappropriate when the targets for knowledge translation are consumers, healthcare professionals, and/or policy makers. This is because individual studies rarely, by themselves, provide sufficient evidence for practice and policy changes. In fact, individual studies may be misleading due to bias in their conduct or random variations in their findings, although some exceptionally large randomised trials may be sufficiently persuasive by themselves to warrant practice or policy change, e.g., the Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial (ALLHAT)  and the International Study of Infarct Survival 2 (ISIS-2) Trial .
Ioannidis and colleagues undertook a series of landmark studies of research exploring the evolution of evidence in healthcare (summarized in ). In both basic and clinical sciences, they observed the ‘Proteus phenomenon’—that the first published study on a scientific question may find the most extravagant effect size and that as further evidence is gathered, effect sizes tend to diminish . They observed that thousands of observations were required before estimates of gene disease association became stable . They also noted that the results of even highly cited clinical research studies published in major medical and specialty journals were likely to be contraindicated or found to be exaggerated with further accumulation of evidence . As a result, Ioannidis and colleagues argued that replication and evidence synthesis is needed before knowledge translation .
We suggest that the results of individual studies need to be interpreted within the context of global evidence before deciding whether it is ready for knowledge translation. In other words, the basic unit of knowledge translation should be up-to-date systematic reviews or other syntheses of the global evidence. Greater emphasis on the results of systematic reviews would increase the ‘signal to noise’ of knowledge translation activities and may increase the likelihood of their success. Over the last twenty years, healthcare research funders and healthcare systems have made considerable investments in knowledge syntheses, especially those targeting the needs of healthcare practitioners and patients. Examples include the substantial number of publicly funded national guideline and health technology programs, The Cochrane Collaboration , and the US funded Evidence-based Practice Centers .
The question ‘What should be transferred?’ also challenges knowledge translators to identify the key messages for different target audiences and to fashion these in language and knowledge translation products that are easily assimilated by different audiences. Over the past decade, a variety of different products have been developed targeting different audiences (for example, decision aids for patients , clinical practice guidelines for healthcare professionals , and actionable messages  and policy briefs  for policy makers).
To whom should research knowledge be transferred?
Stakeholders for different types of research
Type of research
National Policy Makers
Potential target audiences for clinical research about a drug (adapted from Mowatt et al., 1998 )
Stop use, promote research
Promote use for limited indications
Promote use for new indication
Promote widespread use
National Policy Makers
By whom should research knowledge be transferred?
The messenger in knowledge translation efforts may be an individual (e.g., healthcare practitioner, researcher, or consumer), group, organization, or even healthcare system. The most appropriate messenger will vary according to the target audience and research knowledge being transferred. Shonkoff suggests that in determining ‘who’ should be the messenger credibility is important . Research supports this view; Hayward and colleagues found that an authoritative endorsement by a respected physician organization or physician colleague influenced physicians’ use of clinical practice guidelines in practice . With public policy makers, Lavis and colleagues suggest that the most credible messengers might include organizations of government officials .
Building credibility and acting as a messenger for the transfer of research knowledge is a time-consuming and skill-intensive process, making it impossible to use a ‘one size fits all’ approach to deciding ‘by whom should research knowledge be transferred’ . Researchers typically carry the responsibility for conducting knowledge translation. They should, however, only be the messenger when they have credibility with the target audience, possess the skills and experience needed to transfer the research knowledge at hand, and have time and resources to do so. A more appropriate approach to effective and sustainable knowledge translation may be the development of research knowledge infrastructures by healthcare systems that address the needs of their various stakeholders (e.g., consumers, practitioners, managers, and policy makers). Ellen and colleagues define research knowledge infrastructure as any instrument (i.e., programs, tools, devices) implemented in a healthcare system in order to facilitate access, dissemination, exchange, and/or use of evidence . Components of research knowledge infrastructures are classified into two broad categories: technological and organizational. Technological components include electronic databases and search engines. Organizational components include documentation specialists, data analysts, knowledge brokers (i.e., individuals who manage the collaboration between an organization, external information, and knowledge producers and users), and training programs (to assist with activities such as searching for information, quality appraisal, adaption and use of the research findings) [25, 26].
In Canada, some knowledge translation researchers have invested significant time and financial resources into building technological (online databases with built-in search engines) resources that can be used by healthcare systems as part of a research knowledge infrastructure. Rx for Change is an online database that houses syntheses of the global evidence from systematic reviews: on the effectiveness of interventions for improving prescribing by healthcare professionals and medicines use by consumers; of professional interventions that impact the delivery of care; and of organizational, financial, and regulatory interventions that influence professional behaviour. The methods used to populate the database parallel systematic-review methodology. Rx for Change is publicly accessible and contains research information relevant to healthcare professionals, consumers, policy makers, and researchers .
Health Systems Evidence is also an online database, but primarily targets policy makers and senior managers (and other individuals responsible for assisting or making public policy decisions). Common criticisms of systematic reviews by policy makers include the absence of relevant reviews, and difficulty accessing and understanding reviews. Health Systems Evidence addresses these criticisms in order to facilitate the use of systematic reviews in health systems and policy decision making. Health Systems Evidence is a repository of syntheses of research evidence about governance, financial, and delivery arrangements within health systems, and about implementation strategies that can support change in health systems. The database contains policy briefs, overviews of systematic reviews, systematic reviews, and soon will contain a range of other types of documents needed in the policymaking process, such as economic evaluations.
Both databases (Rx for Change and Health Systems Evidence) provide improved access to research information for consumers, practitioners, and/or policy makers. However, this access is necessary but not sufficient to ensure knowledge translation. Effective and sustainable knowledge translation also requires organizational knowledge infrastructure components. Ellen and colleagues developed a research knowledge infrastructure framework that identified potential organizational components that a healthcare system could have in its research knowledge infrastructure. This framework is based on an environmental scan and scoping review of existing literature. The broad organizational domains included in the framework are: climate for research use, research production, activities used to link research to action including push efforts (i.e., efforts undertaken by researchers to disseminate research evidence to knowledge users), pull efforts (i.e., efforts by knowledge users to access and use research evidence), and exchange efforts (i.e., efforts focused on building and maintaining relationships between researchers and knowledge users), and evaluation of efforts . This framework is currently being evaluated in a study examining knowledge-translation platforms in 41 countries [25, 28].
How should research knowledge be transferred?
Planning for knowledge translation
There are a large number of planned knowledge translation models, derived from different disciplinary and contextual viewpoints [29, 30]. Most of these suggest that planned knowledge translation is more likely to be successful if an assessment of the likely barriers and facilitators informs the choice of knowledge translation strategy. In this section, we briefly discuss types of barriers, potential approaches for identifying barriers, and factors influencing the choice of knowledge translation intervention.
Identifying barriers to knowledge translation
Common barriers across target groups include issues relating to knowledge management, such as the sheer volume of research evidence currently produced, access to research evidence sources, time to read evidence sources and skills to appraise and understand research evidence. Over the past twenty years, there has been substantial investment by many healthcare systems to address these knowledge management barriers. For example, the conduct of systematic reviews and development of clinical practice guidelines to reduce the volume of research evidence and the time needed to read evidence sources; investment in electronic libraries of health and public access evidence sources to improve access to research evidence; and the development of critical appraisal skills tools and training to improve research literacy skills.
However while better knowledge management is necessary, it is unlikely by itself to be sufficient to ensure knowledge translation because of barriers working at different levels of healthcare systems, many of which operate at levels beyond the control of an individual practitioner. For example, barriers may operate at other levels of a healthcare system including: structural barriers (e.g. financial disincentives), organizational barriers (e.g. inappropriate skill mix, lack of facilities or equipment), peer group barriers (e.g. local standards of care not in line with desired practice), professional (e.g. knowledge, attitudes and skills) and professional-patient interaction barriers (e.g. communication and information processing issues). Evidence in support of this can be found in a structured review of healthcare professionals’ views on engagement in quality improvement activities . In this review, Davies and colleagues concluded that many of the barriers to participating in quality improvement activities identified by professionals arise from problems related to working effectively between and across health professions. This means that although knowledge management resources (e.g., more time and more resources) may be necessary and even helpful, they are unlikely to be sufficient to overcome the other ‘organizational’ barriers professionals face to engage in quality improvement (and knowledge translation) activities .
There are diverse methods for identifying potential barriers including qualitative approaches (individual interviews, focus groups), surveys and direct observation . However, there are no standard approaches available yet. As a result, those involved with knowledge translation activities need to use their judgement about how best to elicit barriers given their understanding of the context and potential barriers and resources available to them.
Unfortunately, our evidence on the likely effectiveness of different strategies to overcome specific barriers to knowledge translation remains incomplete. Individuals involved in knowledge translation need to: identify modifiable and non-modifiable barriers relating to behavior; identify potential adopters and practice environments; and prioritise which barriers to target based upon consideration of ‘mission critical’ barriers. Furthermore, the potential for addressing these barriers through knowledge translation activities (based upon consideration of the likely mechanisms of action of interventions) and the resources available for knowledge translation activities also needs to be addressed.
Effectiveness of professional behaviour change strategies
The Cochrane Effective Practice and Organisation of Care (EPOC) group supports reviews of interventions to improve healthcare systems and healthcare delivery . It has identified over 7,000 randomised and quasi-experimental studies and conducted 80 systematic reviews of professional, organisational, financial, and regulatory interventions within its scope by August 2011.
Effectiveness of professional behaviour change strategies from selected EPOC systematic reviews
Number of studies/individuals
Printed Educational Materials
12 randomised trials
Median absolute improvement of care on categorical process outcomes (e.g., x-ray requests, prescribing and smoking cessation activities) of 4.3% (range −8.0% to +9.6%) across studies.
11 nonrandomised studies
Farmer et al.
81 randomised trials (involving more than 11,000 health professionals)
Median absolute improvement in care of 6.0% (interquartile range +1.8% to 15.3%).
Forsetlund et al.
Larger effects were associated with higher attendance rates, mixed interactive and didactic meetings and interactive meetings.
Smaller effects were observed for complex behaviours and for less serious outcomes.
69 randomised trials (involving more than 15,000 health professionals)
Median absolute improvements in:
·prescribing behaviours (17 comparisons) of 4.8% (interquartile range +3.0% to + 6.5%);
O’Brien et al.
·other behaviours (17 comparisons) of 6.0% (interquartile range +3.6% to +16.0%).
The effects of educational outreach for changing more complex behaviours are less certain.
Local Opinion Leaders
18 randomised trials (involving more than 296 hospitals and 318 primary care physicians)
Median absolute improvement of care of 12.0% across studies (interquartile range +6.0% to +14.5%).
Flodgren et al.
Audit and Feedback
118 randomised trials
Median absolute improvement of care of 5.0% (interquartile range +3% to +11%).
Jamtvedt et al.
In general, larger effects were seen if baseline compliance was low.
28 randomised trials
Median absolute improvement of care of 4.2% (interquartile range +0.8% to +18.8%).
Shojania et al.
Comment: Most studies have examined the effects of relatively simple reminders; the results of more complex decision support systems, especially for chronic disease management, have been less successful.
26 randomised trials
Meta-regression using 12 randomised trials. Pooled odds ratio of 1.52 (95% CI, 1.27 to 1.82, p < .001)
Baker et al.
Generally, similar median absolute effect sizes are reported across the interventions. While one interpretation might be that the choice of intervention is less important than doing something/anything (i.e., that the observed effects are largely non specific (Hawthorne-like) effects), we do not believe this to be the case. The interquartile range of absolute effect sizes covers almost 30 percentage points and varies by intervention (see Table 3). Furthermore, the variation in observed effects within intervention category (for example the interquartile range of observed effects in trials of audit and feedback was +3% to +11% absolute improvements in performance) suggest that the effects of interventions vary presumably related to the degree to which the mechanism of action of the intervention addresses the underlying barriers in a study. The interventions also have very different mechanisms of action, and there is likely to be confounding within and across reviews. In other words, researchers are likely to have tested interventions that they believed likely effective given the particular behaviours and likely barriers within the context of their study. Finally, because we are reporting absolute effects some broad commonality of effect sizes is to be expected. In general, interventions are not tested in the expectation of producing large absolute effect sizes. Most cluster trials are powered to detect effects in the range of 10 to 20 percent absolute improvement. Under these circumstances similarity of observed effects is not surprising.
Printed educational materials
EPOC defines printed educational materials as the ‘distribution of published or printed recommendations for clinical care, including clinical practice guidelines, audio-visual materials and electronic publications. The materials may have been delivered personally or through mass mailings’ . In general, printed educational materials target knowledge and potential skill gaps of individual healthcare professionals. While they could also be used to target motivation when written as a ‘persuasive communication’ there is little evidence of them being used in this way. Printed educational materials are commonly used, have a relatively low cost and are generally feasible in most settings.
EPOC defines educational meetings as the ‘participation of healthcare providers in conferences, lectures, workshops or traineeships’ . An important distinction is between didactic meetings (that largely target knowledge barriers at the individual healthcare professional/peer group level) and interactive workshops (that can target knowledge, attitudes, and skills at the individual healthcare professional/peer group level). Educational meetings are commonly used, with the main cost related to the release time for healthcare professionals, and are generally feasible in most settings.
EPOC defines educational outreach or academic detailing as ‘use of a trained person who meets with providers in their practice settings to give information with the intent of changing the providers’ practice. The information given may have included feedback on the performance of the provider(s)’ . Soumerai and Avorn suggest that educational outreach derives from social marketing approaches that target an individual’s knowledge and attitudes . Typically, the detailer aims to get a maximum of three messages across during a 10 to 15 minute meeting with a healthcare provider. The detailer will tailor their approach to the characteristics of the individual healthcare provider, and typically use additional provider behaviour change strategies to reinforce their message. Most studies of educational outreach have focused on changing relatively simple behaviours in the control of individual physician behaviors such as the choice of drugs to prescribe.
Educational outreach programs have been used across a wide range of healthcare settings especially to target prescribing behaviours. They require considerable resources including the costs of detailers and preparation of materials. Nevertheless, Mason and colleagues observed that educational outreach may still be efficient to change prescribing patterns .
Local opinion leaders
EPOC defines local opinion leaders as ‘use of providers nominated by their colleagues as ‘educationally influential’ . The investigators must have explicitly stated that their colleagues identified the opinion leaders.’ Opinion leadership is the degree to which an individual is able to influence other individuals’ attitudes or overt behaviour informally in a desired way with relative frequency. This informal leadership is not a function of the individual’s formal position or status in the system; it is earned and maintained by the individual’s technical competence, social accessibility, and conformity to the systems norms. When compared to their peers, opinion leaders have greater exposure to all forms of external communication, have somewhat higher social status and are more innovative. However, the most striking feature of opinion leaders is their unique and influential position in their system’s communication structure; they are at the centre of interpersonal communication networks (interconnected individuals who are linked by patterned flows of information). Opinion leaders target the knowledge, attitudes, and social norms of their peer group. The potential success of opinion leaders is dependent upon the existence of intact social networks within professional communities. Grimshaw and colleagues observed that the existence of such networks varied across communities and settings within the UK . They also observed that opinion leaders were condition-specific; in other words, colleagues identified different opinion leaders for different clinical problems. Doumit also observed that opinion leaders where not stable over time . The resources required for opinion leaders include costs of the identification method, training of opinion leaders and additional service costs.
Audit and feedback
EPOC defines audit and feedback as ‘any summary of clinical performance of healthcare over a specified period of time’ to change health professional behaviour, as indexed by ‘objectively measured professional practice in a healthcare setting or healthcare outcomes.’ The summary may also have included recommendations for clinical action. The information may have been obtained from medical records, computerised databases, or observations from patients. The subsequent feedback of and resulting action planning based on the audit summary are also important elements of an audit and feedback intervention [41, 48]. Adams and colleagues observed that healthcare professionals often over estimated their performance by around 20% to 30% . Audit and feedback target healthcare provider/peer groups’ perceptions of current performance levels and is useful to create cognitive dissonance within healthcare professionals as a stimulus for behaviour change. The resources required to deliver audit and feedback include data abstraction and analysis costs and dissemination costs. The feasibility of audit and feedback may depend on the availability of meaningful routine administrative data for feedback.
EPOC defines reminders as ‘patient or encounter specific information, provided verbally, on paper or on a computer screen, which is designed or intended to prompt a health professional to recall information . This would usually be encountered through their general education, in the medical records or through interactions with peers, and so remind them to perform or avoid some action to aid individual patient care. Computer aided decision support and drugs dosage are included.’ Reminders prompt healthcare professionals to remember to do important items during professional-patient interactions . The majority of early studies on computerized reminders were undertaken in highly computerized US academic health science centres, and their generalisability to other settings is less certain . The resources required vary across the delivery mechanism. Additionally, there is insufficient knowledge at present about how to prioritise and optimize reminders.
Tailored interventions are ‘strategies to improve professional practice that are planned taking account of prospectively identified barriers to change’ . Barriers to change refer to factors that have the potential to impair the effectiveness of interventions designed to improve professional behaviour/practice. EPOC classifies barriers to change into nine categories (information management, clinical uncertainty, sense of competence, perceptions of liability, patient expectations, standards of practice, financial disincentives, administrative constraints, and other) . In a recent review, Baker and colleagues assessed the effectiveness of interventions tailored to address identified barriers to change on professional practice or patient outcomes and found that tailored interventions are more likely to improve professional practice (e.g., prescribing and adherence to guideline recommendations) than is no intervention or the dissemination of guidelines or educational materials. Further research is needed to determine the effectiveness of tailored interventions in comparison with other interventions .
Effectiveness of knowledge translation strategies focusing on consumers
The Cochrane Consumers and Communication Review Group supports systematic reviews of the effects of interventions (particularly those which focus on information and communication) which affect consumers’ interactions with healthcare professionals, healthcare services and healthcare researchers . Outcomes of interest include effects on people’s knowledge and decision-making, healthcare use, experience of healthcare, and health and wellbeing. They have identified over 7,000 randomised studies and conducted 35 systematic reviews of interventions and one overview of systematic reviews  within their scope to August 2011.
Effectiveness of knowledge translation strategies focusing on consumers from selected systematic reviews
Number of studies
86 randomised trials (involving more than 20,209 participants)
Compared with usual care, decision aids:
Stacey et al.
·improved knowledge and accuracy of risk perceptions;
·reduced the proportion of people who were passive in decision-making;
·resulted in a higher proportion of patients achieving decisions informed and consistent with their values (when decision aids included an explicit values clarification component);
·reduced the number of people remaining undecided;
·reduced decisional conflict;
·decreased the choice of major elective surgery in favour of conservative options.
Decision aids have no adverse effects on satisfaction but further research is needed to clarify their effect on adherence to chosen option, patient-practitioner communication, cost-effectiveness and use with developing or lower literacy populations.
Personalised Risk Communication
22 randomised trials
There was weak evidence, consistent with a small effect, that personalised risk communication (whether written, spoken or visually presented) increases uptake of screening tests.
Edwards et al.
Communication before Consultations
33 randomised trials (involving 8244 participants)
Compared with a control, communication before consultations increased question asking during consultations. They may also increase patient participation in consultation and improve patient satisfaction.
Kinnersley et al.
Both coaching and written material interventions produced similar effects on question asking, but coaching produced a larger increase in patient satisfaction.
Overall the benefits of ‘communication before consultations’ interventions were minor.
Interactive Health Communication Applications (IHCAs) (2 reviews)
Murray et al.
24 randomised trials (involving 3739 participants)
IHCAs had a significant positive effect on knowledge, social support and clinical outcomes.
Bailey et al.
15 randomised trials (involving 3917 participants)
Positive effects of IHCAs on knowledge, safer sex self-efficacy and intentions and sexual health behavior were found.
Comment: Data were insufficient for meta-analysis of biological outcomes or analysis of cost- effectiveness and thus, the effects on these outcome categories remain unknown.
Interventions to Enhance Medication Adherence
78 randomised trials
Mixed effects were observed for short term and long- term medication adherence.
Haynes et al.
Some, but not all, of the simple interventions, such as counselling, written information and personal phone calls, were effective with people on short-term medication treatments.
The picture for the effectiveness of interventions for longer-term treatments was mixed; few interventions showed promise and those that were effective were complex and multifaceted in nature.
30 randomised trials (involving 4691 participants)
Contracts were shown to ‘potentially’ improve patient adherence (as applied to diagnostic procedures, therapeutic regimens, and/or a health promotion or illness prevention initiative).
Bosch-Capblanch et al.
Comment: The result above is based on only half of the included studies; the effects were not detected over longer periods.
New Methods of Communication
Marteau et al.
13 randomised trials
Little or no effect was shown with respect to smoking cessation or increasing physical activity. A small effect was shown for changing diet.
(on communicating DNA-based disease risk estimates)
The intervention showed potential for altering intentions to change behaviour (in six non-clinical analogue studies).
Comment: The authors concluded that given the small number of trials in this area, more research involving ‘better-quality RCTs’ is needed before recommending application in practice.
Hollands et al.
9 randomised trials (involving 1371 participants)
Overall, results were mixed:
·a positive effect was found for smoking cessation (three trials);
·a positive effect was found for skin examination behaviour (one trial);
(providing visual feedback on medical imaging results)
·no effect was found for change in physical activity (one trial).
Comment: The authors concluded that due to the small number of trials and the mixed results found, the effectiveness of communicating medical imaging results to change health behaviour is largely unknown and thus, its application in practice is not yet recommended.
Nicolson et al.
25 randomised trials (involving 4788 participants)
Written material significantly improved knowledge of medicines in six of twelve trials. In three of these six trials recall of side effects also improved, but medicines recall significantly improved in only a minority of trials (one of four).
The results for attitudinal and behavioural outcomes were mixed.
Comment: Overall, the authors concluded the combined evidence from this review is not sufficient to say whether written medicines information is effective in changing behaviours related to medicine taking.
Self Management Programmes
Foster et al.
17 randomised trials (involving 7442 participants)
Small (clinically insignificant) short-term improvements in pain, disability, fatigue and depression were found.
(Self management programmes run by lay people)
Positive effects on confidence to manage and self- rated health were also found.
There was no effect on quality of life or use of health services.
Interventions to facilitate communication and/or decision-making
Three interventions to facilitate communication and/or decision making that have been the focus of Cochrane systematic reviews are decision aids, personalised risk communication, and communication before consultations. Decision aids are a type of decision support intervention designed to help people make choices about health treatment options. Stacey (following O’Connor, who prepared the first Cochrane review), defines them as interventions containing ‘detailed, specific, and personalized information to help people focus on options and outcomes for the purpose of decision making’ . They are important for decisions where there is uncertainty about a specific course of action. Personalised risk communication refers to the provision of information to consumers that is personally relevant to them. It is sometimes used to present and discuss the risks and benefits of healthcare in general, and of screening in particular, to consumers. As Edwards and colleagues outline, it can be based on a consumer’s own risk factors for a condition (e.g., their age) or calculated from their risk factors using epidemiological formulas. In the latter, the information is often presented as an absolute risk or as a risk score, or categorised into, for example, high-, medium-, or low-risk groups. Personalised risk communication may also be less detailed, for example, a listing of a consumer’s risk factors to guide discussion and intervention . In their Cochrane review, Kinnersley and colleagues operationalise communication before consultations to include any intervention delivered before consultations, and which has been designed to help consumers (and/or their representatives) address their information needs within consultations .
Interventions to support behaviour change
One area that continues to challenge the Cochrane Consumers and Communication Review Group is the identification of effective interventions that support behaviour change. Four interventions which have been the focus of Cochrane reviews in this area are: interactive health communication applications; interventions to enhance medication adherence; contracts; and new methods of communication. Interactive health communication applications, defined by Murray and colleagues, are computer-based (usually web-based) information packages for patients that combine health information with at least one of: social support, decision support, or behaviour change support . Interventions to enhance medication adherence include a wide range of single and multifaceted interventions; Haynes and colleagues identified: instruction, counseling, automated telephone monitoring and counseling, manual telephone follow-up, family intervention, increasing the convenience of care, simplified dosing, self-monitoring, reminders, special ‘reminder’ pill packaging, dose-dispensing units and medication charts, appointment and prescription refill reminders, reinforcement/rewards, medication formulations, crisis intervention, direct observation of treatments, lay health mentoring, comprehensive pharmaceutical care services, and psychological therapy in their Cochrane review . Contracts refer to formalised (written or verbal) mutual agreements between two or more parties . New methods of communication to date have included communicating DNA-based disease risk estimates to change health behaviours on lifestyle (e.g., smoking, physical activity, diet)  and providing consumers with a visual presentation (i.e., the source images) of their medical imaging (i.e., of magnetic resonance imaging, tomography, radiography, and/or ultrasonography) results to increase consumers’ engagement in health-related behaviours .
Interventions to inform and educate
Two interventions which have been the focus of Cochrane reviews to ‘inform and educate’ consumers are written information and self-management programmes. Written information is one of the most ubiquitous interventions targeting consumers .
Self management programmes have become a major initiative of government and community organizations in the area of chronic illness . They promote various strategies for people to take an active approach to managing their health.
Effectiveness of knowledge translation strategies focusing on policy makers and senior health service managers
In contrast to the substantial evidence base on the effectiveness of knowledge translation strategies targeting healthcare professionals and consumers, few systematic reviews exist of interventions evaluating the effects of knowledge translation strategies for policy makers or senior health service managers. One review, conducted by Perrier and colleagues, evaluated interventions to increase the use of systematic reviews by health policy makers and managers . Two studies were included in the review. The first study utilized a non-experimental design to report an intervention where public health policy makers were offered the opportunity to receive five relevant reviews. At three months and two years, respectively, 23% and 63% of respondents reported using at least one of the systematic reviews to make a policy decision. The second study was a randomised trial where health departments received one of three interventions: access to an online registry of systematic reviews, tailored messages plus access to the online registry of systematic reviews, or tailored messages plus access to the registry along with a knowledge broker who worked one-on-one with decision makers over a period of one year. While none of the interventions showed a significant effect on global evidence-informed decision making, tailored messages plus access to the online registry of systematic reviews showed a positive significant effect on public health policies and programs .
Lavis and colleagues conducted a systematic review of factors that influence the use of research evidence in public policy making . Five criteria were used to assess validity of the included studies: the use of two or more data collection methods; a random or purposive sampling strategy; response rate >60%; two or more types of research use are examined; and two or more competing variables are examined.
A total of 16 studies met the criteria of using two or more data collection methods. These studies were conducted across a variety of jurisdictions, policy domains, content areas, and time periods. There was relatively little consistency in findings. However, two factors emerged with some frequency as being important to policy makers’ use of research evidence: interactions between researchers and policy makers in the context of policy networks such as formal advisory committees and in the context of informal relationships; and research that matched the beliefs, values, interests, or political goals and strategies of elected officials, social interest groups, and others. Both factors increased the prospects for research use by policy makers .
The findings from these reviews and other findings have led to the development of a number of knowledge translation approaches targeting policy makers and senior health services managers [28, 68, 69]. For example, a series of tools called SUPPORT Tools for evidence-informed health policy making (STP) were developed to assist policy makers in using research evidence. These tools were developed by members of the SUPporting POlicy relevant Reviews and Trials (SUPPORT) project, an international collaboration funded by the European Commission’s 6th Framework  (http://www.supportcollaboration.org). The SUPPORT tools describe a series of processes to help ensure that relevant research is identified, appraised and used appropriately by policy makers. The tools address four broad areas of interest related to policymaking: supporting evidence-informed policymaking [71–73]; identifying needs for research evidence in relation to clarifying problems, framing options, and planning implementation [74–76]; finding and assessing evidence from systematic reviews [77–79] and other kinds of evidence [80, 81]; and moving from research evidence to decisions. The focus in this final area is on engaging stakeholders in evidence-informed policymaking [21, 82, 83] and on addressing how to use research evidence in decisions [84–86]. By focusing on how to ‘support’ the use of research evidence in health policymaking, the SUPPORT tools should increase the use of research evidence by policy makers .
The SUPPORT tools describe a variety of packaging and push, facilitating pull, and exchange activities. Packaging and push activities focus on the activities of researchers to disseminate their research findings to a broad audience above and beyond traditional routes of dissemination such as publication in peer reviewed journals . Examples of packaging and push activities include: increased emphasis on knowledge syntheses as the unit for knowledge translation; actionable messages; graded entry formats to allow the research user to access the level of detail that he or she requires (for example, the Canadian Health Services Research Foundation requires research reports to have one page of main messages, a three-page executive summary, and then no more than 25 pages for the complete project); using multiple communication channels tailored to the target audience; targeted electronic push of information relevant to the specific needs of research users—examples include the Contacts, Help, Advice and Information Network (C.H.A.I.N.) (, http://chain.ulcc.ac.uk/chain/ accessed 5 July 2011) and E-watch bulletin on Innovation in Health Services (http://www.ohpe.ca/node/2740 accessed 5 July 2011); workshops and seminars with target audiences; and development of tools to help research users apply research findings in their own settings.
Facilitating pull activities focus on the needs of users, and creating an appetite for research results . Pull activities include various training activities to improve policy makers’ and senior managers’ research literacy and interest. For example, the Canadian Health Services Research Foundation provides the EXTRA program to train senior healthcare executives in research application (http://www.chsrf.ca/Programs/EXTRA.aspx accessed 5 July 2011). ‘One stop’ initiatives such as Health Systems Evidence also facilitate pull.
Exchange activities focus on building and maintaining new relationships between researchers and policy makers and senior managers to exchange knowledge and ideas [69, 89]. For example, several research-funding programs require active participation of decision makers (sometimes including co-funding by healthcare organisations) in research teams. The rationale is that decision makers are more likely to consider research findings if they are actively involved in the research conducted in their settings to answer specific contextualized questions. These approaches legitimately focus on local knowledge translation of individual studies. However, the results of these studies should still be incorporated into systematic reviews to judge whether additional knowledge translation activities should be undertaken outside the context and relationships of the original study. Other exchange approaches include deliberative dialogues and the use of knowledge brokers to act as ‘human intermediaries’ between the world of research and action [69, 82, 90].
This profusion of approaches to improving knowledge translation to policy makers and senior healthcare managers highlights the increased recognition of the failure of traditional diffusion approaches to knowledge translation for this target group (e.g., ). Most of these approaches have a strong theoretical basis and face validity. However, it will be important to evaluate their benefits, harms and costs fully.
With what effect should research knowledge be transferred?
Appropriate endpoints of knowledge translation may vary across different stakeholder groups. For example, knowledge translation targeting policy makers and consumers should ensure that consideration of research evidence is a key component of their decision making, but recognize that there are other legitimate factors (for example, the policy context for policy makers, values and preferences of individual patients) that need to considered [91–93]. Thus, the resulting decision is likely to be evidence-informed but may not be particularly evidence-based. However, knowledge translation targeting professionals should result in practice that is more evidence-based and is likely to be observable as reflected in changes in professional behaviours and quality indicators.
In this paper, we have attempted to briefly summarise some of the key concepts and evidence about the effectiveness of knowledge translation activities targeting different stakeholder groups. We particularly recommend the five key questions developed by Lavis and colleagues as an aide for researchers and others involved in knowledge translation when developing knowledge translation activities . There is a substantial (if incomplete) evidence base to guide choice of knowledge translation activities targeting healthcare professionals and patients. The evidence base on the effects of different knowledge translation approaches targeting healthcare policy makers and senior managers is much weaker but there are a profusion of innovative approaches that warrant further evaluation.
Grol observed that many current knowledge translation activities are based on participants’ beliefs, rather than evidence about the likely effectiveness of different approaches . Grol challenged healthcare systems to develop and use a robust evidence base to support the choice of knowledge translation strategies, arguing, ‘evidence-based medicine should be complemented by evidence-based implementation.’ While we are some way from achieving this goal, there are grounds for optimism. Over the past twenty-five years, healthcare systems have invested heavily in knowledge synthesis activities that facilitate timely access of evidence. Further, it is possible to achieve clinically important practice changes by healthcare professionals and improved patient decision making with current knowledge translation activities.
We are grateful to Egon Jonson for agreeing that we could use the chapter Grimshaw J, Eccles MP (2008). Knowledge Translation of Research Findings. In IHE Report June 2008: Effective Dissemination of Findings from Research. Institute of Health Economics, Alberta, Canada (2008) as the basis for this paper. JMG holds a Canada Research Chair. JES is a Postdoctoral Fellow funded by Canadian Institutes for Health Research. JMG and JNL are members and MPE is a member of the Scientific Advisory Board of KT Canada. Sophie Hill’s role as Coordinating Editor of Cochrane Consumers and Communication Review Group is supported by funding from the Quality, Safety and Patient Experience Branch, Department of Health Victoria, Australia and the National Health and Medical Research Council Funding for Australian-based Cochrane Collaboration Activities.
- McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348: 2635-2645. 10.1056/NEJMsa022615.View ArticlePubMed
- Grol R: Successes and failures in the implementation of evidence-based guidelines for clinical practice. Med Care. 2001, 39: II46-II54.View ArticlePubMed
- Schuster MA, McGlynn EA, Brook RH: How good is the quality of health care in the United States? 1998. Milbank Q. 2005, 83: 843-895. 10.1111/j.1468-0009.2005.00403.x.PubMed CentralView ArticlePubMed
- McKibbon KA, Lokker C, Wilczynski NL, Ciliska D, Dobbins M, Davis DA, Haynes RB, Straus SE: A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel?. Implement Sci. 2010, 5: 16-10.1186/1748-5908-5-16.PubMed CentralView ArticlePubMed
- Tetroe JM, Graham ID, Foy R, Robinson N, Eccles MP, Wensing M, Durieux P, Legare F, Nielson CP, Adily A, Ward JE, Porter C, Shea B, Grimshaw JM: Health research funding agencies' support and promotion of knowledge translation: an international study. Milbank Q. 2008, 86: 125-155. 10.1111/j.1468-0009.2007.00515.x.PubMed CentralView ArticlePubMed
- Donabedian A: Explorations in quality assessment and monitoring: II - the criteria and standards of quality. 1982, Health Administration Press, Ann Arbor, Michigan
- Sung NS, Crowley WF, Genel M, Salber P, Sandy L, Sherwood L, Johnson S, Catanese V, Tilson H, Getz K, Larson E, Scheinberg D, Reece E, Slavkin H, Dobs A, Grebb J, Martinez R, Korn A, Rimoin D: Central challenges facing national clinical research enterprise. JAMA. 2003, 289: 1278-1287. 10.1001/jama.289.10.1278.View ArticlePubMed
- Tarde G: The law of imitiation. 1903, HOLT, New York
- Estabrooks CA, Derksen L, Winther C, Lavis JN, Scott SD, Wallin L, Profetto-McGrath J: The intellectual structure and substance of the knowledge utilization field: A longitudinal author co-citation analysis, 1945 to 2004. Implement Sci. 2008, 3: 49-10.1186/1748-5908-3-49.PubMed CentralView ArticlePubMed
- Grimshaw J, Eccles MP: Knowledge Translation Of Research Findings. Effective Dissemination of Findings from Research. Edited by: Jonson E. 2008, Institute of Health Economics, Edmonton
- Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J: How can research organizations more effectively transfer research knowledge to decision makers?. Milbank Q. 2003, 81: 221-222. 10.1111/1468-0009.t01-1-00052.PubMed CentralView ArticlePubMed
- ALLHAT Collaborative Research Group: Major outcomes in high-risk hypertensive patients randomized to angiotensin-converting enzyme inhibitor or calcium chanel blocker vs diuretic. The Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial (ALLHAT). JAMA. 2002, 288: 2981-2997. 10.1001/jama.288.23.2981.View Article
- International Study of Infarct Survival Collaborative Group: Randomised trial of intravenous streptokinase, oral asprin, both, or neither among 17,187 cases of suspected acute myocardial infarction: ISIS-2 (Second International Study of Infarct Survival) Collaborative Group. Lancet. 1988, 2: 349-360.
- Ioannidis JP: Evolution and translation of research findings: from bench to where?. PLoS Clin Trials. 2006, 1: e36-10.1371/journal.pctr.0010036.PubMed CentralView ArticlePubMed
- Ioannidis JP, Ntzani EE, Trikalinos TA, Contopoulos-Ioannidis DG: Replication validity of genetic association studies. Nat Genet. 2001, 29: 306-309. 10.1038/ng749.View ArticlePubMed
- Ioannidis JP: Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005, 294: 218-228. 10.1001/jama.294.2.218.View ArticlePubMed
- Grimshaw JM, Santesso N, Cumpston M, Mayhew A, McGowan J: Knowledge for knowledge translation: the role of the Cochrane Collaboration. J Contin Educ Health Prof. 2006, 26: 55-62. 10.1002/chp.51.View ArticlePubMed
- Helfand M, Morton SC, Guallar E, Mulrow C: Challenges of Summarizing Better Information for Better Health: The Evidence-based Practice Center Experience. Ann Intern Med. 2005, 142: 1033-1126.View Article
- O'Connor AM, Bennett C, Stacey D, Barry MJ, Col NF, Eden KB, Entwistle V, Fiset V, Holmes-Rovner M, Khangura S, Llewellyn-Thomas H, Rovner D: Do patient decision aids meet effectiveness criteria of the International Patient Decision Aid Standards Collaboration? A systematic review and meta-analysis. Med Decis Making. 2007, 27:
- Grimshaw JM, Thomas RE, Maclennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: iii-72-View Article
- Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S13-10.1186/1478-4505-7-S1-S13.PubMed CentralView ArticlePubMed
- Mowatt G, Thomson MA, Grimshaw J, Grant A: Implementing early warning messages on emerging health technologies. Int J Technol Assess Health Care. 1998, 14: 663-670. 10.1017/S0266462300011971.View ArticlePubMed
- Shonkoff JP: Science, policy, and practice: Three cultures in search of a shared mission. Child Development. 2000, 71: 181-187. 10.1111/1467-8624.00132.View ArticlePubMed
- Hayward RSA, Guyatt G, Moore KA, McKibbon KA, Carter AO: Canadian physicians' attitudes about and preferences regarding clinical practice guidelines. Canadian Medical Association Journal. 1997, 156: 1715-1723.PubMed CentralPubMed
- Ellen ME, Lavis J, Ouimet M, Grimshaw JM, Bedard PO: Determining research knowledge infrastructure for healthcare systems: A qualitative study. Implement Sci. 2011, 6:
- Meso P, Smith R: A resource-based view of organizational knowledge management systems. J Knowledge Management. 2000, 4: 224-234. 10.1108/13673270010350020.View Article
- Weir M, Ryan R, Mayhew A, Worswick J, Santesso N, Lowe D, Leslie B, Stevens A, Hill S, Grimshaw JM: The Rx for Change database: A first-in-class tool for optimal prescribing and medicines use. Implement Sci. 2010, 5:
- Lavis JN, Lomas J, Hamid M, Sewankambo NK: Assessing country-level efforts to link research to action. Bull World Health Organ. 2006, 84: 620-628. 10.2471/BLT.06.030312.PubMed CentralView ArticlePubMed
- Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.View ArticlePubMed
- Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.View ArticlePubMed
- Davies H, Powell A, Rushmer R: Healthcare professionals' views on clinician engagement in quality improvement: A literature review. Health Foundation. 2007
- Grol R, Wensing M, Eccles MP: Improving patient care: implementing change in clinical practice. 2004, Elsevier, Oxford
- Ballini L, Bero L, Eccles MP, Grimshaw J, Gruen RL, Lewin S: Effective Practice and Organisation of Care Group. The Cochrane Library About The Cochrane Collaboration (Cochrane Review Groups (CRGs). 2011
- Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. BMJ. 1998, 317: 465-468. 10.1136/bmj.317.7156.465.PubMed CentralView ArticlePubMed
- Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O'Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39: II2-45.View ArticlePubMed
- Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.PubMed CentralView ArticlePubMed
- Farmer AP, Legare F, Turcot L, Grimshaw J, Harvey E, McGowan JL, Wolf F: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2011, CD004398-
- Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O'Brien MA, Wolf F, Davis D, Odgaard-Jensen J, Oxman AD: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009, CD003030-
- O'Brien MA, Rogers S, Jamtvedt G, Oxman A, Odgaard-Jensen J, Kristoffersen D, Forsetlund L, Bainbridge D, Freemantle N, Davis DA, Haynes R, Harvey E: Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008, CD000409-
- Flodgren G, Parmelli E, Doumit G, Gattellari M, O'Brien MA, Grimshaw J, Eccles MP: Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010, CD000125-
- Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010, CD000259-
- Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J: The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2011, CD001096-
- Baker R, Camosso-Stefanovic J, Gilliss CL, Shaw EJ, Cheater F, Flottorp S, Robertson N: Tailored interventions to overcome identified barriers to change: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010, CD005470-
- Soumerai SB, Avorn J: Principles of educational outreach ('academic detailing') to improve clinical decision making. JAMA. 1990, 263: 549-556. 10.1001/jama.1990.03440040088034.View ArticlePubMed
- Mason J, Freemantle N, Nazareth I, Eccles M, Haines A, Drummond M: When is it cost-effective to change the behavior of health professionals?. JAMA. 2001, 286: 2988-2992. 10.1001/jama.286.23.2988.View ArticlePubMed
- Grimshaw JM, Eccles MP, Greener J, Maclennan G, Ibbotson T, Kahan JP, Sullivan F: Is the involvement of opinion leaders in the implementation of research findings a feasible strategy?. Implement Sci. 2006, 1: 3-10.1186/1748-5908-1-3.PubMed CentralView ArticlePubMed
- Doumit G: Opinion leaders: Effectiveness, Identification, Stability, Specificity, and Mechanism of Action. 2006, PhD Thesis. University Of Ottawa
- Gardner B, Whittington C, McAteer J, Eccles M, Michie S: Using theory to synthesize evidence from behaviour change interventions: The example of audit and feedback. Social Science & Medicine. 2010, 70: 1618-1625. 10.1016/j.socscimed.2010.01.039.View Article
- Adams AS, Soumerai SB, Lomas J, Ross-Degnan D: Evidence of self-report bias in assessing adherence to guidelines. Int J Qual Health Care. 1999, 11: 187-192. 10.1093/intqhc/11.3.187.View ArticlePubMed
- McDonald C: Protocol-based computer reminders, the quality of care and the non-prefectability of man. N Engl J Med. 1976, 295: 1351-1355. 10.1056/NEJM197612092952405.View ArticlePubMed
- Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, Morton SC, Shekelle PG: Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006, 144: 742-752.View ArticlePubMed
- Cochrane Effective Practice and Organisation of Care group: Data collection checklist. EPOC measures for review authors. 2002
- Prictor M, Hill S, Car J, Edwards A, Glenton C: Horey D et al. 2010, Cochrane Consumers and Communications Group, About The Cochrane Collaboration (Cochrane Review Groups (CRGs))
- Ryan R, Santesso N, Hill S, Lowe D, Kaufman C, Grimshaw JM: Consumer-oriented interventions for evidence-based prescribing and medicines use: An overview of systematic reviews. Cochrane Database Syst Rev. 2011
- Stacey D, Bennett CL, Barry MJ, Col NF, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Legare F, Thomson R: Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2011
- Edwards AG, Evans R, Dundon J, Haigh S, Hood K, Elwyn GJ: Personalised risk communication for informed decision making about taking screening tests. Cochrane Database Syst Rev. 2006, CD001865-
- Kinnersley P, Edwards A, Hood K, Cadbury N, Ryan R, Prout H, Owen D, Macbeth F, Butow P, Butler C: Interventions before consultations for helping patients address their information needs. Cochrane Database Syst Rev. 2007, CD004565-
- Murray E, Burns J, See TS, Lai R, Nazareth I: Interactive Health Communication Applications for people with chronic disease. Cochrane Database Syst Rev. 2005, CD004274-
- Bailey JV, Murray E, Rait G, Mercer CH, Morris RW, Peacock R, Cassell J, Nazareth I: Interactive computer-based interventions for sexual health promotion. Cochrane Database Syst Rev. 2010, CD006483-
- Haynes RB, Ackloo E, Sahota N, McDonald HP, Yao X: Interventions for enhancing medication adherence. Cochrane Database Syst Rev. 2008, CD000011-
- Bosch-Capblanch X, Abba K, Prictor M, Garner P: Contracts between patients and healthcare practitioners for improving patients' adherence to treatment, prevention and health promotion activities. Cochrane Database Syst Rev. 2009
- Marteau TM, French DP, Griffin SJ, Prevost AT, Sutton S, Watkinson C, Attwood S, Hollonds GJ: Effects of communicating DNA-based disease risk estimates on risk-reducing behaviours. Cochrane Database Syst Rev. 2010
- Hollands GJ, Hankins M, Marteau TM: Visual feedback of individuals' medical imaging results for changing health behaviour. Cochrane Database Syst Rev. 2010
- Nicolson D, Knapp P, Raynor DK, Spoor P: Written information about individual medicines for consumers. Cochrane Database Syst Rev. 2009
- Foster G, Taylor SJ, Eldridge SE, Ramsay J, Griffiths CJ: Self-management education programmes by lay leaders for people with chronic conditions. Cochrane Database Syst Rev. 2007, CD005108-
- Perrier L, Mrklas K, Lavis J, Straus S: Interventions encouraging the use of systematic reviews by health policymakers and managers: A systematic review. Implement Sci. 2011, 6:
- Lavis J, Hammill AC, Gildiner A, McDonagh RJ, Wilson MG, Ross SE, Ouimet M, Stoddart GL: A systematic review of the factors that influence the use of research evidence by public policymakers: Report submitted to the Canadian Population Health Initiative. 2005, Hamilton, Canada
- Lavis JN: Research, public policymaking, and knowledge-translation processes: Canadian efforts to build bridges. J Contin Educ Health Prof. 2006, 26: 37-45. 10.1002/chp.49.View ArticlePubMed
- Lomas J: The in-between world of knowledge brokering. BMJ. 2007, 334: 129-132. 10.1136/bmj.39038.593380.AE.PubMed CentralView ArticlePubMed
- Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). Health Res Policy Syst. 2009, 7 (Suppl 1): I1-10.1186/1478-4505-7-S1-I1.PubMed CentralView ArticlePubMed
- Oxman AD, Lavis JN, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 1: What is evidence-informed policymaking?. Health Res Policy Syst. 2009, 7 (Suppl 1): S1-10.1186/1478-4505-7-S1-S1.PubMed CentralView ArticlePubMed
- Oxman AD, Vandvik PO, Lavis JN, Fretheim A, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP) 2: Improving how your organisation supports the use of research evidence to inform policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S2-10.1186/1478-4505-7-S1-S2.PubMed CentralView ArticlePubMed
- Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 3: Setting priorities for supporting evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S3-10.1186/1478-4505-7-S1-S3.PubMed CentralView ArticlePubMed
- Lavis JN, Wilson MG, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 4: Using research evidence to clarify a problem. Health Res Policy Syst. 2009, 7 (Suppl 1): S4-10.1186/1478-4505-7-S1-S4.PubMed CentralView ArticlePubMed
- Lavis JN, Wilson MG, Oxman AD, Grimshaw J, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 5: Using research evidence to frame options to address a problem. Health Res Policy Syst. 2009, 7 (Suppl 1): S5-10.1186/1478-4505-7-S1-S5.PubMed CentralView ArticlePubMed
- Fretheim A, Munabi-Babigumira S, Oxman AD, Lavis JN, Lewin S: SUPPORT Tools for Evidence-informed policymaking in health 6: Using research evidence to address how an option will be implemented. Health Res Policy Syst. 2009, 7 (Suppl 1): S6-10.1186/1478-4505-7-S1-S6.PubMed CentralView ArticlePubMed
- Lavis JN, Oxman AD, Grimshaw J, Johansen M, Boyko JA, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 7: Finding systematic reviews. Health Res Policy Syst. 2009, 7 (Suppl 1): S7-10.1186/1478-4505-7-S1-S7.PubMed CentralView ArticlePubMed
- Lewin S, Oxman AD, Lavis JN, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 8: Deciding how much confidence to place in a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S8-10.1186/1478-4505-7-S1-S8.PubMed CentralView ArticlePubMed
- Lavis JN, Oxman AD, Souza NM, Lewin S, Gruen RL, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 9: Assessing the applicability of the findings of a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S9-10.1186/1478-4505-7-S1-S9.PubMed CentralView ArticlePubMed
- Lewin S, Oxman AD, Lavis JN, Fretheim A, Marti SG, Munabi-Babigumira S: SUPPORT Tools for evidence-informed Policymaking in health 11: Finding and using evidence about local conditions. Health Res Policy Syst. 2009, 7 (Suppl 1): S11-10.1186/1478-4505-7-S1-S11.PubMed CentralView ArticlePubMed
- Oxman AD, Fretheim A, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP) 12: Finding and using research evidence about resource use and costs. Health Res Policy Syst. 2009, 7 (Suppl 1): S12-10.1186/1478-4505-7-S1-S12.PubMed CentralView ArticlePubMed
- Lavis JN, Boyko JA, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 14: Organising and using policy dialogues to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S14-10.1186/1478-4505-7-S1-S14.PubMed CentralView ArticlePubMed
- Oxman AD, Lewin S, Lavis JN, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 15: Engaging the public in evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S15-10.1186/1478-4505-7-S1-S15.PubMed CentralView ArticlePubMed
- Oxman AD, Lavis JN, Fretheim A, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP) 16: Using research evidence in balancing the pros and cons of policies. Health Res Policy Syst. 2009, 7 (Suppl 1): S16-10.1186/1478-4505-7-S1-S16.PubMed CentralView ArticlePubMed
- Oxman AD, Lavis JN, Fretheim A, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP) 17: Dealing with insufficient research evidence. Health Res Policy Syst. 2009, 7 (Suppl 1): S17-10.1186/1478-4505-7-S1-S17.PubMed CentralView ArticlePubMed
- Fretheim A, Oxman AD, Lavis JN, Lewin S: SUPPORT Tools for Evidence-informed policymaking in health 18: Planning monitoring and evaluation of policies. Health Res Policy Syst. 2009, 7 (Suppl 1): S18-10.1186/1478-4505-7-S1-S18.PubMed CentralView ArticlePubMed
- Lavis J, Oxman A, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). Health Research Policy and Systems. 2009, 7: I1-10.1186/1478-4505-7-S1-I1.PubMed CentralView ArticlePubMed
- Evans D, McAuley L, Santesso N, McGowan J, Grimshaw JM: Effective Health Care CHAIN (Contacts, Help, Advice and Information Network): Breaking Down Barriers between Professions, Organizations, Researchers and Practitioners in the UK and Canada. Innovations in Health Care: A Reality Check. Edited by: Casebeer AH, Mark AL. 2006, Palgrave Macmillan, Houndmills, 220-231.
- Canadian Health Services Research Foundation: Issues in Linkage and Exchange between Researchers and Decision Makers. 1999
- Lomas J: Improving research dissemination and uptake in the health sector: Beyond the sound of one hand clapping. 1997, ONT, Mcmaster University, Hamilton, 4-8-2011
- Lavis J, Ross S, McLeod C, Glidiner A: Measuring the impact of health research. Journal of Health Services Research and Policy. 2003, 8: 165-170. 10.1258/135581903322029520.View ArticlePubMed
- Lavis JN, Ross SE, Hurley JE, Hohenadel JM, Stoddart GL, Woodward CA, Abelson J: Examining the role of health services research in public policymaking. Milbank Q. 2002, 80: 125-154. 10.1111/1468-0009.00005.PubMed CentralView ArticlePubMed
- Squires J, Estabrooks C, O'Rourke H, Gustavsson P, Newburn-Cook C, Wallin L: A systematic review of the psychometric properties of self-report research utilization measures used in healthcare. Implement Sci. 2011, 6: 83-10.1186/1748-5908-6-83.PubMed CentralView ArticlePubMed
- Grol R: Beliefs and evidence in changing clinical practice. British Medical Journal. 1997, 315: 418-421. 10.1136/bmj.315.7105.418.PubMed CentralView ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.