- Research article
- Open Access
- Open Peer Review
General practitioners' perceptions of the effectiveness of medical interventions: an exploration of underlying constructs
© Vogt et al; licensee BioMed Central Ltd. 2010
- Received: 15 September 2009
- Accepted: 16 February 2010
- Published: 16 February 2010
Many interventions shown to be effective through clinical trials are not readily implemented in clinical practice. Unfortunately, little is known regarding how clinicians construct their perceptions of the effectiveness of medical interventions. This study aims to explore general practitioners' perceptions of the nature of 'effectiveness'.
The design was qualitative in nature using the repertory grid technique to elicit the constructs underlying the perceived effectiveness of a range of medical interventions. Eight medical interventions were used as stimuli (diclophenac to reduce acute pain, cognitive behaviour therapy to treat depression, weight loss surgery to achieve weight loss, diet and exercise to prevent type 2 diabetes, statins to prevent heart disease, stopping smoking to prevent heart disease, nicotine replacement therapy to stop smoking, and stop smoking groups to stop smoking). The setting involved face-to-face interviews followed by questionnaires in London Primary Care Trusts. Participants included a random sample of 13 general practitioners.
Analysis of the ratings showed that the constructs clustered around two dimensions: low patient effort versus high patient effort (dimension one), and small impact versus large impact (dimension two). Dimension one represented constructs such as 'success requires little motivation', 'not a lifestyle intervention', and 'health-care professional led intervention'. Dimension two represented constructs such as 'weak and/or minimal evidence of effectiveness', 'small treatment effect for users', 'a small proportion of users will benefit' and 'not cost-effective'. Constructs within each dimension were closely related.
General practitioners judged the effectiveness of medical interventions by considering two broad dimensions: the extent to which interventions involve patient effort, and the size of their impact. The latter is informed by trial evidence, but the patient effort required to achieve effectiveness seems to be based on clinical judgement. Some of the failure of evidence-based medicine to be implemented may be more explicable if both dimensions were attended to.
- Nicotine Replacement Therapy
- Weight Loss Surgery
- Trial Evidence
- Personal Construct
- Primary Care Trust
Despite the overall success of evidence-based medicine in building a sound research underpinning for understanding the effectiveness of many medical interventions, its major failing has been getting those findings into clinical practice [1, 2]. Interventions to increase implementation of evidence-based guidelines, using a wide-variety of methods including incentives, prompts, and education have had mixed results . Critiques of this large literature highlight that many interventions lack explicit rationales or theoretical bases and insufficient piloting .
A wide variety of perceived barriers towards performing a clinical behaviour have been reported . Among others, the perceived effectiveness of an intervention at achieving desired patient outcomes is considered an important determinant of behaviour [5–7]. A common response to this problem has been to increase clinicians' knowledge of an intervention's effectiveness (as derived from trial evidence) on the grounds that a rational clinician would want to provide the best treatment for his or her patients [5, 6]. While the importance of the perceived effectiveness of medical interventions is well documented, little is known about the basis for these perceptions. Indeed, it is often assumed that perceived effectiveness simply reflects the clinician's understanding of the research evidence, in which case the problem lies in a failure to communicate the evidence in a way that makes sense. This may suggest efforts should be increased to communicate information about the effectiveness of an intervention in a more comprehensible manner to bridge such a communication gap. For example, information about an interventions' benefit is perceived differently depending on whether it is represented in relative or absolute terms .
An alternative explanation is that clinicians and researchers may not share the same meanings of the notion of effectiveness with clinicians considering factors that are not part of the formal evidence base of effectiveness. Research aimed at identifying the reasons behind suboptimal implementation may therefore consider in more detail how clinicians derive their perceptions of the effectiveness of medical interventions. In short, the communication gap identified in implementation studies may reflect different underlying constructs of effectiveness; that is, the problem is a conceptual gap rather than one of communication and understanding.
A variety of methods for ascertaining perceptions or constructs exist, including repertory grid and focus group techniques, in-depth interviews, and survey questionnaires. The repertory grid technique allows individuals to determine their own personal range of descriptions relevant to the issue without imposing experimenter-determined constructs on the data set [8–10]. Exploring how a group of clinicians conceptualise the idea of effectiveness as applied to medical interventions using this technique is one way of understanding whether a communication or a conceptual gap underpins the implementation problem.
An exploratory study was carried out using repertory grid, data reduction, and clustering techniques to elicit and categorise general practitioners' perceptions of the effectiveness of a range of medical interventions.
The sample comprised general practitioners (GPs) working in southeast London. Invitation letters were sent to 200 randomly selected GPs that were registered in three local Primary Care Trusts (the list was obtained from the Primary Care Trusts) explaining the nature of the study and asking for willingness to be interviewed and complete a questionnaire. The inclusion criterion was being a registered GP; there were no exclusion criteria. Fifteen GPs replied to the invitation letters, and interviews were held with 13 (nine were male and four female). Two GPs were not interviewed because a suitable interview date and time could not be arranged. Following the interview, all 13 were sent a questionnaire via email or post, according to his or her preference, which 12 completed (eight were male and four female). One GP did not complete the questionnaire because of time constraints. Participants were reimbursed for their time with a €40 ($80, €50) book token. Data was collected from GPs between September 2007 and February 2008.
Eight interventions used as stimuli
Statins to prevent heart disease .
Diclophenac to reduce acute pain .
Cognitive behaviour therapy (CBT) to treat depression .
Stop smoking groups to stop smoking .
Weight loss surgery to achieve weight loss .
Stopping smoking to prevent heart disease .
Diet and exercise to prevent type 2 diabetes .
Nicotine replacement therapy (NRT) to stop smoking .
Interviews were conducted at the participants' place of work and audio-taped. These lasted between 20 and 40 minutes. Each participant was shown the intervention cards in triads, selected at random from the eight intervention cards. Participants were asked to identify two interventions in each triad that were similar with regards to their effectiveness and to describe what made them similar (similarity pole). After this, they were asked to describe what made the third intervention different (difference pole). For example, when presented with cards showing statins, stop smoking groups, and nicotine replacement therapy (NRT), a respondent might group the two stop smoking cards together because both involved a behaviour, thus 'strong cooperation from patient needed' (the similarity pole), and the third as not requiring a behaviour, thus 'strong cooperation not needed' (the difference pole). These two descriptions represented one bipolar personal construct of the effectiveness of medical interventions; in this example, whether cooperation was needed. When participants could elicit no further personal constructs in a triad, another triad was presented to them, again selected at random from the eight intervention cards. This process was continued until participants could elicit no further constructs.
The personal constructs elicited from all the participants were then reduced in number by using an inductive content analysis . Six researchers were asked to group independently the personal constructs elicited from the GPs into more general constructs depending on their similarity; the number of general constructs the researchers could create was not restricted. A hierarchical cluster analysis combined the groupings from the six researchers using Ward's method and Euclidean distance within SPSS 15.0. The dendrogram and the agglomeration schedule, two key measures for assessing cluster analysis , were used to identify clusters of similar constructs. The six researchers then discussed and agreed labels for each of the clusters of constructs to reflect the underlying theme.
Interviewed GPs were then sent a questionnaire. The questionnaire asked the GP to rate the study's eight interventions on the clusters of constructs derived from the cluster analysis using seven-point scales (Additional file 1).
Ratings were analysed and mapped by generalised procrustes analysis (GPA). This technique is a form of principal components analysis, which assesses the variability in the data by identifying patterns that explain the most variance, thereby highlighting patterns or dimensions among participants' responses. GPA, unlike principal components analysis, maps individual level data, and permits the production of maps showing areas of consensus between individuals, and links between variables. For clarity of interpretation only the consensus maps are shown in the results section.
Eleven clusters of constructs identified in the cluster analysis
'This intervention has robust evidence of effectiveness.' versus 'This intervention has weak and/or minimal evidence of effectiveness.'
'This intervention has a large treatment effect for users.' versus 'This intervention has a small treatment effect for users.'
'A large proportion of users will benefit from this intervention.' versus 'A small proportion of users will benefit from this intervention.'
'Success requires a lot of motivation from the patient.' versus 'Success requires little motivation from the patient.'
'This is a biomedical intervention (treatment using drugs, radiation, or surgery).' versus 'This is not a biomedical intervention.'
'This intervention is appealing to patients.' versus 'This intervention is not appealing to patients.'
'The impact of this intervention can be precisely measured.' versus 'The impact of this intervention is difficult to measure.'
'This is a lifestyle intervention (e.g., Diet and exercise education).' versus 'This is not a lifestyle intervention.'
'This intervention is cost-effective.' versus 'This intervention is not cost-effective.'
'This is a patient led intervention.' versus 'This is a healthcare professional-led intervention.'
'This intervention brings long-term benefits.' versus 'This intervention only helps in the short-term.'
GPA revealed that the clusters were resolved in three dimensions with eigenvalues greater than one. GPA can give results that suggest a consensus between participants when there is none requiring a comparative test with random data that reflects the distributional structure of the data. The clusters were significantly different from chance as determined by the permutation test (p < 0.05), indicating that a true consensus space was achieved for each of these. Dimensions one (76%) and two (10%) accounted for the majority of the variance in the model, together explaining 86% of the variance. Dimension three was difficult to interpret because no construct loaded exclusively on this dimension. The final analyses therefore focused on the solution in two dimensions.
This paper explored a sample of GPs' views of the notion of effectiveness, and found this was underpinned by two dimensions, the 'size of impact' and 'patient effort needed'. The two dimensions appeared independent of each other. Semantically, the dimension 'size of impact' appears closely related to the estimates of effect size reported by trials, and is captured by constructs such as 'small treatment effect for users', 'a small proportion of users will benefit', or 'weak/minimal evidence of effectiveness'. The limited differentiation between these three constructs, as identified by the small separation on the maps, may be seen as reflecting a communication gap and the continued need for further education in medical statistics . GPs in this study, however, also used another, independent dimension in judging an intervention's effectiveness, 'patient effort needed'. 'Patient effort needed' relates to the motivation and ability of the individual patient to achieve the desired outcome. The study thus provides evidence consistent with the hypothesis that a conceptual gap is a potential contributor to suboptimal implementation of evidence-based medicine.
Evidence based medicine involves integrating individual clinical expertise withthe best available external clinical evidence from systematicresearch; the gold standard for this evidence is the randomised clinical trial when it comes to answering whether an intervention is effective or not . Trials, however, suffer from two major limitations in terms of their ready translation into clinical practice. The first is the role of patient behaviour and its generalisability beyond the trials. Early trials simply assessed the relative effectiveness of a particular intervention for those who received it. But although an intervention might be effective in vitro, so to speak, it may not be effective in the real world of clinical practice. This led to an emphasis on intention-to-treat designs that tried to capture the overall value of an intervention, recognising that some patients will not adhere to the intervention . The influence of patient behaviour, however, in the form of involvement and motivation also precedes trials as the evaluation of effectiveness is only based on those patients who are recruited. Many patients are excluded (using formal criteria such as co-morbidities), and many more may decline to take part for a number of reasons, including the extra effort required, preferences for one arm of the trial, and refusal to be randomised . The second major limitation of trials is the translation problem in moving between trial evidence, which is based on probabilities derived from populations, and the judgement about what is best for the individual patient .
Despite attempts to capture the influence of patient behaviour in trial design (such as in preference trials) and subgroup analyses (such as of adherence patterns), the randomisation underlying trials loses an important aspect of patient behaviour, and effectiveness is reported on average; yet there is considerable variability between patients' outcomes depending on their motivation and ability to adhere [17, 18]. Findings of this study suggest that clinicians' appear to consider this. The degree of dependency on patient effort was also perceived as greater or smaller depending on the particular intervention. In other words, the confidence intervals around outcomes are perceived as wider for interventions that are more dependent on behaviour. A perception for which there may be supportive evidence: the impact of adherence on outcome is greater for non-medication regimes .
GPs may also perceive that the effectiveness of interventions obtained from clinical trials (comprising highly motivated participants) is attenuated in clinical practice (featuring moderately motivated patients), especially so, for interventions dependent on higher patient effort. The current results show, however, no clear evidence that interventions requiring high patient effort were systematically perceived as offering a smaller impact, even though stopping smoking was the only intervention perceived to involve high patient effort together with a large impact. An association between the two dimensions may have been confounded in the current study by using interventions with different levels of effectiveness. Future studies could present GPs with interventions of equal effectiveness and assess whether those perceived as requiring low patient effort are also characterised by a large impact.
The evidence on smoking cessation clinics, which have been shown to be 'effective', can illustrate the tension of patient effort needed and trial evidence. While trials have shown these clinics to be 'effective', trial patients are, in effect, screened for their motivation to quit and their willingness to make the extra effort required if they are to be recruited . Six-month quit rates of control groups from trial of stop smoking groups who receive no intervention are often higher than would be expected from untreated quitters outside of the trials illustrating the likelihood of increased commitment and motivation . Of those who do attend, commitment and motivation are clearly important for success, but the trial also reports the average effectiveness. Faced with this evidence, the clinician may consider whether his or her patient will attend a smoking clinic if referred, and whether they would regularly attend the support meetings. Deciding whether the patient is able and motivated to attend and adhere is therefore an important aspect of translating trial evidence into practice. Indeed, guidelines suggest that GPs only prescribe NRT to those they judge as motivated to make a quit attempt . Even so, GPs may misjudge a patient's motivation when considering interventions such as the stop smoking groups.
In summary, randomised controlled trials tend to lose aspects of patient behaviour through the randomisation process. This means that adherence and other psychological influences on outcome are lost from the effectiveness equation, even though it has been shown in other studies to have a powerful therapeutic effect [22, 23]. An intention-to-treat analysis can capture some of the patient effect, but trial inclusion still ignores the recruitment effect of trial participants. While evidence-based medicine is regarded as the integration of individual clinical expertise with external clinical evidence, this study suggests that GPs may consider that the external clinical evidence is not the same for all interventions, namely some evidence needs to be scrutinised with regards to patient effort more than others (i.e., some have a greater variability of outcome because of the patient effort required, and their replication may be less certain because the optimal trial conditions have a bigger impact on the overall outcome). In effect, clinicians in this study appear to be reassessing the formal effect size reported by trials in the light of perceived patient attributes. The implementation gap may be partly understandable when these limitations of trials are coupled with the tension of treating individual patients with interventions whose effectiveness is based on probabilities derived from the treatment of a population. However, whether clinicians' estimates of patients' effort required for the different interventions are accurate is not clear, and merits further study. The key role of assessments of 'patient effort needed' might also inform future research on the dissemination of trial evidence into everyday practice.
There are now a number of different models of how clinicians make decisions in everyday practice . In each model, there are a series of 'inputs' in terms of existing knowledge and the new problem the patient presents that inform the decision-making process. Over the last two decades or so, evidence-based medicine has attempted to provide a key input into the process, usually through clinical guidelines, and there have been studies of the characteristics of guidelines that lead to greater impact . A common assumption in this literature is that the idea of 'effectiveness' primarily derives from research evidence, and while it may be resisted for all sorts of local factors, the idea of what is effective remains largely unchallenged. What this paper has attempted to explore is whether the concept of 'effectiveness' has a common meaning. The results suggest that for these frontline clinicians the effectiveness embodied in research evidence needs to be filtered through an appreciation of patient characteristics that may increase or decrease the formal effect size of the intervention. An earlier qualitative study identified the importance of the patients' psychological and social needs in determining clinical decisions , and this new study using both qualitative and quantitative methods extends these findings and begins to pinpoint the key factor in the willingness and ability of patients to avail themselves of the intervention on offer.
To our knowledge this is the first study to examine what underlies GPs' perceived effectiveness of medical interventions. It is also novel in its use of qualitative participant-directed techniques supported by quantitative techniques to provide clear interpretations. Participants mentioned a wide range of constructs that they perceived as relevant without the researcher influencing either the choice of constructs or the choice of words to describe them. The repertory grid technique proved a useful framework for studying the perceived effectiveness of medical interventions, generating findings with face-validity. The study had several limitations. An alternative label could have been chosen for dimension one, to reflect more strongly the distinguishing feature of biomedical intervention versus non-biomedical interventions. The current label was chosen, first, because the constructs achieved near identical scores, and second, because it is the more inconclusive of the two, given that some interventions may be neither biomedical nor lifestyle interventions. The small sample size of qualitative studies limits their generalisability. Nevertheless, this study can be seen as an exploratory and innovative step in the understanding of how GPs construct the effectiveness of medical interventions, which may help to explain and address the gap in the implementation of research-based measures of effectiveness.
This paper suggests that GPs hold a view of effectiveness that not only incorporates the dimension of clinical impact or effect size, which is provided by trial evidence, but also a 'patient effort needed' dimension, assessed on an individual patient basis. Some of the failure of evidence-based medicine to be implemented may be more explicable if both knowledge of effect size and estimates of patient effort needed were both seen to be part of the problem.
The study was approved by the Lewisham Local Research Ethics Committee (07/H0810/36). This study was funded by a Cancer Research UK Fellowship (C9009/A7655) awarded to Dr Florian Vogt. We would like to thank Dr Mark Ashworth for helping to coordinate the study, the GPs that volunteered for this study and the six researchers who helped with the coding.
- Roche AM, Freeman T: Brief interventions: good in theory but weak in practice. Drug and Alcohol Review. 2004, 21: 11-18. 10.1080/09595230410001645510.View ArticleGoogle Scholar
- Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N: Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. Journal of Clinical Epidemiology. 2005, 58: 107-112. 10.1016/j.jclinepi.2004.09.002.View ArticlePubMedGoogle Scholar
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technology Assessment. 2004Google Scholar
- Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PAC, Rubin HR: Why don't physicians follow clinical practice guidelines? A framework for improvement. Journal of the American Medical Association. 1999, 282: 1458-1465. 10.1001/jama.282.15.1458.View ArticlePubMedGoogle Scholar
- Cornuz J, Zellweger J-P, Mounoud C, Decrey H, Pecoud A, Burnand B: Smoking Cessation Counseling by Residents in an Outpatient Clinic. Preventive Medicine. 1997, 26: 292-296. 10.1006/pmed.1997.0139.View ArticlePubMedGoogle Scholar
- Vogt F, Hall S, Hankins M, Marteau TM: Evaluating three theory-based interventions to increase physicians' recommendations of smoking cessation services. Health Psychology. 2009, 28: 174-182. 10.1037/a0013783.View ArticlePubMedGoogle Scholar
- Covey J: A Meta-analysis of the Effects of Presenting Treatment Benefits in Different Formats. Med Decis Making. 2007, 27: 638-654. 10.1177/0272989X07306783.View ArticlePubMedGoogle Scholar
- Kelly GA: The psychology of personal constructs: a theory of personality. 1955, New York: NortonGoogle Scholar
- Fransella F, Bannister D: A manual for repertory grid technique. 1977, London: Academic PressGoogle Scholar
- Frewer LJ, Salter B, Lambert N: Understanding patients preferences for treatment: the need for innovative methodologies. Quality in Health Care. 2001, 10: i50-i54. 10.1136/qhc.0100050...View ArticlePubMedPubMed CentralGoogle Scholar
- Jankowicz D: The easy guide to repertory grids. 2004, Chichester: WileyGoogle Scholar
- Clatworthy J, Buick D, Hankins M, Weinman J, Horne R: The use and reporting of cluster analysis in health psychology: A review. British Journal of Health Psychology. 2005, 10: 329-358. 10.1348/135910705X25697.View ArticlePubMedGoogle Scholar
- Ghosh AK, Ghosh K: Translating evidence-based information into effective risk communication: Current challenges and opportunities. Journal of Laboratory and Clinical Medicine. 2005, 145: 171-180. 10.1016/j.lab.2005.02.006.View ArticlePubMedGoogle Scholar
- Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 312: 71-72.View ArticlePubMedPubMed CentralGoogle Scholar
- Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, Colthart IR, Ross S, Shepherd SM, Russell D: Factors that limit the quality, number and progress of randomised controlled trials. Health Technol Assess. 1999, 3: 1-143.PubMedGoogle Scholar
- Grossi E: The single individual in medicine: how to escape from the probability theory trap. Cases J. 2008, 1: 58-10.1186/1757-1626-1-58.View ArticlePubMedPubMed CentralGoogle Scholar
- Conner M, Norman P: Predicting Health Behaviour: a social cognition approach. Predicting Health behaviour. Edited by: Conner M, Norman P. 2005, Maidenhead: Open University Press, 1-27. 2Google Scholar
- Horne R, Weinman J: Self-regulation and Self-management in Asthma: Exploring The Role of Illness Perceptions and Treatment Beliefs in Explaining Non-adherence to Preventer Medication. Psychology & Health. 2002, 17: 17-32. 10.1080/08870440290001502.View ArticleGoogle Scholar
- DiMatteo MR, Giordani PJ, Lepper HS, Croghan TW: Patient adherence and medical treatment outcomes: a meta-analysis. Med Care. 2002, 40: 794-811. 10.1097/00005650-200209000-00009.View ArticlePubMedGoogle Scholar
- Stead LF, Lancaster T: Group behaviour therapy programmes for smoking cessation. The Cochrane Database of Systematic Reviews. 2005, 2Google Scholar
- NICE: Guidance on the use of Nicotine replacement therapy (NRT) and bupropion for smoking cessation. Technology Appraisal. 2002, London: National Institute for Clinical Excellence, 39:Google Scholar
- World Health Organization: Adherence to Long-term Therapies. 2003, World Health OrganizationGoogle Scholar
- van Dulmen S, Sluijs E, van Dijk L, de Ridder D, Heerdink R, Bensing J: Patient adherence to medical treatment: a review of reviews. BMC Health Services Research. 2007, 7: 55-10.1186/1472-6963-7-55.View ArticlePubMedPubMed CentralGoogle Scholar
- Elstein AS, Schwarz A: Evidence base of clinical diagnosis: Clinical problem solving and diagnostic decision making: selective review of the cognitive literature. BMJ. 2002, 324: 729-732. 10.1136/bmj.324.7339.729.View ArticlePubMedPubMed CentralGoogle Scholar
- Grol R, Dalhuijsen J, Thomas S, Veld Cit, Rutten G, Mokkink H: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. British Medical Journal. 1998, 317: 858-861.View ArticlePubMedPubMed CentralGoogle Scholar
- Armstrong D: Clinical autonomy, individual and collective: the problem of changing doctors' behaviour. Social Science & Medicine. 2002, 55: 1771-1777. 10.1016/S0277-9536(01)00309-4.View ArticleGoogle Scholar
- Sacks FM, Pfeffer MA, Moye LA, Rouleau JL, Rutherford JD, Cole TG, Brown L, Warnica JW, Arnold JMO, Wun C-C, Davis BR, Braunwald E: The Effect of Pravastatin on Coronary Events after Myocardial Infarction in Patients with Average Cholesterol Levels. N Engl J Med. 1996, 335: 1001-1009. 10.1056/NEJM199610033351401.View ArticlePubMedGoogle Scholar
- Collins S, Moore RA, McQuay HJ, Wiffen PJ, Rees J: Single dose oral ibuprofen and diclofenac for postoperative pain. Cochrane Database of Systematic Reviews 1999. 2007, Chichester: The Cochrane Collaboration, 1Google Scholar
- DeRubeis RJ, Hollon SD, Amsterdam JD, Shelton RC, Young PR, Salomon RM, O'Reardon JP, Lovett ML, Gladis MM, Brown LL, Gallop R: Cognitive Therapy vs Medications in the Treatment of Moderate to Severe Depression. Arch Gen Psychiatry. 2005, 62: 409-416. 10.1001/archpsyc.62.4.409.View ArticlePubMedGoogle Scholar
- Orzano AJ, Scott JG: Diagnosis and Treatment of Obesity in Adults: An Applied Evidence-Based Review. J Am Board Fam Pract. 2004, 17: 359-369. 10.3122/jabfm.17.5.359.View ArticlePubMedGoogle Scholar
- Critchley JA, Capewell S: Mortality Risk Reduction Associated With Smoking Cessation in Patients With Coronary Heart Disease: A Systematic Review. Journal of the American Medical Association. 2003, 290: 86-97. 10.1001/jama.290.1.86.View ArticlePubMedGoogle Scholar
- Yamaoka K, Tango T: Efficacy of Lifestyle Education to Prevent Type 2 Diabetes: A meta-analysis of randomized controlled trials. Diabetes Care. 2005, 28: 2780-2786. 10.2337/diacare.28.11.2780.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.