- Research article
- Open Access
- Open Peer Review
Why don't physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners
Implementation Sciencevolume 4, Article number: 54 (2009)
Despite wide distribution and promotion of clinical practice guidelines, adherence among Dutch general practitioners (GPs) is not optimal. To improve adherence to guidelines, an analysis of barriers to implementation is advocated. Because different recommendations within a guideline can have different barriers, in this study we focus on key recommendations rather than guidelines as a whole, and explore the barriers to implementation perceived by Dutch GPs.
A qualitative study using six focus groups was conducted, in which 30 GPs participated, with an average of seven per session. Fifty-six key recommendations were derived from twelve national guidelines. In each focus group, barriers to the implementation of the key recommendations of two clinical practice guidelines were discussed. Focus group discussions were audiotaped and transcribed verbatim. Data was analysed by using an existing framework of barriers.
The barriers varied largely within guidelines, with each key recommendation having a unique pattern of barriers. The most perceived barriers were lack of agreement with the recommendations due to lack of applicability or lack of evidence (68% of key recommendations), environmental factors such as organisational constraints (52%), lack of knowledge regarding the guideline recommendations (46%), and guideline factors such as unclear or ambiguous guideline recommendations (43%).
Our study findings suggest a broad range of barriers. As the barriers largely differ within guidelines, tailored and barrier-driven implementation strategies focusing on key recommendations are needed to improve adherence in practice. In addition, guidelines should be more transparent concerning the underlying evidence and applicability, and further efforts are needed to address complex issues such as comorbidity in guidelines. Finally, it might be useful to include focus groups in continuing medical education as an innovative medium for guideline education and implementation.
Clinical practice guidelines are commonly regarded as useful tools for quality improvement . However, their impact on clinical practice is not optimal. Several reviews have shown that guidelines have only been moderately effective in changing the process of care, and that there is much room for improvement [2–6]. For instance, general practitioners (GPs) in the Netherlands do not prescribe drugs according to the national guidelines in about one-third of cases, and this figure has stayed fairly constant during the last few years [7, 8]. In addition, levels of adherence vary largely between practices and between diagnoses [7–9].
To improve adherence to guidelines in practice, an analysis of barriers to implementation of guidelines among target users is advocated [10, 11]. A large number of potential barriers have been identified operating at different levels, such as the level of the practitioner, the level of the patient, the organisational context, and the social and cultural context [10–14]. A recently conducted review and synthesis of qualitative studies  identified six themes of barriers to the implementation of guidelines among GPs: the content of the guidelines, the format of the guidelines, GPs individual experience, preserving the doctor-patient relationship, professional responsibility, and practical issues.
Few studies have focussed on a set of guidelines considering the variety of barriers that should be addressed to improve guideline adherence . In addition, guideline studies often focus on barriers regarding the guideline as a whole, rather than on barriers operating at the level of the individual recommendations within the guidelines [16–19]. As different recommendations within the same guideline can have different barriers, it might be more useful to focus on barriers of individual recommendations to optimize the strategies needed for implementation of guidelines in practice.
The aim of this study was to identify the perceived barriers towards the use of national guidelines for general practice by focusing on the key recommendations within the guidelines. By analysing multiple key recommendations from a set of guidelines, we aim to identify which barriers occur most frequently across the selection. These findings may be useful for guideline developers as well as for professional organisations in designing tailored implementation strategies.
The Dutch College of General Practitioners (NHG) has developed a set of more than 80 national guidelines that cover the majority of conditions and diseases seen in general practice . The guidelines have been developed according to the principles of evidence-based medicine, formulating recommendations based on the best available evidence . Along with the development of guidelines, NHG also puts considerable effort into promoting the use of these guidelines among the target group. They select key recommendations within each guideline, provide a two-page summary, and supply tools for application, such as electronic decision tools, patient information leaflets, and educational materials. In addition, continuing medical education (CME) for GPs in the Netherlands is only accredited if it is based on this set of nationally endorsed guidelines.
Six two-hour focus group sessions were conducted in which twelve NHG guidelines were discussed. Focus groups have proven to be a useful method of providing in-depth information and exploring cognitions and motivations underlying behaviour [22–25]. This is particularly useful when behaviour change is needed. The focus groups enabled us to identify the most relevant barriers perceived by GPs in applying guidelines in practice.
Selection of clinical guidelines
An expert panel of GPs (n = 16) was asked to help selecting the guidelines for our study. The panel was recruited by the organisation responsible for CME for GPs in the Southwestern part of the Netherlands (Stichting KOEL) . We provided an overview of the NHG guidelines published since 2003 and asked the panel members for each guideline about the relevance of studying the effects of the guideline on quality of care and the potential improvement of quality of care as a result of implementing the guideline. In addition, they were asked to select five guidelines that should have high priority as part of a guideline implementation study.
The panel suggested nineteen guidelines having high priority. From these nineteen, we selected twelve guidelines according to the equal distribution among prevalence and type of diseases, and the measurability of quality improvement on patient outcomes (Table 1). Fifty-six key recommendations were abstracted from the twelve guidelines (Additional File 1, in Dutch).
Selection of participants
GPs were recruited by Stichting KOEL through advertisement in their electronic newsletter and website. They could register for more than one focus group session and were offered CME accreditation (two hours per session). All 34 GPs that had registered for one or more focus group sessions were invited and 30 of them (88%) participated in the sessions (range, 5 to 13). Nine of them participated in two sessions and one in all six sessions. One-half of the participants were male, and most of them were between 45 and 54 years of age (37%), practiced in a group setting (45%), and worked in a rural area or small town (39%). Compared to the total population of Dutch GPs , participants working in group practices and in towns or small cities were slightly overrepresented.
Focus groups sessions
The participants received a copy of the key recommendations of the guidelines one week in advance. In each focus group session, the GPs had a semi-structured discussion about the perceived barriers to the implementation of the key recommendations of two guidelines. The sessions were chaired by a GP with at least 15 years of experience in general practice and guideline development (JB), and co-chaired by a health services researcher (ML). A topic guide with open-ended questions was used to structure the discussion. The six sessions were held at Stichting KOEL from March to June 2008 and were audiotaped.
Data analysis and synthesis
The focus groups were transcribed verbatim. Two researchers (ML and JZ) independently studied the transcripts and classified the comments according to the framework of Cabana et al. . In this framework, three main categories of barriers to following guidelines are distinguished: barriers related to knowledge, barriers related to attitude, and external barriers that are subdivided into several subcategories. For those comments that did not fit into the categories of the framework, additional types of barriers were formulated (Table 2).
Additionally, we further divided organisational constraints into organisational constraints within the own organisation or practice (such as opening hours or insufficient number of personnel/staff), organisational constraints outside the organisation (such as policies in hospitals or out of hours services), and organisational constraints between organisations (such as communication and collaboration with other healthcare providers). Results of the two researchers were compared and discrepancies were discussed until consensus was reached. When necessary, a third researcher (JB or GW) was consulted.
In the synthesis of the data, the key recommendation is the unit of analysis. For each barrier in our model, we calculated the number and percentage of key recommendations to which the barrier applied.
Barriers related to attitude were perceived for 91% of the key recommendations; behaviour-related barriers and knowledge-related barriers were perceived for 82% and 46% of the key recommendations respectively (Table 2).
Within these three main categories, the most perceived barriers were lack of agreement with guideline recommendations (applicable to 68% of the key recommendations), followed by environmental factors (52%), lack of knowledge of the guideline recommendations (46%), and guideline recommendation factors (43%).
Table 3 presents the perceived types of barriers per guideline. In the following sections, the perceived barriers are discussed according to the main categories of barriers: knowledge, attitude and behaviour.
Barriers related to knowledge
Lack of awareness/familiarity
GPs were generally aware of the guidelines, but did not know the specific content of 46% of the key recommendations (Table 2). GPs were mostly familiar with part of the key recommendation, but did not know, for instance, the recommended dosage of the drug (Appendix 1). Lack of awareness or familiarity was most relevant for the guidelines regarding transient ischemic attack and sexually transmitted diseases (Table 3).
Barriers related to attitude
Lack of agreement with guideline recommendation
The most reported attitudinal barrier was a lack of agreement with the guideline recommendation (68%). This barrier was mostly related to a lack of applicability (57%) (Table 2). GPs felt that benefits often did not outweigh the harms, or that a recommendation was not applicable to a specific group of patients, such as patients with comorbidity (Appendix 2). Another reason why GPs did not agree with the recommendation was that they argued the evidence (or lack of evidence) underlying a recommendation (23%) (Appendix 2). Lack of agreement with guideline recommendations was a problem for all key recommendations in the guidelines for rhinosinusitis, thyroid disorders, transient ischemic attack, and urinary tract infection (Table 3).
Lack of self-efficacy
The lack of belief that one is capable of adequately performing the recommendation in practice was a barrier in 20% of the key recommendations. Reasons mentioned were a lack of skills, experience or training, or having more confidence in the expertise of other healthcare providers (Appendix 2). This type of barrier was most often mentioned for the key recommendations in the guidelines for thyroid disorders, and sexually transmitted diseases (Table 3).
Lack of outcome expectancy
In 30% of the key recommendations, GPs agreed with the content, but did not believe that applying the recommendation would result in better patient outcomes (Appendix 2). This was particularly a problem for the guidelines regarding rhinosinusitis, asthma among children, and sleeping disorder (Table 3).
Inertia of previous practice/lack of motivation
In 27% of the key recommendations, GPs were not sufficiently motivated to change, or felt that is was hard to overcome the inertia of previous practice due to habits and routines (Appendix 2). These barriers were most frequently mentioned for the guidelines regarding eye inflammation and cardiovascular risk management (Table 3).
Barriers related to behaviour
Patient factors were mentioned as a barrier with respect to 40% of the key recommendations. In 25% of cases, GPs felt that patients' preferences did not match with the guideline recommendation (Table 2). Patient ability or behaviour was perceived as a barrier for 20% of the key recommendations, e.g., patients were not able to perform a required action accurately, or did not show up for follow-up (Appendix 3). Patient factors were most often reported as a barrier for the guidelines regarding rhinosinusitis, eye inflammation, and thyroid disorder (Table 3).
Guideline recommendation factors
In 43% of the key recommendations, factors related to the guideline were perceived as a barrier to implementation (Table 2). Recommendations were found to be unclear or confusing (32%), not covering all relevant information, or not being up to date (14%), or too complex or not easy to use in practice (5%) (Appendix 4). These types of barriers were most prominent for the guidelines regarding sexually transmitted diseases, cerebrovascular accident, and asthma among children (Table 3).
Environmental factors were the most prominent barrier related to behaviour (52%) (Table 2). Particularly, organisational constraints were often reported as a barrier (36%). These constraints mostly referred to organisational constraints outside the organisation, such as logistic problems in out-of-hours services. Perceived constraints within the practice included communication and lack of education or skills among practice assistants. Constraints between organisations were unclear division of tasks and lack of collaboration with specialists in hospitals (Appendix 5). Other environmental barriers were lack of time (13%) and lack of resources (13%) (Appendix 5). Environmental barriers were relatively often perceived for the guidelines concerning eye inflammation, thyroid disorders, atrial fibrillation, and urinary tract infection (Table 3).
Our study revealed a broad spectrum of barriers that Dutch GPs perceive in applying the key recommendations of a set of nationally developed guidelines. Although the focus of the barriers differed across guidelines, each key recommendation had a unique combination of barriers. As a consequence, multiple interventions tailored to the specific barriers of the key recommendations are needed to improve the implementation of guidelines in practice.
The most prominent barrier was lack of agreement with guideline recommendations. GPs often disagreed with recommendations because they argued the underlying evidence provided or felt that it was not clear why they should apply them. In addition, they perceived some recommendations not being applicable due to heterogeneity of patient populations. Other studies also demonstrated that lack of applicability is an important barrier to guideline adherence, particularly to patients with comorbidity [18, 28, 29]. Evidence-based guidelines focus on patients with single diseases and often exclude complex patients, which limits the applicability in practice [30–33]. Further research and efforts are needed on methods to address comorbidity in guidelines in order to improve the applicability of guideline recommendations [31, 32, 34].
Environmental barriers, particularly organisational constraints, were the second most often perceived group of barriers to implementation. These constraints mostly referred to logistic problems within the own practice or within out-of-hours healthcare services. Moreover, lack of collaboration with other types of healthcare professionals was perceived as a barrier in our study, which is consistent with other studies [17, 35–38]. Improvements can be made by better organising care and by improving multiprofessional collaboration. Standardisation of processes and procedures, and inter-professional agreements on referral and follow-up might be useful.
Dutch GPs are generally aware of the guidelines because they are a fundamental part of the postgraduate training and continuing medical education. This is a strong feature of the professionalisation of GPs that is rooted in the 1980s when the guideline program of the NHG started. Nevertheless, GPs did not know the content well for almost half of the key recommendations in the guidelines selected in our study. GPs might be confronted with too many guidelines, as each year eight to ten new guidelines or updated versions are produced. To improve knowledge on guidelines, it may be useful to regularly conduct sessions among GPs, because the participants in our study appreciated the focus group sessions and considered these as an innovative medium for guideline education and implementation. The effectiveness of interactive education with active involvement and participation has been demonstrated in other studies as well [39–41].
In our study, we found that guideline factors were a relevant barrier to implementation, which is consistent with previous studies [12, 42]. GPs prefer short guideline recommendations that are easy to understand. The challenge is to produce simple and clear guideline recommendations that also address the complexity of problems seen in daily practice. Presenting guideline recommendations in multiple formats, such as algorithms, one or two page summaries, and electronic web-based versions with hyperlinks to more detailed information might serve the varying needs of physicians and patients [42, 43].
We used an existing framework of barriers to guideline adherence from Cabana et al. , and explored whether it covered the full range of barriers perceived by GPs in our study. We suggest that lack of applicability should be a more prominent category, including different reasons such as that the benefits may not outweigh the harms or patients with comorbidity who need special attention. In addition, the external barriers could be extended with some subcategories, as presented in Table 2. Finally, organisational constraints could be subdivided into organisational constraints within the own organisation or practice, those outside the organisation and those between organisations. Other studies also suggested additions to the framework [44, 45].
One of the strengths of our study is that we examined a large set of guidelines produced within one longstanding guideline program. Most qualitative studies have focused on a specific health topic, or studied only one or two guidelines [18, 19, 42, 46, 47], limiting the applicability of their findings. Secondly, we focused on barriers to key recommendations, rather than on barriers to guidelines as a whole. Our in-depth analysis of barriers provides detailed information on potential interventions needed to improve guideline adherence. This information can be used by professional groups or organisations, regionally and nationally, to develop multifaceted interventions, tailored to the individual recommendations in the guideline. For example, to improve the implementation of the guideline on urinary tract infections, it was suggested to develop local protocols for diagnosis in out-of-hours services, as the recommendation on diagnosis (i.e., the use of a dipslide method) did not apply well in these settings. Finally, the findings from our study may be useful for guideline developers in the process of updating the guidelines to raise the acceptance and implementability of the guideline recommendations.
Several limitations should be considered in interpreting our findings. First, we collected opinions from a small sample of GPs, with GPs working in group practices and in towns and small cities being slightly overrepresented . However, the aim of our focus group study was to identify possible barriers qualitatively, rather than quantifying their relative importance among a representative group of GPs. Results from this study will be used as input for a survey to be conducted among a larger sample of GPs in order to quantify our findings. Secondly, we only included GPs and no other healthcare professionals in our focus group sessions. As some of the barriers were related to behaviour of the practice assistants or practice nurses, it might be useful to include these professions in focus group sessions as well.
In conclusion, we identified a wide range of barriers that Dutch GPs face when using national guidelines. Using the focus group method proved to be an effective method to collect information on barriers. Results from this study help explaining why GPs do not adhere to guideline recommendations in practice, and provide useful suggestions for improving adherence. Our study also illustrated that lack of adherence to individual recommendations is related to multiple barriers. A detailed, in-depth analysis of barriers, as conducted in this study, offers opportunities for professional organisations to develop multiple, barrier driven, and tailored interventions to improve adherence in practice.
Examples of perceived barriers related to knowledge
LACK OF AWARENESS/FAMILIARITY
Guideline Sleeping disorder
'Can I be really honest with you? I have never read the guideline, never looked at it, never...'
Guideline Cerebrovascular accident (KR 2)
'I did not know about 160 mg acetylsalicylic acid for the course of two weeks... I always start with 80 mg in patients with stroke.'
Examples of perceived barriers related to attitude
LACK OF APPLICABILITY – benefits do not outweigh the harms
Guideline urinary tract infection (KR 4)
'I usually prescribe ciprofloxacin for the course of 10 days, because Augmentin is badly tolerated according to my experience.'
LACK OF APPLICABILITY – not applicable to patient population
Guideline depressive disorder (KR1)
'In practice, you never see patients with depression only or anxiety disorder only. Both often overlap. Then, the management plan is unclear.'
INTERPRETATION/LACK OF EVIDENCE – lack of evidence
Guideline atrial fibrillation (KR3)
'I only do thyroid gland testing. I do not understand the need for testing Hemoglobin and glucose in patients with atrial fibrillation. What's the evidence?'
LACK OF SELF-EFFICACY
Guideline thyroid disorders (KR 2)
'I do not have experience in treating hyperthyroid patients and only see a few of them per year. I think this is not sufficient to build up expertise.'
LACK OF OUTCOME EXPECTANCY
Guideline sleeping disorder (KR 6)
'.as GP in training, I was motivated to stop long term use of hypnotics in patients with a sleeping disorder. But now, people tell me: don't do it, it demands a lot of energy, without any predicted result. Then you start thinking: hands off, leave it.'
INERTIA OF PREVIOUS PRACTICE
Guideline cardiovascular risk management (KR 4)
'The new guideline recommends using systolic blood pressure...in monitoring drug treatment in patients with hypertension. However, I am used to monitor diastolic blood pressure...and then I feel guilty if I see someone with 150...I think that's a big change.'
Examples of perceived barriers related to behaviour: patient factors
PATIENT FACTORS – Patient preferences and demands
Guideline rhinosinusitis (KR2)
'There is a tension between the recommendation and patient demands. Patients expect antibiotics. This sometimes causes friction...yes.'
PATIENT FACTORS – Patient ability and behaviour
Guideline asthma among children (KR2)
'Some children perform well in spirometry, but with a very large number the results are totally invalid. Well, with some children it is just not going to work.'
Guideline cardiovascular risk management (KR 7)
'Yes, I try to, but there are always patients that do not show up for follow-up. Always. Also with medication.'
Examples of perceived barriers related to behaviour: guideline recommendation factors
GUIDELINE RECOMMENDATION FACTORS – Confusing/not clear
Guideline asthma among children (KR1)
'I read the recommendation [on allergy testing in children younger than six years] five times, and I still did not understand it!'
GUIDELINE RECOMMENDATION FACTORS – Incomplete/not up to date
Guideline cerebrovascular accident (KR1)
'This recommendation is based on obsolete opinions. You cannot keep patients with stroke at home. All of them should be immediately admitted to hospital.'
Examples of perceived barriers related to behaviour: environmental factors
ENVIRONMENTAL FACTORS – Organisational constraints (outside organisation)
Guideline urinary tract infection (KR1)
'How to use a dipslide in out-of-hours services on Sunday? Then you need someone who reads the results on Monday. That is really bothersome.'
ENVIRONMENTAL FACTORS – Organisational constraints (within own practice)
Guideline eye inflammation (KR2)
'I would like to reduce antibiotic prescriptions in patients with red eye, but the practice assistant often deals with these patients who ask for a prescription by telephone. The bottleneck is mainly in prescriptions requested over the telephone. There is an important improvement to make there, yes! As the assistant thinks that at any time a prescription is necessary.'
ENVIRONMENTAL FACTORS – Organisational constraints (between organisations)
Guideline cerebrovascular accident (KR 4/5)
'It is unclear what the hospital arranges and what we need to do when stroke patients return to their homes. There should be a formal handoff between hospital and the GP.'
ENVIRONMENTAL FACTORS – Lack of time/time pressure
Guideline cardiovascular risk management (KR 1/2)
'It's great what we could offer in cardiovascular risk management, but it would need full weekdays to realize this in practice.'
ENVIRONMENTAL FACTORS – Lack of/unpractical resources/materials
Guideline sexually transmitted diseases (KR3)
'There are different media, which is unpractical in use...and the media used in cervix streams can only be shortly preserved.'
Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72.
Grimshaw JM, Russell IT: Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993, 342 (8883): 1317-1322. 10.1016/0140-6736(93)92244-N.
Grimshaw J, Freemantle N, Wallace S, Russell I, Hurwitz B, Watt I, Long A, Sheldon T: Developing and implementing clinical practice guidelines. Quality Health Care. 1995, 4 (1): 55-64. 10.1136/qshc.4.1.55.
Grimshaw J, Eccles M, Thomas R, Maclennan G, Ramsay C, Fraser C: Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. J Gen Intern Med. 2006, 21 (Suppl 2): S14-S20.
Grol R: Improving the quality of medical care: building bridges among professional pride, payer profit, and patient satisfaction. JAMA. 2001, 286 (20): 2578-2585. 10.1001/jama.286.20.2578.
Lugtenberg M, Burgers JS, Westert GP: Effects of evidence-based clinical practice guidelines: a systematic review. Qual Saf Health Care. 2009,
Braspenning J, Schellevis F, Grol R: Tweede Nationale Studie naar ziekten en verrichtingen in de huisartspraktijk. Kwaliteit huisartsenzorg belicht. 2004, Nijmegen/Utrecht: WOK/NIVEL
Van Dijk L, Volkers A, Wolters I, De Bakker D: Het gebruik van elektronische formularia in de huisartspraktijk. 2008, Utrecht: NIVEL
Berg Van den MJ, De Bakker DH, Van Roosmalen M, Braspenning JCC: De staat van de huisartsenzorg. 2005, Utrecht: NIVEL
Grol R: Beliefs and evidence in changing clinical practice. BMJ. 1997, 418-421. 7105
Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362 (9391): 1225-1230. 10.1016/S0140-6736(03)14546-1.
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PAC, Rubin HR: Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999, 282 (15): 1458-1465. 10.1001/jama.282.15.1458.
Foy R, Walker A, Penney G: Barriers to clinical guidelines: The need for concerted action. Br J Clin Gov. 2001, 6 (3): 167-174.
Pagliari H, Kahan J: Researching perceived barriers and facilitators to implementation: a coded review of studies. Changing professional practice. Edited by: Thorsen T, Mäkelä M. 1999, Copenhagen: Danish Institute for Health Services Research, 169-190.
Carlsen B, Glenton C, Pope C: Thou shalt versus thou shalt not: a meta-synthesis of GPs' attitudes to clinical practice guidelines. Br J Gen Pract. 2007, 57 (545): 971-978. 10.3399/096016407782604820.
Boivin A, Legare F, Gagnon M-P: Competing norms: Canadian rural family physicians' perceptions of clinical practice guidelines and shared decision-making. J Health Serv Res Policy. 2008, 13 (2): 79-84. 10.1258/jhsrp.2007.007052.
Kasje WN, Denig P, Haaijer-Ruskamp FM: Specialists' expectations regarding joint treatment guidelines for primary and secondary care. Int J Qual Health Care. 2002, 14 (6): 509-518. 10.1093/intqhc/14.6.509.
Smith L, Walker A, Gilhooly K: Clinical guidelines of depression: a qualitative study of GPs' views. J Fam Pract. 2004, 53 (7): 556-561.
Cranney M, Warren E, Barton S, Gardner K, Walley T: Why do GPs not implement evidence-based guidelines? A descriptive study. Fam Pract. 2001, 18 (4): 359-363. 10.1093/fampra/18.4.359.
Nederlands Huisartsen Genootschap (NHG). [http://nhg.artsennet.nl]
Shekelle PG, Woolf SH, Eccles M, Grimshaw J: Clinical guidelines: developing guidelines. BMJ. 1999, 318 (7183): 593-596.
Krueger RA, Casey MA: Focus groups: a practical guide for applied research. 2000, Thousand Oaks, CA: Sage
Murphy E, Mattson B: Qualitative research and family practice: a marriage made in heaven?. Fam Pract. 1992, 9 (1): 85-91. 10.1093/fampra/9.1.85.
Mays N, Pope C: Qualitative research: rigour and qualitative research. BMJ. 1995, 311 (6997): 109-112.
Mays N, Pope C: Qualitative research in health care: assessing quality in qualitative research. BMJ. 2000, 320 (7226): 50-52. 10.1136/bmj.320.7226.50.
Stichting Kwaliteit en Opleiding Eerstelijnszorg (KOEL). [http://www.stichtingkoel.nl]
Hingstman L, Kenens RJ: Cijfers uit de registratie van huisartsen – peiling 2007. 2007, Utrecht: NIVEL
Davis DA, Taylor-Vaisey A: Translating guidelines into practice: a systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. CMAJ. 1997, 157 (4): 408-416.
Francke A, Smit M, de Veer A, Mistiaen P: Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak. 2008, 8 (1): 38-10.1186/1472-6947-8-38.
Schoen C, Osborn R, Huynh PT, Doty M, Peugh J, Zapert K: On the front lines of care: primary care doctors' office systems, experiences, and views in seven countries. Health Aff. 2006, 25 (6): w555-571. 10.1377/hlthaff.25.w555.
Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW: Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. JAMA. 2005, 294 (6): 716-724. 10.1001/jama.294.6.716.
Tinetti ME, Bogardus ST, Agostini JV: Potential pitfalls of disease-specific guidelines for patients with multiple conditions. N Engl J Med. 2004, 351 (27): 2870-2874. 10.1056/NEJMsb042458.
Shaneyfelt TM, Centor RM: Reassessment of clinical practice guidelines: go gently into that good night. JAMA. 2009, 301 (8): 868-869. 10.1001/jama.2009.225.
Durso SC: Using clinical guidelines designed for older adults with diabetes mellitus and complex health status. JAMA. 2006, 295 (16): 1935-1940. 10.1001/jama.295.16.1935.
Kasje WN, Denig P, de Graeff PA, Haaijer-Ruskamp FM: Physicians' views on joint treatment guidelines for primary and secondary care. Int J Qual Health Care. 2004, 16: 229-236. 10.1093/intqhc/mzh038.
Berendsen AJ, Benneker W, Schuling J, Rijkers-Koorn N, Slaets JPJ, Meyboom-de Jong B: Collaboration with general practitioners: preferences of medical specialists – a qualitative study. BMC Health Serv Res. 2006, 6: 155-10.1186/1472-6963-6-155.
Younes N, Gasquet I, Gaudebout P, Chaillet M-P, Kovess V, Falissard B, Hardy Bayle M-C: General Practitioners' opinions on their practice in mental health and their collaboration with mental health professionals. BMC Family Practice. 2005, 6 (1): 18-10.1186/1471-2296-6-18.
Heideman J, Laurant M, Verhaak P, Wensing M, Grol R: Effects of a nationwide programme: interventions to reduce perceived barriers to collaboration and to increase structural one-on-one contact. Journal of Evaluation in Clinical Practice. 2007, 13 (6): 860-866.
Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Getting research findings into practice: closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998, 317 (7156): 465-468.
Davis D, O'Brien MAT, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A: Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes?. JAMA. 1999, 282 (9): 867-874. 10.1001/jama.282.9.867.
O'Brien M, Freemantle N, Oxman A, Wolf F, Davis D, Herrin J: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2001, 1: pc118-
Cabana MD, Ebel BE, Cooper-Patrick L, Powe NR, Rubin HR, Rand CS: Barriers pediatricians face when using asthma practice guidelines. Arch Pediatr Adolesc Med. 2000, 154 (7): 685-693.
Hayward RSA, Guyatt GH, Moore KA, McKibbon A, Carter AO: Canadian physicians' attitudes about and preferences regarding clinical practice guidelines. CMAJ. 1997, 156 (12): 1715-1723.
Espeland A, Baerheim A: Factors affecting general practitioners' decisions about plain radiography for back pain: implications for classification of guideline barriers – a qualitative study. BMC Health Serv Res. 2003, 3 (1): 8-10.1186/1472-6963-3-8.
Gravel K, Légaré F, Graham ID: Barriers and facilitators to implementing shared decision-making in clinical practice: a systematic review of health professionals' perceptions. Implement Sci. 2006, 1: 16-10.1186/1748-5908-1-16.
Schers HMGP, Wensing MP, Huijsmans Z, van Tulder MP, Grol RP: Implementation barriers for general practice guidelines on low back pain: a qualitative study. Spine. 2001, 26 (15): E348-353. 10.1097/00007632-200108010-00013.
Schouten JA, Hulscher MEJL, Natsch S, Kullberg B-J, Meer Van der JWM, Grol RPTM: Barriers to optimal antibiotic use for community-acquired pneumonia at hospitals: a qualitative study. Quality Saf Health Care. 2007, 16 (2): 143-149. 10.1136/qshc.2005.017327.
The authors wish to thank all participating GPs and Stichting KOEL for providing the sample of GPs and facilitating the focus group sessions.
The authors declare that they have no competing interests.
ML drafted and revised the manuscript, has been involved in designing and conducting the focus groups study, and in analysing and interpreting the data. JZ has made substantial contributions in analysing the data. GW was involved in designing the study and critically revising the manuscript. JB supervised the study and has been involved in designing the study, conducting the focus group sessions and critically revising the manuscript. All authors have read and approved the final manuscript.