Skip to content


Implementation Science

What do you think about BMC? Take part in

Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Effectiveness and efficiency of a practice accreditation program on cardiovascular risk management in primary care: study protocol of a clustered randomized trial

  • Elvira Nouwens1Email author,
  • Jan Van Lieshout1,
  • Eddy Adang2,
  • Margriet Bouma3,
  • Jozé Braspenning1 and
  • Michel Wensing1
Implementation Science20127:94

Received: 14 June 2012

Accepted: 28 September 2012

Published: 4 October 2012



Cardiovascular risk management is largely provided in primary healthcare, but not all patients with established cardiovascular diseases receive preventive treatment as recommended. Accreditation of healthcare organizations has been introduced across the world with a range of aims, including the improvement of clinical processes and outcomes. The Dutch College of General Practitioners has launched a program for accreditation of primary care practices, which focuses on chronic illness care. This study aims to determine the effectiveness and efficiency of a practice accreditation program, focusing on patients with established cardiovascular diseases.


We have planned a two-arm cluster randomized trial with a block design. Seventy primary care practices will be recruited from those who volunteer to participate in the practice accreditation program. Primary care practices will be the unit of randomization. A computer list of random numbers will be generated by an independent statistician. The intervention group (n = 35 practices) will be instructed to focus improvement on cardiovascular risk management. The control group will be instructed to focus improvement on other domains in the first year of the program. Baseline and follow-up measurements at 12 months after receiving the accreditation certificate are based on a standardized version of the audit in the practice accreditation program. Primary outcomes include controlled blood pressure, serum cholesterol, and prescription of recommended preventive medication. Secondary outcomes are 15 process indicators and two outcome indicators of cardiovascular risk management, self-reported achievement of improvement goals and perceived unintended consequences. The intention to treat analysis is statistically powered to detect a difference of 10% on primary outcomes. The economic evaluation aims to determine the efficiency of the program and investigates the relationship between costs, performance indicators, and accreditation.


It is important to gain more information about the effectiveness and efficiency of the practice accreditation program to assess if participation is worthwhile regarding the quality of cardiovascular risk management. The results of this study will help to develop the practice accreditation program for primary care practices.

Trial registration

This cluster randomized trial is registered at nr NCT00791362


Institutional accreditationProfessional certificationPrimary careCardiovascular illness


Cardiovascular diseases (CVD) remain an important cause of mortality and morbidity worldwide. In public health and in primary care, many efforts have been made to prevent CVD [1, 2]. Although cardiovascular care has improved in recent years [3], a substantial number of individuals receive suboptimal cardiovascular risk management (CVRM) and do not attain the lifestyle, risk factor, and therapeutic targets that are recommended [4, 5]. A range of interventions to improve healthcare delivery is available [68]. In recent years, programs have been developed for performance indicators, accreditation, pay-for-performance, and public reporting [9]. These approaches make use of market forces and pressure for accountability, but research evidence on effectiveness and efficiency is limited [911].

The slow improvement of cardiovascular primary care may be caused by the one-off and condition-specific character of many improvement activities (e.g., a continuing education session or audit without follow-up). To enhance continuous improvement in primary care in the Netherlands, the Dutch College of General Practitioners (DCGP) initiated in 2005 a nationwide comprehensive practice accreditation program for primary care practices. This program consists of a systematic audit on the basis of validated performance indicators for diabetes mellitus, CVRM, asthma, chronic obstructive pulmonary disease (COPD), practice organization, patient experience, educational feedback to practices, the requirement to develop structured improvement plans, and a check on the implementation of these plans after one year. If the procedure is performed, primary care practices receive a certificate that provides accreditation for a time period of one year. While accreditation serves a range of purposes, improvement of professional performance and practice organization are prominent among these [1214]. While the impact of audit and feedback is mixed and moderate [15], it is unknown what the added value of the accreditation procedure is. A study of practice accreditation in German primary care practices showed that it improved aspects of practice organization, but this study did not measure or assess impact on clinical processes or outcomes [16]. Given the resources invested in accreditation schemes and the high expectations, an evaluation of the impact on quality and outcomes of care is needed.

A substantial number of performance indicators used in the practice accreditation program is related to CVD. These indicators are derived from the completely revised guideline on CVRM that was published by the DCGP late 2005 [17]. The new set of guidelines on CVRM describes the clinical interventions to be implemented in patient care in this project. They contain important changes in recommendations, such as different cut-off levels (e.g., LDL-cholesterol <2.5 mmol/l and systolic blood pressure <140 mmHg). The DCGP has developed a number of products and activities to implement these guidelines, including a national kick-off conference for general practitioners (GPs) in December 2005, and a supportive package (‘kwaliteitskoffer’) consisting of educational materials and software for assessment of cardiovascular risk. The practice accreditation program is an important approach to improve primary care, but controlled evaluations of its effect have not yet been done.

Aims and objectives

The overall aims of the study are to determine the effectiveness and efficiency of the practice accreditation program in primary care, focused on its effect on CVRM.

Key objectives are:
  1. 1.

    To determine the effectiveness of the program on primary performance indicators for CVRM by comparing practices in the accreditation program that focus their improvement plans on CVRM to practices in the accreditation program that focus their improvement plans on other domains of chronic care. Primary outcomes are documented controlled blood pressure, serum cholesterol, and prescription of recommended preventive medication (effect evaluation).

  2. 2.

    To determine the potential effect of the program on other indicators for CVRM, self-reported goal attainment in the intervention group, and unintended consequences. Secondary outcomes are all other indicators for CVRM, self-reported goal attainment in the intervention group, and unintended consequences (effect evaluation).

  3. 3.

    To determine the economic efficiency of the program in the observed period regarding the primary outcomes.

  4. 4.

    To explore what factors and mechanisms are associated with change (or absence of change) of performance in CVRM.



Trial design

The study design is a cluster randomized controlled trial with a block design, considering primary care practices as units of clustering.

Ethical approval and informed consent

The Medical Ethics committee Arnhem-Nijmegen waived approval for this trial. At follow-up practices will send a letter of invitation and informed consent to 100 patients with established CVD. Patients return their letter with informed consent to Radboud University Nijmegen Medical Centre with permission for audit of their medical records. The privacy of the participating patients will be protected, and all data will be coded and processed anonymously. For the baseline-measurement, mandatory information on indicators for patients with established CVD will be used, collected by practices on behalf of the practice accreditation program.


Primary care practices

Seventy primary care practices will be recruited from practices in the Netherlands who voluntarily apply to start the practice accreditation program. An invitation letter for the study will be sent as part of the instruction manual for the program. Practices with a clear preference for a specific improvement plan will be excluded from participation in the study while participating practices will be randomized to a group which starts with an improvement plan on CVRM or to a group that does not. This also accounts for practices that participate in regional programs for enhancing disease management.


The study focuses on patients with established CVD. This includes patients with angina pectoris, acute myocardial infarction in their medical history, other chronic ischemic heart diseases, transient ischemic attack (TIA), ischemic stroke, peripheral arterial disease, and aneurysma aortae. Selection of patients out of electronic medical records with these conditions will be based on corresponding diagnostic International Classification of Primary Care codes (ICPC-codes K74, K75, K76, K89, K90.3, K92.1 and K99.1), a worldwide system to label conditions in primary care [18].


General practices will be the unit of randomization. A computer list of random numbers will be generated by an independent statistician and then used to randomly allocate practices to equally sized intervention group or control group. This will be done in a randomized block design in blocks of four practices in order of enrolment. We assume that improvement activities in the control group will not influence cardiovascular care.

The practice accreditation program

The practice accreditation program is an existing procedure provided since 2005 by an independent body (NPA) that has a license to use the accreditation procedure developed by the DCGP. The DCGP remains responsible for the content and further development of the procedure; it will be responsible for adequate delivery of the practice accreditation program in this study. The practice accreditation program comprises, firstly, of a comprehensive audit (using validated performance indicators) and written feedback to the practice, which covers a range of clinical domains (mainly chronic diseases), practice management, and patient experiences. The feedback, which consists of a comparison with benchmarks of other primary care practices, is discussed with a non-physician observer in a feedback consultation and helps to identify substandard performance. The second obligatory component, the planning of improvements in the practice according to the principles of quality management, is based on this feedback. The practice team is supported by a trained non-physician consultant. Practices that perform the procedure as planned are all accredited, so accreditation does not imply that a certain minimum score has been obtained (the latter is usually labeled certification). In the practice accreditation program, validated instruments are used: the Visit Instrument to asses Practice management (Visitatie Instrument Praktijkvoering, VIP) [19], clinical performance, and Europep [20]. Practices in the program receive a reimbursement of some insurance companies consisting of a bonus per patient per year. Furthermore they receive a certification for the time period of one year that demonstrates (to the public) their involvement in continuous quality improvement. Every year the practice will be audited, and every year new improvement plans have to be formulated that have to be approved by the auditor.

Intervention group

The intervention starts with volunteering for the practice accreditation program. After enrolment for the study, practices will be contacted by telephone for further explanation of the study protocol and to schedule the data collection. After data is collected, practices are randomized. Practices allocated to the intervention group are instructed to focus their improvement plans on cardiovascular diseases in the first year of the program.

Control group

The control group also starts with volunteering for the practice accreditation program and follows the same routine as described for the intervention group. Practices allocated to the control group are instructed to focus their improvement plans on other domains than cardiovascular disease and diabetes mellitus (they may target CVD later after the study period of one year). They are instructed to focus their improvement plans on other clinical areas than CVD or diabetes.

Both intervention and control group receive feedback on CVD indicators as part of the normal practice accreditation program. Practices in the intervention group are instructed to set targets related to process and outcomes of cardiovascular care (and not just focused on improvement of registration of cardiovascular disease in the medical record system). All practices will receive a minimum of four hours of support by outreach consultants for no cost, which is available in all regions. Also, the practices are provided with examples of improvement plans, which saves time and would make study participation more attractive.

Measurement procedures

In each practice measurements are done at baseline and at follow-up (Figure 1). At baseline, medical records of 40 patients with established CVD are audited as part of the clinical performance measurements in the practice accreditation program. Data on performance indicators of CVRM as included in the practice accreditation program will be used for the analysis. At follow up, the following measurement methods will be used: medical record audit based on the same indicators of CVRM as in the baseline measurement, patient questionnaires, and a semi-structured interview for a contact person in each practice. Data will be collected consistently as this is done by two persons with similar training.
Figure 1

Flow Diagram.

Measures of effectiveness

The effect evaluation aims to determine the effectiveness of the program on primary performance indicators for CVRM and to determine the potential impact of the program on other indicators for CVRM, self-reported goal attainment in the intervention group, and unintended consequences.

Primary outcomes have been selected from the 20 quality indicators for established CVD [21], which were developed by DCGP (Table 1), and are:
  1. 1.

    The percentage of patients in the practice with known established CVD who have systolic blood pressure below 140 mmHg.

  2. 2.

    The percentage of patients in the practice with known established CVD who have LDL cholesterol below 2.5 mmol/l.

  3. 3.

    The percentage of patients in the practice with known established CVD with a record that aspirin, an alternative anti-platelet therapy, or an anticoagulant has been prescribed.

Table 1

Indicators for cardiovascular risk management

Type of indicator



Smoking status


Patient is a smoker


Stop smoking advice


BMI measured


BMI < 25 kg/m2


Influenza vaccination


Exercise control


Systolic blood pressure measured


Systolic blood pressure < 140 mmHg1


LDL cholesterol measured


LDL cholesterol <2.5 mmol/L1


Advice physical activity


Diet control


Counseling about diet


Registration of alcohol intake


Patients with LDL cholesterol ≥2.5 mmol/L with statin prescription


Waist circumference measured


Prescription antiplatelet drugs1


Fasting glucose measured


Comprehensive risk assessment *

*Positive score when there is a record of: blood pressure, BMI, waist circumference, fasting glucose measurement, LDL cholesterol measurement, smoking behavior, alcohol intake, advice and control of diet and physical exercise in the past 12 months.

1Primary outcome.

Data concerning indicators are extracted from medical records and will be available at patient level so that linkage to other measures (resource use, patient characteristics) can be made at patient level.

Secondary outcomes consist of the 17 remaining indicators are used and include: measurement of systolic blood pressure, measurement of LDL-cholesterol, prescription of statin, smoking status, stop smoking advice, measurement of body mass index (BMI), BMI <25 kg/m2, measurement of waist circumference, fasting glucose measurement, influenza vaccination, registration of alcohol intake, control and advice for exercise and diet, and comprehensive risk assessment (Table 1). Furthermore, secondary outcomes are measured in interviews with the contact person of the practice and contain perceived goal attainment regarding the improvement plans, which is measured on a likert scale, and unintended consequences as result of participating in the practice accreditation program.

Measures of costs

In follow-up measurements items of use of healthcare will be extracted from the medical records with a retrospective three-month observation period. These items include number of contacts in the practice (face to face, telephone, email), use of various types of cardiovascular medication, use of hospital care or other care providers for cardiovascular diagnosis or therapy. Additional information will be collected with patient questionnaires, particularly on other healthcare use (e.g., home care) and productivity losses, using a one-month retrospective observation period. Also, at follow-up in both groups, time and other resources of practice teams spent on quality improvement in the total period of 18 months will be documented. Data-collection on performance indicators will be done in the follow-up measurement by medical record audit.

Other measures

  1. 1.

    Exposure to other quality improvement activities: Both study groups report on their exposure to relevant professional education and practice improvement activities (e.g., training for practice nurses). This will be measured in semi-structured telephone interviews.

  2. 2.

    Potential confounders: At follow up, potential confounders will be measured. These include patient characteristics, particularly patient age, gender and multi-morbidity. Furthermore, data on practice characteristics will be collected. These include practice size, physician workload, volume of assistance in the practice, delegation of medical tasks to assistants, and involvement of practice nurses in chronic care. These practice characteristics have shown to be associated with better chronic disease management in Dutch primary care practices [22].

  3. 3.

    Patient reported outcomes: At follow up, patients receive questionnaires that include items on demographic characteristics, labor activities and healthcare use. Furthermore the EQ-5D (five items and VAS scale) will be added to measure health outcome [23]. To measure chronic care delivery, the Patient Assessment of Chronic Illness Care (PACIC) will be used [24]. Questionnaires for physical exercise (RAPA, nine items) [25], and the Treatment Self-Regulation Questionnaire (TSRQ) [26] to measure the motivation for being physically active will be included.


Statistical methods

The study groups will be compared at baseline regarding known determinants of cardiovascular care and its improvement. These include patient factors [27, 28] (e.g., age, multi-morbidity, ethnicity at practice level) and practice characteristics [22, 29] (e.g., availability of nurses, delegation of medical tasks to assistance, practice size). Only factors emerging from previous research are considered to avoid overcorrection in the primary analysis. A logistic regression model will be constructed for each outcome to analyze these outcomes in relation to group (intervention, control) and measurement moment (baseline, follow-up). Identified differences between the groups at baseline will be included in this analysis. Random coefficients will be included to allow for the clustering of data within practices. Each of the secondary outcomes (clinical and organizational indicators) will also be analyzed in this way. Finally, if an internally consistent scale can be constructed (reflected by high reliability coefficients of the combined score), we will develop an aggregated measure of outcome, and use this in a similar random coefficients linear regression analysis.

To identify the effectiveness of this program on attainment of practice-defined goals and its perceived unintended consequences, the second key objective, a descriptive analysis will be performed aimed at determining what proportion of self-defined goals for improvement was achieved by the practices and straightforward listing of the GP views on unintended consequences of the practice accreditation program.

Economic analysis

The economic analysis, the third key objective, aims to determine the efficiency of the program in the observed period regarding the primary outcomes. The economic evaluation also investigates the relationship between costs, performance indicators, and accreditation. The economic evaluation provides incremental cost-effectiveness ratios: incremental cost per percentage patients gained with systolic blood pressure below 140 mmHg; incremental cost per percentage patients gained with LDL cholesterol <2.5 mmol/l; incremental cost per percentage patient gained with aspirin, an alternative anti-platelet therapy or an anti-coagulant.

For the economic analysis, costs analyses will be based on the competing health production processes respectively, including and excluding resources attributed to accreditation. Specific unit-costs include, for example medical care (contacts in primary care practice, tests, treatments, etc.) and improvement related costs (accreditation tariff, time for audit, planning and implementing improvement, exposure to other relevant quality improvement, etc.). Units of resources are monetary valued on the basis of prevailing Dutch guidelines [30] or national CVZ tariffs. The analysis aims to provide incremental cost-effectiveness ratios (ICERs). The ICERs will be computed, and uncertainty will be determined using the bootstrap method to account for skewness in the underlying parameter distributions. Uncertainty will be presented in a Bayesian fashion using cost-effectiveness acceptability curves (CEAC’s) that are able to evaluate efficiency by using different thresholds for the ICER (varying the willingness to pay for a percentage patients gained for each of the primary outcomes). Uncertainty in deterministic parameters will be examined with sensitivity analysis based on the range of extremes.

Process evaluation

The process evaluation, the fourth key objective, aims to explore what factors and mechanisms are associated with change (or absence of change) of performance on CVRM indicators. Semi-structured telephone interviews will be held with primary care physician or the quality coordinator of the practice after data collection for follow-up measurement is concluded. Topics of this interview are: practice characteristics; feedback reports; composing improvement plans; and reasons to participate in and experiences with the practice accreditation program. We want to explore if specific elements of the practice accreditation program are the cause of change in CVRM. All interviews will be conducted by the same person and will be audio-recorded. Interviews will be transcribed verbatim. Two researchers will independently review the transcripts. Data analysis will be done according to the framework approach [31]. Topics in the interviews will be used as coding frame. Software package Atlas ti. will be applied to analyze qualitative data. The primary analysis of the interview data aims to identify determinants of (change of) practice as perceived by participants.

Sample size

In the practices in the practice accreditation program up to 2006 (n = 139), the following median values at practice level were found on indicators referring to patients with CVD: 53% for acceptable blood pressure levels; 36% for acceptable cholesterol levels; and 38% for use of anticoagulents (unpublished data at IQ healthcare, 2005 and 2006). These data suggest that the current scores on the primary outcomes are in the range of 35% to 55%, which imply that substantial improvement is possible in many practices. The proposed study has been powered to detect a difference of 10% (from 55% to 65%), not yet taking control for baseline values into account because of uncertainty regarding the correlation between baseline and follow-up measures.

We expected that the accreditation and improvement program will have an effect of 5% to 10% absolute change, which is the median value of effect sizes in a comprehensive review of 235 studies on quality improvement [14]. Other assumptions were a power = 0.80, alpha = 0.05, and ICC = 0.05. Given the sample of 30 patients per practice per indicator, we aimed to include 31 practices in each group. Allowing for dropout, we aim to include 35 practices in each group (n = 70 practices in total). This number is feasible, given the recruitment rate for the accreditation in 2006.

Time frame of the study

The study is planned from September 2008 until September 2012. In months 1 to 18, practices are recruited and included in the project and go through the accreditation procedure. The baseline data collection will take place in these months. During months 3 to 42, practices (in the intervention group) work on improving their management of CVD, practices in the control group on improvements in other areas. In months 18 to 42, follow-up measurements in intervention and control practices are planned. During months 43 to 48, data will be analyzed and reported.


The sample of participating primary care practices in this study is composed of volunteers for the practice accreditation program and therefore not nationally representative for primary care practices in the country. This reflects current practice, in which practice accreditation is a voluntary activity. It implies that study results cannot be generalized to the (currently hypothetical) situation of obligatory accreditation. Furthermore, we only collect data on CVRM; therefore, we cannot make statements about the effects of the program on other chronic illnesses.

Because both intervention and control groups start with accreditation, this project cannot pick up non-specific effects of the practice accreditation program. For example, we expect that practices prepare for accreditation by improving their practice (e.g., involve a practice nurse). We intend to compare the groups with other, independent samples of practices that provide data on cardiovascular care to get an impression of the representativeness of our sample of practices.

With the results of this study, we hope to make a contribution with regard to further development and adjustment of the practice accreditation program. Previous research [32] has shown that the program is time-consuming for participating practices. Furthermore, it costs a considerable amount of money to participate in the program. It is important to gain more information about the effectiveness and efficiency of the program to assess if participation is worthwhile regarding the quality of CVRM. With these results, stakeholders can make policy and management decisions with regard to the use of the program.

No data cleaning or analysis has occurred prior to submission of the manuscript.



Cardiovascular disease


Cardiovascular risk management


Dutch College of General Practitioners


Chronic obstructive pulmonary disease


General Practitioners


Low Density Lipoprotein-cholesterol


Transient Ischemic Attack


The Visit Instrument to asses Practice management (Visitatie Instrument Praktijkvoering)


International Classification of Primary Care


Patient Assessment of Chronic Illness Care


Treatment Self-Regulation Questionnaire


Incremental cost effectiveness ratio


Cost-effectiveness acceptability curve.



This study is funded by ZonMW – the Netherlands Organization for Health Research and Development, project number 170883001.

Authors’ Affiliations

Scientific Institute for Quality of Healthcare (IQ healthcare), Radboud University Nijmegen Medical Centre
Department of Epidemiology, Biostatistics and HTA, Radboud University Nijmegen Medical Centre
Dutch College of General Practitioners, Domus Medica


  1. Pennant M, Davenport C, Bayliss S, Greenheld W, Marshall T, Hyde C: Community programs for the prevention of cardiovascular disease: a systematic review. Am J Epidemiol. 2010, 172 (5): 501-516. 10.1093/aje/kwq171.View ArticlePubMedGoogle Scholar
  2. Van Lieshout J, Wensing M, Campbell SM, Grol R: Primary care strength linked to prevention programs for cardiovascular disease. Am J Manag Care. 2009, 15 (4): 255-262.PubMedGoogle Scholar
  3. Campbell SM, Roland MO, Middleton E, Reeves D: Improvements in quality of clinical care in English general practice 1998–2003: longitudinal observational study. BMJ. 2005, 331 (7525): 1121-10.1136/bmj.38632.611123.AE.View ArticlePubMedPubMed CentralGoogle Scholar
  4. Kotseva K, Wood D, De Backer G, De Bacquer D, Pyorala K, Keil U: EUROASPIRE III: a survey on the lifestyle, risk factors and use of cardioprotective drug therapies in coronary patients from 22 European countries. Eur J Cardiovasc Prev Rehabil. 2009, 16 (2): 121-137. 10.1097/HJR.0b013e3283294b1d.View ArticlePubMedGoogle Scholar
  5. Ludt S, Petek D, Laux G, Van Lieshout J, Campbell SM, Kunzi B, Glehr M, Wensing M: Recording of risk-factors and lifestyle counselling in patients at high risk for cardiovascular diseases in European primary care. Eur J Cardiovasc Prev Rehabil. 2012, 19 (2): 258-266.View ArticleGoogle Scholar
  6. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N: Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010, 17 (3): CD005470-Google Scholar
  7. Hulscher ME, Wensing M, Van der Weijden T, Grol R: Interventions to implement prevention in primary care. Cochrane Database Syst Rev. 2001, 1: CD000362-PubMedGoogle Scholar
  8. Wensing M, Van der Weijden T, Grol R: Implementing guidelines and innovations in general practice: which interventions are effective?. Br J Gen Pract. 1998, 48 (427): 991-997.PubMedPubMed CentralGoogle Scholar
  9. Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003, 362 (9391): 1225-1230. 10.1016/S0140-6736(03)14546-1.View ArticlePubMedGoogle Scholar
  10. Marshall MN, Romano PS, Davies HT: How do we maximize the impact of the public reporting of quality of care?. Int J Qual Health Care. 2004, 16 (Suppl 1): i57-i63.View ArticlePubMedGoogle Scholar
  11. Sutherland K, Leatherman S: Regulation and quality improvement. A review of the evidence. 2006, London: The Health FoundationGoogle Scholar
  12. Frijling B, Hulscher ME, van Leest LA, Braspenning JC, Van den Hoogen H, Drenthen AJ, Grol RP: Multifaceted support to improve preventive cardiovascular care: a nationwide, controlled trial in general practice. Br J Gen Pract. 2003, 53 (497): 934-941.PubMedPubMed CentralGoogle Scholar
  13. Frijling BD, Lobo CM, Hulscher ME, Akkermans RP, Van Drenth BB, Prins A, Van der Wouden JC, Grol RP: Intensive support to improve clinical decision making in cardiovascular care: a randomised controlled trial in general practice. Qual Saf Health Care. 2003, 12 (3): 181-187. 10.1136/qhc.12.3.181.View ArticlePubMedPubMed CentralGoogle Scholar
  14. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): iii- 72-View ArticleGoogle Scholar
  15. Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, 2: CD000259-PubMedGoogle Scholar
  16. Szecsenyi J, Campbell S, Broge B, Laux G, Willms S, Wensing M, Goetz K: Effectiveness of a quality-improvement program in improving management of primary care practices. CMAJ. 2011, 183 (18): E1326-E1333. 10.1503/cmaj.110412.View ArticlePubMedPubMed CentralGoogle Scholar
  17. Wiersma T, Goudswaard AN: NHG-Standaard Cardiovasculair risicomanagement. NHG-standaarden voor de huisarts. 2007, Houten: Bohn Stafleu van LoghumGoogle Scholar
  18. Soler JK, Okkes I, Wood M, Lamberts H: The coming of age of ICPC: celebrating the 21st birthday of the International Classification of Primary Care. Fam Pract. 2008, 25 (4): 312-317. 10.1093/fampra/cmn028.View ArticlePubMedGoogle Scholar
  19. Van den Hombergh P: PhD thesis. Practice visits. Assessing and improving management in general practice. 1998, Nijmegen: Katholieke Universiteit Nijmegen, Centre for Quality of Care ResearchGoogle Scholar
  20. Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, Hjortdahl P, Olesen F, Reis S, Ribacke M, Szecsenyi J: Patients in Europe evaluate general practice care: an international comparison. Br J Gen Pract. 2000, 50 (460): 882-887.PubMedPubMed CentralGoogle Scholar
  21. Van Althuis TR: Overzicht en definitie van indicatoren voor cardiovasculair risicomanagement bij patiënten met bekende hart- en vaatziekten in de huisartsenzorg.,
  22. Wensing M, Van den Hombergh P, Akkermans R, Van Doremalen J, Grol R: Physician workload in primary care: what is the optimal size of practices? A cross-sectional study. Health Policy. 2006, 77( (3): 260-267.View ArticleGoogle Scholar
  23. EQ-5D, an instrument to describe and value health.,
  24. Wensing M, Van Lieshout J, Jung HP, Hermsen J, Rosemann T: The Patients Assessment Chronic Illness Care (PACIC) questionnaire in The Netherlands: a validation study in rural general practice. BMC Health Serv Res. 2008, 8: 182-10.1186/1472-6963-8-182.View ArticlePubMedPubMed CentralGoogle Scholar
  25. Topolski TD, LoGerfo J, Patrick DL, Williams B, Walwick J, Patrick MB: The Rapid Assessment of Physical Activity (RAPA) among older adults. Prev Chronic Dis. 2006, 3 (4): A118-PubMedPubMed CentralGoogle Scholar
  26. Levesque CS, Williams GC, Elliot D, Pickering MA, Bodenhamer B, Finley PJ: Validating the theoretical structure of the Treatment Self-Regulation Questionnaire (TSRQ) across three different health behaviors. Health Educ Res. 2007, 22 (5): 691-702.View ArticlePubMedGoogle Scholar
  27. Min LC, Wenger NS, Fung C, Chang JT, Ganz DA, Higashi T, Kamberg CJ, Maclean CH, Roth CP, Solomon DH, Young RT, Reuben DB: Multimorbidity is associated with better quality of care among vulnerable elders. Med Care. 2007, 45 (6): 480-488. 10.1097/MLR.0b013e318030fff9.View ArticlePubMedGoogle Scholar
  28. Sales AE, Tipton EF, Levine DA, Houston TK, Kim Y, Allison J, Kiefe CI: Are co-morbidities associated with guideline adherence? The MI-Plus study of Medicare patients. J Gen Intern Med. 2009, 24 (11): 1205-1210. 10.1007/s11606-009-1096-4.View ArticlePubMedPubMed CentralGoogle Scholar
  29. Laurant M, Reeves D, Hermens R, Braspenning J, Grol R, Sibbald B: Substitution of doctors by nurses in primary care. Cochrane Database Syst Rev. 2005, 2: CD001271-PubMedGoogle Scholar
  30. Hakkaart-Van Roijen L, Tan SS, Bouwmans CAM: Handleiding voor kostenonderzoek. Methoden en richtlijnprijzen voor economische evaluaties in de gezondheidszorg. Geactualiseerde versie 2010. 2010, Erasmus Universiteit Rotterdam: Instituut voor Medical Technology AssessmentGoogle Scholar
  31. Pope C, Ziebland S, Mays N: Qualitative research in health care. Analysing qualitative data. BMJ. 2000, 320 (7227): 114-116.PubMedGoogle Scholar
  32. Van Doorn-Klomberg AL, Kirschner K, Bouma M, In 't Veld CJ, Wensing M, Braspenning JCC: Ervaringen met de NHG-Praktijkaccreditering. Huisarts & Wetenschap. 2011, 7: 360-365.View ArticleGoogle Scholar


© Nouwens et al.; licensee BioMed Central Ltd. 2012

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.