Table 2 Criteria for development of guideline-based performance measures, supporting methodology publications and strength of consensus at Delphi round 2
From: Reporting standards for guideline-based performance measures
Criterion | Supporting methodology publications as identified by systematic search | Strength of consensus |
|---|---|---|
1. Guideline selection 1a. State the currency of the guideline(s) used for guideline-based performance measure development and state if it/they meet the criteria set out by the Guidelines International Network (G-I-N). Describe the guideline quality using a validated guideline appraisal tool, such as AGREE II. b. Indicate additional sources, if used and the rationale for their use. | AQUA 2013 [35] Campbell 2002 [22] 1b: ACCF/AHA 2005 [28]/2010 [37] Ă„ZQ 2009 [24] Graham 2009 [27] Hutchinson 2003 [30] | Overall agreement 100Â % Agree 67Â % Rather agree 33Â % |
2. Selection of guideline recommendations State the strength of evidence and/or the grade of recommendation qualifying the guideline recommendations to be used for guideline-based performance measures. | AHCPR 1995 [20] AHCPR 1995 [19] Ă„ZQ 2009 [24] Baker 1999 [21] Bergman 1999 [25] Califf 2002 [26] Campbell 2002 [22] Duffy 2005 [32] Graham 2009 [27] Hutchinson 2003 [30] De Koning 2006 [8] Wollersheim 2003 [29] | Overall agreement 100Â % Agree 75Â % Rather agree 25Â % |
3. Selection process of performance measures from guideline recommendations Describe clearly and in detail the methods used to develop the performance measures from the supporting clinical guideline recommendations. | ACC/AHA 2005 [28] ACCF/AHA 2010 [37] Ă„ZQ 2009 [24] Califf 2002 [26] Campbell 2002 [22] Campbell 2011 [36] Duffy 2005 [32] Hutchinson 2003 [30] De Koning 2006 [8] LaClair 2001 [34] | Overall agreement 100Â % Agree 92Â % Rather agree 8Â % |
4. Core attributes of performance measures State, if the following attributes within the development process of guideline-based performance measures were considered: • Relevance (as a minimum: potential for improvement/clinical relevance) • Scientific Soundness (as a minimum: the evidence supporting the measure) • Feasibility (as a minimum: clarity of definition and measurability) | ACC/AHA 2005 [28] ACCF/AHA 2010 [37] ÄZQ 2009 [24] Baker 1995 [21] Califf 2002 [26] Graham 2009 [27] Campbell 2002 [22] Campbell 2011 [36] Duffy 2005 [32] Golden 2008 [33] Wollersheim 2003 [29] | Overall agreement 100 % Agree 92 % Rather agree 8 % |
5. Specification of performance measures State that numerator and denominator of the guideline-based Performance Measure is specified unambiguously and in detail. | ACCF/AHA 2005 [28] Advani 2003 [31] Ă„ZQ 2009 [24] Campbell 2002 [22] Campbell 2011 [36] Golden 2008 [33] LeClair 2001 [34] | Overall agreement 100Â % Agree 100Â % |
6. Intended use of performance measures State if there is a clear description of the intended use of the performance measure (quality improvement, quality assurance with or without accountability purposes, pay for performance) and at what level in the health system it is used (local, regional, national). | ACCF/AHA 2010 [37] Ă„ZQ 2009 [24] AQUA 2013 [35 Campbell 2002 [22] Campbell 2011 [36] | Overall agreement 100Â % Agree 75Â % Rather agree 25Â % |
7. Practice test of performance measures If a practice test (piloting) is carried out prior using the guideline-based performance measure, provide a full description of the process. If no practice test is done, provide the rationale for this. Provide information about any other validation process in use. | AHCPR 1995 [20] AHCPR 1995 [19] AQUA 2013 [35] Campbell 2011 [36] ACCF/AHA 2005 [28] Golden 2008 [33] Wollersheim 2003 [29] | Overall agreement 100Â % Agree 75Â % Rather agree 25Â % |
8. Review and reevaluation of performance measures Report the currency of the performance measures in use. State if there are criteria for deciding to change or stop using performance measures. | Graham 2009 [27] ACCF/AHA 2010 [37] Duffy 2005 [32] Follmann 2012 [38] | Overall agreement 92Â % Agree 75Â % Rather agree 17Â % Rather disagree 8Â % |
9. Composition of the panel deciding on guideline-based performance measures Describe clearly the composition of the panel deciding on guideline-based performance measures with information on participation of multidisciplinary experts, stakeholders in the field, experts in quality measurement, and patient representatives. | ACCF/AHA 2005 [28] Ă„ZQ 2009 [24] Campbell 2002 [22] Campbell 2011 [36] Duffy 2005 [32] Hutchinson 2003 [30] Wollersheim 2003 [29] | Overall agreement 100Â % Agree 92Â % Rather agree 8Â % |