Table 3 Characteristics of included references: Methodological approaches to topic/guideline selection and extraction of recommendations
From: Methods for the guideline-based development of quality indicators--a systematic review
| Â | Topic/guideline selection | Extraction of recommendations | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
Reference | Criteria for selection of topic | Development of QI from... | Criteria for selection of participants | Criteria for selection of guidelines | Participants listed a | Critical appraisal | Guidelines listed a | Extraction of all/a selection of recommendations | Criteria for recommendation selection b | Potential indicators listed a |
Method papers | Â | Â | Â | Â | Â | Â | Â | Â | Â | Â |
ÄZQ (2009) | No | One guideline | No | No | - | No | - | Unclear | - | - |
AHCPR (1995) | No | One guideline | Yes Profession involved in the selected healthcare process, methodological competence | Yes Methodological quality | - | Yes Not detailed | - | Selection | Yes Impact on patient outcome | - |
AHRQ (1995) | Yes Regulatory requirements, quality gap, guideline adherence unknown | More than one guideline | No | Yes Methodological quality | - | Yes Not detailed | - | Selection | Yes Impact on patient outcome and relevance to obtaining value for money | - |
AQUA (2010) | Yes Public health relevance, sound evidence base, feasibility | Guidelines and other sources | No | Yes Methodological quality | - | Yes AGREE Instrument | - | All | - | - |
Baker and Fraser (1995) | No | Not specified (method paper) | No | No | - | Yes Not detailed | - | Unclear | - | - |
Bergman (1999) | Yes Sound evidence base | Not specified (method paper) | No | No | - | Yes Not detailed | - | Unclear | . | - |
Califf et al. (2002) | No | One guideline | No | No | - | Yes Not detailed | - | Selection | Yes Level of evidence | - |
Campbell et al. (2002) | No | Not specified (method paper) | No | No | - | No | - | Unclear | - | - |
Graham et al. (2009) | Yes Quality gap | Guidelines and other sources | No | No | - | No | - | Unclear | - | - |
Spertus et al. (2005) | No | Not specified (method paper) | No | Yes Strength of evidence, clinical relevance, magnitude of relationship between performance and outcome | - | Yes Not detailed | - | Selection | Yes Level of evidence, impact on patient outcome | - |
Topic papers | Â | Â | Â | Â | Â | Â | Â | Â | Â | Â |
Bonow et al. (2005) | Yes Public health relevance, quality gap, costs | More than one guideline | No | No | Yes | Yes Not detailed | Yes | Selection | Yes Grade of recommendation, relevance for the topic | No |
Burge et al. (2007) | Yes Public health relevance, quality gap | Unclear | No | No | Yes | No | No | Selection | Yes Potential for improvement, meaningful, valid, reliable, adjustable, feasible | No |
Campbell et al. (1999) | Yes Public health relevance, substantial amount of workload in general practice | Guidelines and other sources | No | No | No | No | Yes | Unclear | - | No |
Desch et al. (2008) | No | Guidelines and other sources | Yes Profession involved in the selected healthcare process | No | Unclear | No | Yes | Selection | Yes Impact on patient outcome, potential for improvement, feasibility of data collection | No |
Draskovic et al. (2008) | Yes Variance in quality of care between providers | One guideline | No | No | No | No | Yes | Unclear | - | No |
Estes et al. (2008) | Yes Public health relevance and costs | Guidelines and other sources | No | No | Yes | Yes Not detailed | Yes | Selection | Yes Grade of recommendation, relevance for the topic | No |
Forbes et al. (1997) | Yes Public health relevance, individual impact on quality of life | One guideline | No | No | No | No | Yes | All | - | No |
Giesen et al. (2007) | Yes Quality of care unknown | Guidelines and other sources | No | Yes Applicability to the setting, clinical relevance | Yes | Yes AGREE instrument | Yes | Selection | Yes Relevance for the selected topic | No |
Hadorn et al. (1996) | Yes Public health relevance, individual quality-of-life impact, costs | One guideline | No | No | Yes | No | Yes | All | - | Yes |
Hardy and Hadley (1995) | No | One guideline | No | Unclear | No | No | Yes | Unclear | - | No |
Hermanides et al. (2008) | Yes Public health relevance, quality gap | One guideline | No | No | No | No | Yes | Selection | No | Yes |
Hermens et al. (2006) | Yes Quality of care unknown, guideline adherence unclear | One guideline | No | No | No | No | Yes | All | - | No |
James et al. (1997) | Yes Public health relevance, costs, quality gap | One guideline | No | No | No | Yes Not detailed | Yes | All | - | No |
Kongnyuy and van den Broek (2008) | No | Guidelines and other sources | No | No | No | No | Yes | Unclear | - | No |
Krumholz et al. (2006) | Yes Public health relevance, quality gap | More than one guideline | No | No | Yes | Yes Not detailed | Yes | Selection | Yes Grade of recommendation | No |
Lee et al. (2003) | No | Guidelines and other sources | No | No | No | No | Yes | Unclear | - | No |
Maclean et al. (2004) | Yes Public health relevance | Guidelines and other sources | No | No | No | Unclear | Yes | Selection | Yes Impact on patient outcome, grade of recommendation | No |
Martirosyan et al. (2008) | Yes Public health relevance, quality of care unknown | More than one guideline | No | No | No | No | Yes | Selection | Yes Measurability | Yes |
Mourad et al. (2007) | Yes Public health relevance, quality gap | More than one guideline | No | Yes Methodological quality | No | No | Yes | All | - | No |
Nijkrake et al. (2009) | Yes Public health relevance and complexity of the topic | One guideline | No | No | No | No | Yes | Selection | Yes Acceptability, measurability | No |
Ouwens et al. (2007) | Yes Complexity of the process of care | Guidelines and other sources | No | No | No | No | Yes | Selection | Yes Impact on patient outcome | No |
Ouwens et al. (2010) | Yes Individual impact on quality of life, quality gap | Guidelines and other sources | No | Yes Applicability to the setting | No | No | Yes | All | - | No |
Radtke et al. (2009) | No | Guidelines and other sources | No | No | No | Yes Not detailed | Yes | Unclear | - | No |
Redberg et al. (2009) | Yes Public health relevance, costs, quality gap | One guideline | No | No | No | No | Yes | Selection | Unclear | No |
Schouten et al. (2005) | Yes Quality gap | Guidelines and other sources | No | No | No | No | Yes | Selection | No | Yes |
Sugarman et al. (2003) | Yes Quality of care unknown, regulatory requirements | One guideline | No | No | No | No | Yes | Unclear | - | No |
Thomas et al. (2007) | Yes Underutilization, quality of care unknown | Guidelines and other sources | No | No | Yes | Yes Not detailed | Yes | Selection | Yes Grade of recommendation, level of evidence | No |
Tu et al. (2008) | Yes Quality gap | Guidelines and other sources | No | No | Yes | No | Yes | Selection | Yes Meaningful, valid and reliable, feasible, accountable for patient variability, potential for improvement, | No |
van den Boogaard et al. (2010) | Yes Quality gap | One guideline | No | Yes Most recently revised guideline available | No | No | Yes | All | - | No |
van Hulst et al. (2009) | No | Guidelines and other sources | No | No | No | No | Yes | Selection | Yes Grade of recommendations | No |
Wang et al. (2006) | Yes Public health relevance, complex process of care, quality gap | Guidelines and other sources | No | No | Yes | No | No | Selection | Yes Impact on patient outcome, level of evidence, potential for improvement, feasibility of data collection | No |
Yazdany et al. (2009) | Yes Quality of care unknown | Guidelines and other sources | No | Yes Methodological quality | Yes | Unclear | No | Selection | Yes Eligible population, process of care performed by healthcare providers, impact on patient outcome | No |
Method + topic papers | Â | Â | Â | Â | Â | Â | Â | Â | Â | Â |
Advani et al. (2003) | No | One guideline | No | No | No | No | Yes | Unclear | - | No |
Duffy et al. (2005) | Yes Individual impact on quality of life, quality gap | More than one guideline | No | No | No | No | Yes | Selection | Yes Level of evidence, impact on patient outcome, breadth of available treatment recommendations, clinical utility and appropriateness, proportion of patients for whom the recommendation is likely to be relevant | No |
Golden et al. (2008) | Yes Public health relevance, costs, quality gap | Guidelines and other sources | Yes Profession involved in the selected health care process | No | No | No | No | Selection | Yes Level of evidence | No |
Hutchinson et al. (2003) | No | More than one guideline | No | Yes Evidence based | No | Yes Suitable for primary care, agency responsible for development clearly identifiable, objectives clearly defined, independent review prior to publication, information regarding evidence adequate and explicit, link between major recommendations and underlying evidence | Yes | Selection | Unclear | No |
Laclair et al. (2001) | No | One guideline | No | No | Yes | No | Yes | All | - | No |
Wollersheim et al. (2007) | Yes Quality gap, public health relevance, sound evidence base | Guidelines and other sources | Yes Membership in a guideline-development committee, methodological competence, profession involved in the selected healthcare process | No | No | No | Yes | Unclear | - | No |