Skip to main content

Advertisement

Table 3 Summary of preliminary results

From: The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation

Domain Construct Instruments per construct Stage of dev. Stage of dev. Percentage of instruments with definition Number of articles in packet
  N M Mode N(%) M(SD)
Implementation outcomesAcceptability463.11433 (71.74%)4.41 (4.11)
Adoption243.58121 (87.50%)1.58 (1.52)
Appropriateness71.0013 (42.86%)1.29 (1.10)
Feasibility141.0016 (42.86%)1.57 (1.46)
Penetration52.4015 (100%)2.60 (2.08)
Sustainability92.4416 (66.67%)1.67 (1.48)
Total 105  74 
Average 17.52.26170.48%2.19 (1.96)
Intervention characteristicsAdaptability14.001, 2, 3, 41 (100%)1.00 (1.00)
Complexity43.5013 (75.00%)1.00 (0.75)
Design quality and packaging00.0000 (0.00%)0.00 (0.00)
Evidence strength and quality41.7513 (75.00%)1.00 (0.75)
 Intervention source00.0000 (0.00%)0.00 (0.00)
 Relative advantage72.4315 (71.43%)1.00 (0.71)
 Trialability34.001, 6, 7, 82 (66.67%)1.00 (0.67)
Total 19  14 
Average 2.712.24173.68%0.71 (0.55)
Outer settingCosmopolitanism13.002, 6, 80 (0.00%)4.00 (0.00)
 External policy and incentives00.0000 (0.00%)0.00 (0.00)
 Patient needs and resources34.6762 (66.67%)1.00 (0.67)
 Peer pressure00.0000 (0.00%)0.00 (0.00)
Total 4  2 
Average 11.92650.00%1.25 (0.17)
Inner settingCombined94.4418 (88.89%)9.22 (8.20)
 Culture105.00110 (100%)4.44 (3.95)
 Implementation climate (IC)155.60114 (93.33%)6.93 (6.47)
   IC: tension for change00.0000 (0.00%)0.00 (0.00)
   IC: compatibility18.001, 2, 3, 4, 5, 6, 7, 81 (100%)11.00 (0.00)
   IC: relative priority12.001 and 61 (100%)3.00 (0.00)
   IC: organizational incentives and rewards45.751,6,7,84 (100%)3.00 (2.25)
   IC: goals and feedback00.0000 (0.00%)0.00 (0.00)
   IC: learning climate144.64114 (100%)9.29 (8.62)
 Networks and communications114.3619 (81.82%)5.17 (4.40)
 Readiness for implementation (RI)163.38113 (81.25%)2.74 (2.59)
   RI: leadership engagement45.751, 6, 7, 84 (100%)4.50 (3.38)
   RI: available resources23.001, 62 (100%)2.50 (1.25)
   RI: access to knowledge and information18.001, 2, 3, 4, 5, 6, 7, 81 (100%)7.00 (0.00)
 Structural characteristics23.501, 62 (100%)7.50 (3.75)
Total 90  83 
Average 6.004.23192.22%5.09 (2.99)
Characteristics of individualsKnowledge and beliefs about the intervention523.84231 (5.36%)4.48 (4.40)
 Individual stage of change62.8315 (83.33%)3.00 (2.50)
 Individual identification with the organization43.501, 43 (16.67%)2.83 (2.36)
 Other personal attributes342.65127 (5.26%)3.89 (3.79)
 Self-Efficacy43.7514 (100%)2.75 (2.06)
Total 98  70 
Average 19.63.31271.43%3.39 (3.02)
ProcessEngaging00.0000 (0.00%)1.00 (0.00)
   Engaging: opinion leaders00.0000 (0.00%)5.67 (3.78)
   Engaging: formally appointed internal implementation leaders00.0000 (0.00%)0.00 (0.00)
   Engaging: champions00.0000 (0.00%)0.00 (0.00)
   Engaging: external change agents17.001, 2, 3, 5, 6, 7, 81 (100%)10.00 (0.00)
 Executing15.001, 2, 6, 7, 81 (100%)2.00 (0.00)
 Planning212.14113 (61.90%)7.25 (6.99)
 Reflecting and evaluating200.0309 (45.00%)2.70 (2.22)
Total 54  24 
Average 6.751.77144.44%3.58 (1.62)
Client outcomesSatisfaction102.801, 3, 4, 54 (40.00%)4.43 (4.11)
  1. Stages of dev. means the stages of development through which the instrument passed based on an eight-stage coding system describe in the text. It is important to note that these stages are not necessarily linear, meaning that an instrument need not pass through stage one to enter stage two and so forth. Rather, instruments received a point for any of the stages the instrument passed through. Finally, these ratings are reflective of the instruments’ quality at its inception (i.e., based on its source article) and are not necessarily indicative of the instruments’ current psychometric strength.