Skip to main content

Table 2 Single-measure reliability coefficients for independent coders, experts, and between independent coders and experts

From: Preliminary testing of the reliability and feasibility of SAGE: a system to measure and score engagement with and use of research in health policies and programs

Aim

Single-measure reliability G(q,1)

Domain

Searching for research

Research obtained

Relevance appraisal

Quality appraisal

Generating new research

Interacting with researchers

Conceptual research use

Instrumental research use

Tactical research use

Imposed research use

(A) Reliability between the two independent coders; q = 0

0.74

0.78

0.58

0.78

0.86

0.73

0.62

0.62

0.74

0.76

(B) Reliability between the nine experts; q = 0.08;

0.57

0.63

0.25

0.50

0.41

0.40

0.35

0.25

0.47

0.62

(C) Reliability between the independent coders and the average of the experts; q = 0

0.75

0.69

0.48

0.76

0.73

0.64

0.55

0.57

0.70

0.76