Skip to main content

Table 3 Average-measure reliability coefficients for independent coders and experts

From: Preliminary testing of the reliability and feasibility of SAGE: a system to measure and score engagement with and use of research in health policies and programs

Aim Average-measure reliability G(q,k)
Domain Searching for research Research obtained Relevance appraisal Quality appraisal Generating new research Interacting with researchers Conceptual research use Instrumental research use Tactical research use Imposed research use
(A) Reliability between the two independent coders; q = 0, k = 2 0.85 0.88 0.74 0.88 0.93 0.84 0.76 0.77 0.85 0.87
(B) Reliability between the nine experts; q = 0.23, k = 3 0.77 0.83 0.46 0.74 0.66 0.65 0.58 0.49 0.71 0.89