Table 3 Average-measure reliability coefficients for independent coders and experts
Aim | Average-measure reliability G(q,k) | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
Domain | Searching for research | Research obtained | Relevance appraisal | Quality appraisal | Generating new research | Interacting with researchers | Conceptual research use | Instrumental research use | Tactical research use | Imposed research use |
(A) Reliability between the two independent coders; q = 0, k = 2 | 0.85 | 0.88 | 0.74 | 0.88 | 0.93 | 0.84 | 0.76 | 0.77 | 0.85 | 0.87 |
(B) Reliability between the nine experts; q = 0.23, k = 3 | 0.77 | 0.83 | 0.46 | 0.74 | 0.66 | 0.65 | 0.58 | 0.49 | 0.71 | 0.89 |