Table 4 Critical appraisal of eligible studies

Appraisal questions for survey

O’Rourke (2013) [66]

William (2013) [69]

Grady (2014) [64]

Hargis (2015) [65]

Chan (2005) [63]

Slot (2009) [67]

1

Did the study address a clearly focused question/issue?

Y

Y

Y

Y

Y

Y

2

Is the research method (study design) appropriate for answering the research question?

Y

Y

Y

Y

Y

Y

3

Is the method of selection of the subjects (employees, teams, divisions, organisations) clearly described?

U

Y

Y

Y

N

Y

4

Could the way the sample was obtained introduce (selection) bias?

N

N

N

U

N

N

5

Was the sample of subjects representative with regard to the population to which the findings will be referred?

N

N

Y

N

N

Y

6

Was the sample size based on pre-study considerations of statistical power?

N

Y

N

N

N

N

7

Was a satisfactory response rate achieved?

Y

N

N

Y

Y

Y

8

Are the measurements (questionnaires) likely to be valid and reliable?

N

Y

Y

N

N

N

9

Was the statistical significance assessed?

N

N

Y

N

N

N

10

Are confidence intervals given for the main results?

N

N

N

N

N

N

11

Could there be confounding factors that haven’t been accounted for?

N

N

N

N

N

U

12

Can the results be applied to your organisation?

N

U

N

N

N

Y

Yes (Y), Can’t Tell (U) and NO (N)

Critical Appraisal Questions for Qualitative Studies

Meurer (2011) [60]

Purvis (2014) [62]

1

Is there a congruity between the stated philosophical perspective and the research methodology?

N

N

2

Is there a congruity between the research methodology and the research question or objectives?

Y

Y

3

Is there a congruity between the research methodology and the methods used to collect the data?

Y

Y

4

Is there a congruity between the research methodology and the representation and analysis of data?

Y

Y

5

Is there a congruity between the research methodology and the interpretation of results?

Y

Y

6

Is there a statement locating the researcher culturally or theoretically?

Y

Y

7

Is the influence of the researcher on the research and vice versa addressed?

U

Y

8

Are participants, and their voices, adequately represented?

Y

Y

9

Is the research ethical according to current criteria or, for recent studies, is there evidence of ethical approval by an appropriate body?

Y

Y

10

Do the conclusions drawn in the research report flow from the analysis, or interpretation, of the data?

Y

Y

Yes (Y) No (N) Unclear (U) Not Applicable (NA)