Table 3 EQUIP formative evaluation methods

   • Semi-structured interviews conducted by research personnel with intervention and control psychiatrist participants (n = 35): gathered data on psychiatrists' previous experience with research, their clinical practices, and expected barriers and facilitators of intervention components.

   • Self-report questionnaire completed by intervention and control psychiatrist participants (n = 44): gathered data on psychiatrists' training, attitudes, knowledge and skills related to schizophrenia and guidelines, and on workload.

Mid-implementation

   • Semi-structured qualitative interviews conducted by an independent contractor with a sub-sample of the intervention clinical and research staff (n = 18): gathered data on usefulness of the PopUps, in order to make any necessary changes that would enhance the remainder of the EQUIP intervention.

   • Computer System Usability Questionnaire [38] completed by sub-sample of intervention psychiatrist participants (n = 16): gathered quantitative data on experiences with the PopUps.

   • Quality Report survey completed by sub-sample of intervention psychiatrist participants (n = 8): provided data on uptake of the Quality Report they received quarterly.

Post-implementation

   • Semi-structured qualitative interviews conducted by research personnel with intervention and control clinical and research staff (n = 11): gathered data on psychiatrists' current clinical practices, barriers and facilitators of intervention components, especially the unsuccessful family component, satisfaction/dissatisfaction with the implementation program, and recommendations for future programs.

   • Self-report questionnaire completed by intervention and control psychiatrist participants (n = 14): gathered data on psychiatrists' attitudes, knowledge and skills related to schizophrenia and guidelines, their attitudes about recovery and family services, and on workload.