- Study protocol
- Open Access
Collaborative planning approach to inform the implementation of a healthcare manager intervention for hispanics with serious mental illness: a study protocol
Implementation Science volume 6, Article number: 80 (2011)
This study describes a collaborative planning approach that blends principles of community-based participatory research (CBPR) and intervention mapping to modify a healthcare manager intervention to a new patient population and provider group and to assess the feasibility and acceptability of this modified intervention to improve the physical health of Hispanics with serious mental illness (SMI) and at risk for cardiovascular disease (CVD).
The proposed study uses a multiphase approach that applies CBPR principles and intervention-mapping steps--an intervention-planning approach--to move from intervention planning to pilot testing. In phase I, a community advisory board composed of researchers and stakeholders will be assembled to learn and review the intervention and make initial modifications. Phase II uses a combination of qualitative methods--patient focus groups and stakeholder interviews--to ensure that the modifications are acceptable to all stakeholders. Phase III uses results from phase II to further modify the intervention, develop an implementation plan, and train two care managers on the modified intervention. Phase IV consists of a 12-month open pilot study (N = 30) to assess the feasibility and acceptability of the modified intervention and explore its initial effects. Lastly, phase V consists of analysis of pilot study data and preparation for future funding to develop a more rigorous evaluation of the modified intervention.
The proposed study is one of the few projects to date to focus on improving the physical health of Hispanics with SMI and at risk for CVD by using a collaborative planning approach to enhance the transportability and use of a promising healthcare manager intervention. This study illustrates how blending health-disparities research and implementation science can help reduce the disproportionate burden of medical illness in a vulnerable population.
This manuscript describes an innovative, collaborative intervention-planning approach that capitalizes on both researchers' and stakeholders' knowledge and skills to inform pre-implementation work to transport a promising healthcare manager intervention to a new patient population and provider group. Our approach builds upon the growing interest in using community-based participatory research (CBPR) as a translational strategy to bridge the gap between research and practice in underserved diverse communities in the United States in order to reduce health inequities . We combined principles from CBPR (e.g., capacity building, ownership) and an intervention mapping (IM)--a step-by-step systematic framework for intervention planning, implementation, and evaluation --to modify and assess the feasibility and acceptability of an existing care manager (CM) intervention to improve the physical health of Hispanics with serious mental illness (SMI; e.g., schizophrenia) and at risk for cardiovascular disease (CVD).
Compared to non-Hispanic whites with SMI, Hispanics with SMI have higher rates of obesity , diabetes [4, 5], and other metabolic risk factors[6, 7], placing them at elevated risk for CVD. These health needs are exacerbated by the fact that Hispanics with SMI and at risk for CVD are less likely to engage and receive high-quality medical care, even against the backdrop of the poor-quality care received by people with SMI . Despite higher risk and disparities in care, limited attention has been paid to the process of making interventions shown to improve the physical healthcare of people with SMI, such as CM interventions, culturally relevant to Hispanics with SMI. Cultural modifications are important because unique sociocultural factors (e.g., cultural norms) influence access and quality of care, and the provision of culturally sensitive care increases engagement and treatment retention . Provider-level modifications are also needed because many public mental health systems--the main source of healthcare for Hispanics with SMI --lack sufficient numbers of registered nurses (RNs) [11, 12], the provider group for whom these interventions have been designed. The absence of an established approach for systematically conducting intervention modifications and pre-implementation work in order to expand the intervention's use with a new patient population and provider group without compromising its effectiveness constitutes an implementation research gap. This study uses a collaborative planning approach that blends principles of CBPR and IM to modify and assess the feasibility and acceptability of an existing CM intervention to improve the physical health of Hispanics with SMI and at risk for CVD.
The specific aims of this study are as follows:
Use a collaborative intervention-planning framework to conduct intervention modifications.
Pretest intervention methods and materials with Hispanics with SMI and at risk for CVD.
Identify stakeholders' views of factors impacting the acceptability and sustainability of the modified intervention.
Pilot test the feasibility and acceptability of the modified intervention and initially explore its effect.
Care manager interventions
CM interventions are a cornerstone of initiatives to improve the health of people with multiple and complex physical and mental health conditions [13–15]. CM interventions improve receipt of primary care services, social functioning, independent living skills, and the quality of life of people with SMI and medical conditions linked to CVD (e.g., hypertension) [16, 17]. The Primary Care, Access Referral and Evaluation (PCARE), a CM intervention developed by one of the authors (BGD), focuses on improving patient activation and the coordination of medical care between outpatient mental health clinics and primary care. In a recent randomized controlled trial, the intervention was found to double the rate of receipt of preventive medical care and to improve the quality of cardiometabolic care and mental-health-related quality of life among adults with SMI . CMs do not provide direct medical services; instead, they work individually with patients in the mental health clinic to provide education and activation and to connect patients to primary care, as well as coordinate their medical care between mental health and primary care providers.
Adapting the intervention to a new patient population and provider group
Adapting any healthcare intervention to a new population requires consideration of both sociocultural and system-level factors that can affect its uptake. Adapting PCARE to Hispanics provides an example of attention to both patient and system-level considerations.
First, unique sociocultural factors that impact patient activation and care coordination--core elements of CM interventions--need to be examined and incorporated into the intervention to ensure its acceptability, feasibility, and effectiveness in the new population. Sociocultural adaptations involve surface- and deep-level modifications . Surface modifications entail matching intervention materials, messages, and content to the observable characteristics of the new patient population in order to enhance the intervention's "face validity." Examples of surface elements include delivering the program in the patient's dominant language (e.g., Spanish) to reduce language barriers and drafting all patient educational materials at the appropriate reading level (e.g., fourth grade) to enhance health literacy. Surface adaptations are a prerequisite, but they may not be sufficient to attain cultural sensitivity; thus, deep-level modifications are required.
Deep-level modifications entail identifying and incorporating into the intervention patients' cultural values, understandings, and preferences that impact core intervention elements . The qualitative research conducted by our team with six behavioral health organizations in the Northern Manhattan communities of New York City serving Hispanics and African Americans with SMI illustrates how sociocultural factors impact patient activation and care coordination . The medical encounter itself, for example, is shaped by cultural factors. We found that many Hispanics with SMI, who are disenfranchised due to their mental illness and minority status, feel that it is inappropriate and disrespectful to directly question their doctors' advice. CMs need to recognize this deference to authority and adapt their patient-activation techniques accordingly, such as by modeling appropriate interactions with providers and helping patients formulate a list of questions before their medical visit . Similarly, we found that body image varies across cultures, with some Hispanic patients favoring a fuller body ideal [22, 23]. Unaddressed, this can lead to the perception among Hispanics that medical recommendations that focus on thinness may be culturally insensitive. CMs can deal with this by assessing patients' explanatory models of illness and using this information to present medical goals congruent with patients' views (e.g., focusing on health rather than thinness). Also, in contrast with many white consumers, most Hispanics with SMI live with their families [24–26], who are involved in their medical care. This suggests that family members should be included in medical care decisions, as appropriate, to enhance this source of support. These examples illustrate the kind of deep modifications needed to ensure that the intervention is congruent with patients' culture, without diluting its effectiveness [19, 27].
Second, whereas PCARE was developed for use with RNs, these practitioners were in short supply both in our study site and in other sites where Hispanics with SMI receive their care . In our study site, for example, social workers (SWs) outnumber RNs 2.5:1. Since CMs provide no direct medical care, our plan to modify the intervention to SWs is appropriate and essential to increase applicability to the target population. SWs are a natural fit for the CM role because they  deliver approximately 60% of the mental healthcare in the United States , particularly in the public system;  can bill for care management functions at our study site; and  work closely with minority communities. Their expertise in counseling and systems navigation match the skills required for effective care management. Multiple studies have demonstrated the effectiveness of SWs as CMs across a range of mental and physical illnesses [29–32]. To modify PCARE for SWs requires that they receive extra training on how to use existing guidelines to monitor and coordinate the management of the physical health needs of people with SMI , deliver appropriate physical health information to patients, and coordinate medical care between mental health and primary care providers. SWs will also require more intense clinical training on how to manage the medical needs of patients with complex medical problems. Due to medical and legal regulations, SWs will need more structured and regular supervision and involvement from existing RNs and/or primary care providers.
Lastly, the addition of this intervention to the study site requires attention to providers' attitudes and expectations about the intervention and identifying what resources are needed to accommodate the intervention into routine practice. More generally, adapting interventions to vulnerable ethnic subpopulations calls for close attention to not only cultural factors but also to these provider and system-level considerations.
Collaborative planning approach
Figure 1 presents the collaborative framework for this study, which blends CBPR principles and IM procedures to plan and implement these cultural and system-level modifications. CBPR in intervention research can be conceptualized as a translational strategy that focuses on co- learning, engendering ownership, and two-way capacity building among all partners to address a shared health concern and develop sustainable solutions . CBPR differs from other knowledge translational approaches for its emphasis on community members' participation as equal contributors in creating knowledge and skills that inform the implementation process [34–36]. According to Wallerstein and Duran , CBPR enhances the potential of implementation sciences in diverse communities through the use of strategies that "redress power imbalances, facilitate mutual benefits among community and academic partners, and promote reciprocal knowledge translation incorporating community theories into the research" (p. S1). CBPR principles in our framework include a focus on a shared health concern identified by our community partners, formation of a community advisory board (CAB) of community and academic partners to maximize the relevance of the intervention and incorporate community knowledge and wisdom into the implementation process, and involving partners in all modification steps to enhance their capacity for adopting and using the intervention.
Although CBPR approaches have been used to modify interventions to address health disparities [37, 38], the procedures for how to carry this out remain unspecified and difficult to replicate. Clear guidelines and procedures are needed to help community members and researchers move through a collaborative process to plan, implement, and evaluate health interventions (see Belansky and colleagues  for a recent example). Our collaborative framework addresses this limitation by using IM in a CBPR partnership (see Additional file 1) . IM "road maps" planners' moves from theory to practice. It uses core processes (e.g., brainstorming, literature reviews, data collection) and visual tools, such as logic models and matrices of performance objectives, to clarify intervention goals and how to attain intended outcomes . Similar to CBPR, IM relies on bringing together a planning team or linkage system that includes researchers, program participants, potential program users, and other stakeholders to inform intervention planning, implementation, and evaluation. Most IM projects to date have tended to be driven by researchers and/or public health interventionists . More recently, several teams have begun to incorporate community members' participation and leadership into the process [39, 41]. Our approach will build upon these recent examples.
The six steps of IM that inform intervention modifications are  problem analysis,  review of intervention objectives and theoretical foundations,  modification of intervention methods and strategies,  development of a revised intervention,  development of an implementation plan, and  evaluation . Each step includes specific tasks leading to a product (e.g., logic model) that is the basis for the next step. The result is an "intervention map" consisting of tables, logic models, and written plans that guide the modification, implementation, and evaluation of the intervention . We chose IM over other adaptation models [43–45] because  it relies on group members' input throughout the entire process;  at each step the goals of the intervention are emphasized, engendering participation of CAB members with divergent backgrounds; and  it develops an implementation plan, composed of objectives and strategies, that supports the adoption and use of the intervention in a new context. In sum, this collaborative framework provides a structured and participatory platform for directing intervention modifications and pre-implementation work.
The Washington Heights Community Service (WHCS) of the New York State Psychiatric Institute will serve as the study site and community partner. WHCS is a state-run public mental health clinic located in the largest Hispanic community in New York state; its catchment area is approximately 74% Hispanic, mostly first-generation Dominican. About one-third of residents live in poverty, 31% lack health insurance, and 25% lack a regular medical home . WHCS serves those members of the community that are most disenfranchised as a result of SMI. In 2008, WHCS had 1,030 patients, of whom 75% were Hispanics, 40% were male, and 90% had schizophrenia-spectrum or bipolar disorder. A study of 69 WHCS patients (78% Hispanic) revealed their poor health status . Although 67% had had a physical exam over the past year, 89% of women and 59% of men were overweight/obese (body mass index > 25 kg/m2). Many had elevated rates of CVD risk factors: hypertension (29%), hyperlipidemia (22%), and diabetes (17%). The proposed modified CM program aims to help address these needs.
Study design overview
The project will use a multiphase approach (see Table 1) that applies IM steps to move from intervention planning to pilot testing. Study phases are described below.
During phase I, we will assemble the CAB composed of one primary care physician, one WHCS social worker, two consumer advocates (e.g., former consumers), one clinic administrator, and the research team to inform all phases of the project. Use of a CAB is an established CBPR strategy for modifying interventions as it helps frame and monitor the progress of the project and provides guidance on cultural values and practices as well as community assets that deepen the contextualization of the intervention . The CAB will meet monthly during phase I and every three months through phases II-V. IM steps 1-3 will be completed in this phase. IM step 1 (problem analysis) entails deepening CAB members' understanding of the physical health needs of Hispanics with SMI by reviewing existing literature, discussing results of a pilot qualitative study on the physical health needs of minorities with SMI , and discussing the capacity of the study site and other community agencies to address these needs. We will also discuss how to address possible provider-level barriers, such as primary care doctors' stigma and reluctance to work with patients with SMIs and the lack of communication between primary care and mental health providers. IM step 2 (review of intervention objectives and theoretical foundations) involves learning and reviewing intervention components. Intervention objective tables will be constructed to specify the links between each intervention objective and the methods used to achieve it. The CAB will determine whether objectives and determinants of these objectives need to be added or deleted without compromising intervention effectiveness and whether the intervention methods are practical and appropriate for the new patient population and provider group to achieve desired outcomes. In IM step 3 (modification of intervention methods and strategies), we will use results from patient focus groups (FGs) and stakeholder interviews (see below) to guide initial modifications. We expect to make several modifications at this stage, such as translating PCARE materials into Spanish, developing a community resource guide to the Washington Heights neighborhood, adding explanatory model questions about consumers' physical health problems to the assessment tool, and developing strategies to involve family members in CM sessions.
Another likely modification is to supplement the intervention with culturally and linguistically appropriate patient education tools, such as health-related fotonovelas[48, 49]. Fotonovelas use posed photographs, text bubbles with simple text, and soap opera narratives to engage patients and raise their knowledge about specific medical conditions (e.g., diabetes) and lifestyle changes. At the end of phase 1, we will have an initial modified version of PCARE.
During this phase we will continue IM step 3 and use qualitative methods (patient FGs and stakeholder interviews) to pretest our initial modifications and ensure their feasibility and acceptability.
Patient focus groups
Four patient FGs conducted at the WHCS will be used to pretest the intervention methods and materials. Each FG will last 90 minutes and will consist of 8-10 patients who meet inclusion criteria for participation in the intervention. We will recruit up to 40 adult Hispanic patients with SMI and at risk for CVD at WHCS through flyers, word of mouth, and provider/peer referrals. Eligible patients are active patients at WHCS who are 18 years of age or older; self-identify as Hispanic; speak English or Spanish; and have chart diagnoses of schizophrenia, schizoaffective disorder, or bipolar disorder and have at least one CVD risk factor (body mass indent > 25 kg/m2], diabetes mellitus, hypertension, or hyperlipidemia). CVD risk factors are mandated by the New York State Office of Mental Health (OMH) to be part of patient medical records. We will exclude patients who are in need of detoxification; are at acute risk of suicide or homicide; fail a capacity-to-consent questionnaire ; or are cognitively impaired, as detected on the Mini-Cog Examination, which does not require English fluency or formal education . To accommodate patients' language preferences, FGs will be conducted in Spanish or English. LJC will facilitate all FGs. FGs will be audiotaped and transcribed. A FG guide of six to eight open-ended questions developed with input from the CAB and implementation research consultants will be used to elicit patients' views about intervention materials and methods. Questions will explore patients' views about the acceptability, feasibility, and cultural appropriateness--particularly among the main Hispanic subgroups in our study site (Dominicans and Mexicans)--of the intervention, including suggestions for improvement.
Twenty stakeholder semi-structured qualitative interviews will be conducted to examine the acceptability and sustainability of the modified intervention in a public mental health system. A purposive sample of stakeholders will be obtained, including five mental health clinicians, five primary care physicians, five consumer advocates, and five administrators. The aims of these interviews are to identify factors that facilitate or impede the acceptability and sustainability of the intervention and identify strategies to maximize its acceptability and sustainability (e.g., adding a CM training curriculum for SWs). Interviews will last 60 minutes and will be conducted by LJC or a trained research assistant (RA) in person or via telephone to accommodate participants' availability. The option of telephone interviews enables us to reach stakeholders across New York state. Interviews will be audiotaped and transcribed. Participants will be stakeholders who are at least part-time employees at their organizations and consumer advocates who are involved in the OMH advisory committees. Recruitment strategies include presentations at OMH meetings focusing on physical/mental health integration and referrals from the Director of Research at the OMH. An interview guide will be developed with input from the CAB and the implementation and qualitative consultants. Questions will explore factors and barriers that influence an intervention's acceptability and sustainability, such as characteristics of the intervention (e.g., complexity, cost), the organization's financial resources and openness to change, staff's capacity, knowledge, self-efficacy, and competing demands .
IM steps 4 and 5 will be completed in this phase in order to further modify the intervention, develop an implementation plan, and train two SWs from the study site on the modified intervention. IM step 4 (development of revised intervention) will entail using phase II findings to reexamine, and if necessary reconstruct, program objective tables developed in phase 1. This process will include CAB review of salient themes that emerged from phase II FGs and interviews, refinement of the program's logic model of change, and discussions about revising objectives, methods, and/or strategies. To ensure that modifications do not compromise intervention core elements, revisions will be presented and discussed with the second author (BD), the PCARE developer. The goal of this step is for the CAB to determine if intervention objectives and methods should be unchanged, deleted, revised, or added. Table 2 presents examples of possible modifications.
During IM step 5 (development of implementation plan), the CAB will formulate specific implementation objective tables and methods. In this step, the CAB will (a) discuss themes that emerged from phase II interviews and FGs regarding intervention acceptability, feasibility, and sustainability; (b) identify existing resources (e.g., connections with primary care clinics) that facilitate intervention implementation; and (c) develop a performance objective table that links each implementation objective to the methods used to accomplish it. The goal is to write a detailed plan of what needs to be done to ensure the intervention is delivered at acceptable levels of fidelity and completeness. The plan will include CM tracking forms to log frequency, number, and types of patients' contacts and clinical services. These will serve as fidelity indicators for structural and clinical elements of the intervention .
Once the revised intervention is finalized, two SWs will be trained. Training will consist of four 90-minute education sessions that combine didactic presentations and interactive hands-on activities, such as role-playing, teach-back, and practice exercises. The training will be taught by intervention developers and other project consultants who are experts in primary care and cardiovascular care. The sessions will be based on the intervention materials, the American Heart Association guidelines for managing CVD risk factors , and the New York City Department of Health and Mental Hygiene continuing education modules that review existing guidelines for monitoring the physical health of adults with SMI . Training topics include ascertainment of CVD risk factors; monitoring these risk factors in an SMI population; learning how to correctly obtain simple body composition measures (e.g., weight, height), blood pressure assessment, and a basic medical history; developing patient education skills to boost patient recall and comprehension using teach-back techniques ; basics of motivational interviewing techniques; use of action plans ; and coordination with local medical care services. We will also develop and train SWs on how to follow specific clinical protocols to manage possible medical emergencies (e.g., myocardial infarction, diabetic ketoacidosis) that require immediate attention by a medical provider (e.g., clinic's nurse, emergency department). Lastly, during the pilot trial (see below) the two SWs will receive supervision every two weeks from the project primary care consultant, an experienced family physician, who will also provide clinical backup in case of medical emergencies. During these meetings, SWs will review patients' initial assessment and stated health goals and identify additional health needs, potential barriers to care, and strategies for ensuring receipt of services. An individualized patient report will be generated that identifies key medical issues, providers, and contacts, as well as short- and long-term goals. A copy of this report will be given to the patient, and if the patient consents, added to his/her medical records and given to his/her primary care provider.
This phase will complete IM step 6 (evaluation) with a single group, pre-post, 12-month open pilot study (N = 30) carried out at WHCS. Two SW CMs will deliver the modified intervention, each carrying a caseload of 15 patients. Thirty adult Hispanic patients with SMI will be recruited. Inclusion and exclusion criteria are identical to those in phase IV. Based on the PCARE study recruitment rate of 69%, we will screen at least 45 patients to achieve our recruitment goal. A bilingual RA will recruit patients at WHCS through flyers, canvassing of waiting rooms, word of mouth, and provider referrals. We have allocated 18 months to this phase, which provides a six-month cushion for unanticipated problems with recruitment and attrition. Descriptions of the proposed measures for this study are presented in Table 3. As part of the planning process for this phase, the CAB will assess the appropriateness of these outcome measures for the intended patient population and, if necessary, identify other culturally relevant measures for key constructs (e.g., acculturation, health literacy, illness perceptions).
The primary outcomes of the pilot study are feasibility and acceptability. Two post-intervention FGs will be conducted with study participants to explore their reactions to the intervention. Each FG will be composed of 8-10 patients and follow the FG methods described in phase II. Although this is not an efficacy trial, we would be remiss in not taking this opportunity to initially explore the intervention's effect, as measured by patient activation, receipt of preventive primary care, and physical- and mental-health-related quality of life. Covariates include demographics, acculturation, barriers to care, and comorbid medical conditions. The RA will assess patients at baseline, 6 months, and 12 months. Self-report measures and medical chart abstractions will be obtained. Patients will be asked for consent to access medical records at WHCS and their primary care clinic. The RA will conduct these abstractions under LJC's supervision.
This final phase will consist of analysis of pilot study data, incorporation of pilot findings into the refinement of the modified intervention, and preparation for future funding to develop a more rigorous evaluation of the intervention. A concurrent triangulation approach  will be used to integrate qualitative and quantitative data generated from this pilot. A set of questions will guide this data integration process to identify themes, patterns, and conflicts: What patterns emerge from each set of findings? Do they converge? If not, what are their discrepancies and what additional data and analysis are needed to understand these discrepancies? All study results will be presented and discussed with the CAB to inform next steps and future plans.
Quantitative data entry and analysis will utilize SAS version 9.1.3 (SAS Institute, Inc., Cary, NC, USA). ATLAS.ti (ATLAS.ti Scientific Software Development GmBH, Berlin, Germany), a qualitative data management software , will be used to manage and analyze all qualitative data.
All tests will be two-sided and performed at significance level α = 0.05.
Preliminary analyses will consist of examining distributions of all baseline variables, identifying outliers, and calculating descriptive statistics. For longitudinal data, we will examine the distributions and calculate descriptive statistics for variables relevant to study aims at each time point. Proper transformation will be considered to meet assumptions of parametric models. Graphics will be used to explore bivariate associations, especially patterns over time for variables of interest.
Accounting for missing data in the analysis
If a patient drops out of the study, we will record the stated reasons for dropout and make all efforts to obtain a final assessment. Failing this, the end-of-treatment assessment will be the patient's last scheduled assessment. The analysis of acceptability as measured by the Client Satisfaction Questionnaire (CSQ) will be based on a multilevel model with subject-specific random intercepts. For analyses that include missing outcomes, PROC MIXED in SAS allows for continuous data that may be missing for some patients due to lack of completion of assessments. Measurement at each time point on each patient contributes to the analysis. Thus, complete outcome information for all patients at all sessions is not needed. For analyses that include missing covariates, we will use multiple imputation to account for missing data. The inferences from incomplete data are valid, provided the missing data are missing at random . Unfortunately, this assumption is untestable in most medical research. When we suspect this assumption does not hold, we will assume a model for the missing mechanism that depends on the unobserved outcome value and do the analysis incorporating the assumed model and conduct sensitivity analysis [60–62].
To evaluate feasibility, we will estimate recruitment rate, assessment completion rate, and treatment attendance rate by sample proportions and provide their standard errors based on binomial distribution. We will evaluate acceptability by assessing patient satisfaction (CSQ scores) repeatedly over time (baseline, 6 months, and 12 months). We will analyze improvement in patient satisfaction by a linear mixed-effects model with random subject-specific intercepts to handle correlation between repeated measurements of the outcomes. We will include time as predictor of interest. Significance of improvement in satisfaction over time will be assessed by testing whether the slope of time is zero.
To explore the initial effect of the CM intervention, we will assess average level of patient activation, rates of guideline-concordant preventive primary care use, and physical- and mental-health-related quality of life. We will provide confidence intervals for these estimates.
Since this is a pilot study for a future large randomized trial, we did not conduct a power analysis in accordance with recommendations in the new National Institutes of Health guidelines http://grants.nih.gov/grants/guide/pa-files/PAR-09-173.html and Kraemer and Kupfer . Instead, we conducted precision analysis for the main study outcomes--feasibility and acceptability--by computing margin of error of an estimated rate to assess the precision that can be achieved by the proposed sample size. Margin of error is half the width of a confidence interval of an estimator. The smaller the margin of error, the tighter the confidence interval and the more precision we achieve for an estimator. We used the original PCARE  study treatment and completion assessment rates to estimate standard errors and margins of errors. PCARE's observed treatment completion rate was 0.68, with a sample size of 30, the standard error was 0.085 and the margin of error was 0.167. PCARE's observed assessment completion was 0.78 at 6 months and 0.69 at 12 months, the corresponding standard error is 0.076 and 0.084, respectively, and the margin of error is 0.15 and 0.17, respectively. For the CSQ scores (acceptability measure), when the standard deviation of the improvement of CSQ is 1, 2, or 4 points, the corresponding margin of error for estimating mean improvement is 0.18, 0.36, and 0.72, respectively. In all, our precision analysis indicates we have small margin of errors for each of our main study outcomes.
All FGs and stakeholder interviews will be transcribed. The RA will review all transcripts while listening to the recordings to fix errors. Clean transcripts will be entered into ATLAS.ti. A grounded theory approach will inform the analysis [64–66]. LJC and the RA will independently read all transcripts and develop an open coding schema based on a priori and emergent themes. Each code condenses the data into analyzable units, ranging from a phrase to paragraphs. They will then meet with the project qualitative consultant to present their coding schemes, discuss emergent themes, refine codes, and develop a final codebook that consists of a list of categories and topics. We will use ATLAS.ti to mark instances where each code occurs in the data. To establish coding reliability, both LJC and the RA will independently code up to 10% of the transcripts. They will meet weekly during this process to review definitions and assignment of codes and resolve differences through consensus by checking the segment of transcript in question. Successive coding sessions will continue until an agreement of 85% or greater in codes applied is reached. Once this rate is maintained, a single rater will code the rest of the data. Additional analyses will include identification of subthemes and descriptions of the range and salience of themes. Established procedures to enhance the trustworthiness of our analysis will be used, including analyses of negative cases that do not fit our coding scheme, development of an audit trail documenting analytical decisions, and member-checking presentations to the CAB . Qualitative results will be used to inform both surface- and deep-level modifications to enhance the cultural relevance of the intervention. Moreover, results from stakeholder interviews will enable us to identify implementation barriers as well as implementation strategies that need to be taken into consideration as we develop the implementation plan in phase III. In sum, the qualitative analysis is intended to provide insights into contextual factors that can inform intervention planning and implementation.
This study will contribute to the advancement of implementation science by developing a collaborative approach that blends CBPR principles and IM procedures for overcoming barriers to the modification, pre-implementation, and use of evidence-based approaches in real-world settings. This study's strengths and innovations include  the testing of an innovative strategy for modifying interventions to vulnerable ethnic subgroups;  the preparation of an intervention for Hispanics with SMI that is urgently needed to address physical health disparities that have received limited attention;  the modification of a promising intervention to a different provider group that can improve access to preventive primary care, reduce risk for CVD, and reduce premature mortality among Hispanics with SMI; and  the engagement of stakeholders in a collaborative effort to enhance the transportation of evidence-based interventions to underserved racial and ethnic minorities with SMI.
Several study limitation must be noted. This study will be conducted in one public outpatient mental health clinic located in northern Manhattan in New York City, thus limiting its generalizability to other urban areas in the United States. Cultural modifications to the intervention will focus on Hispanic adults with SMI, predominantly of Dominican or Mexican descent. Future studies are needed to examine whether these modifications are appropriate with other Hispanic groups. The open trial design of our pilot study will not permit us to test the efficacy of the modified healthcare manager intervention or to identify mechanisms of change. We plan to use the results of the pilot study to inform the design of a more rigorous effectiveness trial of the modified intervention with a larger sample of Hispanic patients.
The collaborative planning framework that guides the proposed study could be used to modify and prepare other health interventions for vulnerable populations and advance implementation science by developing a systematic approach for helping to close the gap between research and practice in order to reduce health inequities in underserved communities. The adapted intervention will be one of the few to date to focus on a critical public health issue, improving the physical health of Hispanics with SMI and at risk for CVD. In sum, this study blends health-disparities research and implementation science to help reduce the disproportionate burden of medical illness and poor quality of medical care experienced by Hispanics with SMI.
Wallerstein N, Duran B: Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010, 100 (Suppl 1): S40-6.
Bartholomew LK, Parcel GS, Kok G: Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Educ Behav. 1998, 25 (5): 545-63. 10.1177/109019819802500502.
Hellerstein DJ, Almeida G, Devlin MJ, Mendelsohn N, Helfand S, Dragatsi D, Miranda R, Kelso JR, Capitelli L: Assessing obesity and other related health problems of mentally ill Hispanic patients in an urban outpatient setting. Psychiatr Q. 2007, 78 (3): 171-81. 10.1007/s11126-007-9038-y.
Cabassa LJ, Lewis-Fernández R, Castroman J, Blanco C: Racial and ethnic differences in diabetes among individuals with psychiatric disorders: Results from the National Epidemiologic Survey on Alcohol and Related Conditions. Gen Hosp Psych. 2011, 33 (2): 107-115. 10.1016/j.genhosppsych.2010.11.011.
Lambert BL, Chou CH, Chang KY, Tafesse E, Carson W: Antipsychotic exposure and type 2 diabetes among patients with schizophrenia: a matched case-control study of California Medicaid claims. Pharmacoepidemiol Drug Saf. 2005, 14 (6): 417-25. 10.1002/pds.1092.
Kato MM, Currier MB, Gomez CM, Hall L, Gonzalez-Blanco M: Prevalence of Metabolic Syndrome in Hispanic and Non-Hispanic Patients With Schizophrenia. Prim Care Companion J Clin Psychiatry. 2004, 6 (2): 74-7. 10.4088/PCC.v06n0205.
McEvoy JP, Meyer JM, Goff DC, Nasrallah HA, Davis SM, Sullivan L, Meltzer HY, Hsiao J, Scott Stroup T, Lieberman JA: Prevalence of the metabolic syndrome in patients with schizophrenia: baseline results from the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) schizophrenia trial and comparison with national estimates from NHANES III. Schizophr Res. 2005, 80 (1): 19-32. 10.1016/j.schres.2005.07.014.
Nasrallah HA, Meyer JM, Goff DC, McEvoy JP, Davis SM, Stroup TS, Lieberman JA: Low rates of treatment for hypertension, dyslipidemia and diabetes in schizophrenia: data from the CATIE schizophrenia trial sample at baseline. Schizophr Res. 2006, 86 (1-3): 15-22. 10.1016/j.schres.2006.06.026.
Fisher TL, Burnet DL, Huang ES, Chin MH, Cagney KA: Cultural leverage: interventions using culture to narrow racial disparities in health care. Med Care Res Rev. 2007, 64 (5 Suppl): 243S-82S. 10.1177/1077558707305414.
Alakeson V, Frank RG, Katz RE: Specialty care medical homes for people with severe, persistent mental disorders. Health Aff. 2010, 29 (5): 867-73. 10.1377/hlthaff.2010.0080.
Buerhaus PI, Donelan K, Ulrich BT, Norman L, Dittus R: State of the registered nurse workforce in the United States. Nursing Economics. 2006, 4 (1): 6-12.
Stuhlmiller CM: Promoting student interest in mental health nursing. Journal of the American Psychiatric Nurses Association. 2006, 11 (6): 355-8.
Bedenheimer T, Berry-Millett R: Care management of patient with complex health care need: Research synthesis report, NO 9. 2009, Roberto Wood Johnson Foundation
Institute of Medicine: Improving Quality of Health Care for Mental and Substance use Conditions: Quality Chasm Series. Washington D.C. 2006
Parekh AK, Barton MB: The challenge of multiple comorbidity for the US health care system. Jama. 2007, 303 (13): 1303-4.
Bartels SJ, Forester B, Mueser KT, Miles KM, Dums AR, Pratt SI, Sengupta A, Littlefield C, O'Hurley S, White P, Perkins L: Enhanced skills training and health care management for older persons with severe mental illness. Community Ment Health J. 2004, 40 (1): 75-90.
Kilbourne AM, Post EP, Nossek A, Drill L, Cooley S, Bauer MS: Improving medical and psychiatric outcomes among individuals with bipolar disorder: a randomized controlled trial. Psychiatr Serv. 2008, 59 (7): 760-8. 10.1176/appi.ps.59.7.760.
Druss BG, von Esenwein SA, Compton MT, Rask KJ, Zhao L, Parker RM: A randomized trial of medical care management for community mental health settings: the Primary Care Access, Referral, and Evaluation (PCARE) study. Am J Psychiatry. 2010, 167 (2): 151-9. 10.1176/appi.ajp.2009.09050691.
Resnicow K, Baranowski T, Ahluwalia JS, Braithwaite RL: Cultural sensitivity in public health: defined and demystified. Ethn Dis. 1999, 9 (1): 10-21.
New York State Center of Excellence for Cultural Competence: Sociocultural factors affecting the integration of physical health and mental health services for consumers with serious mental illness from underserved racial and ethnic groups. 2010, New York New York State Psychiatric Institute
Alegría M, Polo A, Gao S, Santana L, Rothstein D, Jimenez A, Hunter ML, Mendieta F, Oddo V, Normand SL: Evaluation of a patient activation and empowerment intervention in mental health care. Med Care. 2008, 46 (3): 247-56. 10.1097/MLR.0b013e318158af52.
Caballero AE: Type 2 diabetes in the Hispanic or Latino population: challenges and opportunities. Curr Opin Endocrinol Diabetes Obes. 2007, 14 (2): 151-7. 10.1097/MED.0b013e32809f9531.
Diaz VA, Mainous AG, Pope C: Cultural conflicts in the weight loss experience of overweight Latinos. Int J Obes. 2007, 31 (2): 328-33. 10.1038/sj.ijo.0803387.
Barrio C, Yamada AM, Atuel H, Hough RL, Yee S, Berthot B, Russo PA: A tri-ethnic examination of symptom expression on the positive and negative syndrome scale in schizophrenia spectrum disorders. Schizophr Res. 2003, 60 (2-3): 259-69. 10.1016/S0920-9964(02)00223-2.
Kopelowicz A: Adapting social skills training for Latinos with schizophrenia. International Review of Psychiatry. 1998, 10: 47-50. 10.1080/09540269875087.
Guarnaccia PJ: Multicultural experiences of family caregiving: a study of African American, European American, and Hispanic American Families. New Dir Ment Health Serv. 1998, 77: 45-61.
Kreuter MW, Lukwago SN, Bucholtz RD, Clark EM, Sanders-Thompson V: Achieving cultural appropriateness in health promotion programs: targeted and tailored approaches. Health Educ Behav. 2003, 30 (2): 133-46. 10.1177/1090198102251021.
Ivey SL, Scheffler R, Zazzali JL: Supply dynamics of the mental health workforce: implications for health policy. Milbank Quarterly. 1998, 76 (1): 25-58. 10.1111/1468-0009.00078.
Ell K, Katon W, Xie B, Lee PJ, Kapetanovic S, Guterman J, Chou CP: Collaborative care management of major depression among low-income, predominantly Hispanic subjects with diabetes: a randomized controlled trial. Diabetes Care. 2010, 33 (4): 706-13. 10.2337/dc09-1711.
Ell K, Quon B, Quinn DI, Dwight-Johnson M, Wells A, Lee PJ, Xie B: Improving treatment of depression among low-income patients with cancer: the design of the ADAPt-C study. Gen Hosp Psychiatry. 2007, 29 (3): 223-31. 10.1016/j.genhosppsych.2007.01.005.
Ell K, Unutzer J, Aranda M, Gibbs NE, Lee PJ, Xie B: Managing depression in home health care: a randomized clinical trial. Home Health Care Serv Q. 2007, 26 (3): 81-104. 10.1300/J027v26n03_05.
Ell K, Vourlekis B, Lee PJ, Xie B: Patient navigation and case management following an abnormal mammogram: a randomized clinical trial. Prev Med. 2007, 44 (1): 26-33. 10.1016/j.ypmed.2006.08.001.
Marder SR, Essock SM, Miller AL, Buchanan RW, Casey DE, Davis JM, Kane JM, Lieberman JA, Schooler NR, Covell N, Stroup S, Weissman EM, Wirshing DA, Hall CS, Pogach L, Pi-Sunyer X, Bigger JT, Friedman A, Kleinberg D, Yevich SJ, Davis B, Shon S: Physical health monitoring of patients with schizophrenia. Am J Psychiatry. 2004, 161 (8): 1334-49. 10.1176/appi.ajp.161.8.1334.
Gehlert S, Coleman R: Using community-based participatory research to ameliorate cancer disparities. Health Soc Work. 2010, 35 (4): 302-9.
Minkler M, Wallesrstein , editors: Community-Based Participatory Research for Health: From Processes to Outcomes. 2008, San Francisco: Jossey-Bass, 2
Valente TW, Fujimoto K, Palmer P, Tanjasiri SP: A network assessment of community-based participatory research: linking communities and universities to reduce cancer disparities. Am J Public Health. 2010, 100 (7): 1319-25. 10.2105/AJPH.2009.171116.
Parikh P, Simon EP, Fei K, Looker H, Goytia C, Horowitz CR: Results of a pilot diabetes prevention intervention in East Harlem, New York City: Project HEED. Am J Public Health. 2010, 1;100 (Suppl 1): S232-9.
Punzalan C, Paxton KC, Guentzel H, Bluthenthal RN, Staunton AD, Mejia G, Morales L, Miranda J: Seeking community input to improve implementation of a lifestyle modification program. Ethn Dis. 2006, 16 (1 Suppl 1): S79-88.
Belansky ES, Cutforth N, Chavez RA, Waters E, Bartlett-Horch K: An Adapted Version of Intervention Mapping (AIM) Is a Tool for Conducting Community-Based Participatory Research. Health Promot Pract. 2010, 12 (3): 440-55.
Bartholomew LK, Parcel GS, KokGG NH: Planning Health Promotion Programs: Intervention Mapping. 2006, San Francisco: Jossey-Bass, 2
Fernandez ME, Gonzales A, Tortolero-Luna G, Partida S, Bartholomew LK: Using intervention mapping to develop a breast and cervical cancer screening program for Hispanic farmworkers: Cultivando La Salud. Health Promot Pract. 2005, 6 (4): 394-404. 10.1177/1524839905278810.
Tortolero SR, Markham CM, Parcel GS, Peters RJ, Escobar-Chaves SL, Basen-Engquist K, Lewis HL: Using intervention mapping to adapt an effective HIV, sexually transmitted disease, and pregnancy prevention program for high-risk minority youth. Health Promot Pract. 2005, 6 (3): 286-98. 10.1177/1524839904266472.
Bernal G, Bonilla J, Bellido C: Ecological validity and cultural sensitivity for outcome research: issues for the cultural adaptation and development of psychosocial treatments with Hispanics. J Abnorm Child Psychol. 1995, 23 (1): 67-82. 10.1007/BF01447045.
Castro FG, Barrera M, Martinez CR: The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004, 5 (1): 41-5.
Rogler LH, Malgady RG, Constantino G, Blumenthal R: What do culturally sensitive mental health services means? The case of Hispanics. American Psychologist. 1987, 42 (6): 565-70.
New York City Department of Health and Mental Hygiene: Community Health Profile: Central Harlem and Inwood Washington Heights. New York. 2006, New York City Department of Health and Mental Hygiene
Devieux JG, Malow RM, Rosenberg R, Jean-Gilles M, Samuels D, Ergon-Perez E, Jacobs R: Cultural adaptation in translational research: field experiences. J Urban Health. 2005, 82 (2 Suppl 3): iii82-91.
Cabassa LJ, Molina G, Baron M: Depression Fotonovela: Development of a depression literacy tool for Latinos with limited English proficiency. Health Promot Pract. 2010,
Cabrera DM, Morisky DE, Chin S: Development of a tuberculosis education booklet for Latino immigrant patients. Patient Education and Counseling. 2002, 46: 117-24. 10.1016/S0738-3991(01)00156-2.
Zayas LH, Cabassa LJ, Pérez MC: Capacity-to-consent in psychiatric research: Development and preliminary testing of a screening tool. Research on Social Work Practice. 2005, 15 (16): 545-56.
Palmer RM, Meldon SW: Acute Care. Principles of Geriatric Medicine and Gerontology. Edited by: Hazzard WR. 2003, Boston, MA: McGraw-Hill, 157-68.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-10.1186/1748-5908-4-50.
Bond GR, Drake RE, McHugo GJ, Rapp CA, Whitley R: Strategies for improving fidelity in the national evidence-based practices project. Research on Social Work Practice. 2009, 19 (5): 569-81. 10.1177/1049731509335531.
Pearson TA, Blair SN, Daniels SR, Eckel RH, Fair JM, Fortmann SP, Franklin BA, Goldstein LB, Greenland P, Grundy SM, Hong Y, Miller NH, Lauer RM, Ockene IS, Sacco RL, Sallis JF, Smith SC, Stone NJ, Taubert KA: AHA Guidelines for Primary Prevention of Cardiovascular Disease and Stroke: 2002 Update: Consensus Panel Guide to Comprehensive Risk Reduction for Adult Patients Without Coronary or Other Atherosclerotic Vascular Diseases. American Heart Association Science Advisory and Coordinating Committee. Circulation. 2002, 106 (3): 388-91. 10.1161/01.CIR.0000020190.45892.75.
Doak LG, Doak CC, Meade CD: Strategies to improve cancer education materials. Oncol Nurs Forum. 23 (8): 1305-12.
Handley M, MacGregor K, Schillinger D, Sharifi C, Wong S, Bodenheimer T: Using action plans to help primary care patients adopt healthy behaviors: a descriptive study. J Am Board Fam Med. 2006, 19 (3): 224-31. 10.3122/jabfm.19.3.224.
Creswell JW: Research design: Qualitative, quantitative and mixed methods approaches. 2003, Thousand Oaks: Sage Publications, 2
Muhr T: User's manual for ATLAS.ti 5.0. 2004, Berlin: Scientific Software Development, 2
Little R, Rubin D: Statistical Analysis with Missing Data. 1987, New York: Wiley
Diggle P, Kenward M: Informative dropout in longitudinal data analysis. Applied Statistics. 1994, 43: 49-73. 10.2307/2986113.
Rotnitzky A, Scharfstein D, Su TL, Robins J: Methods for conducting sensitivity analysis of trials with potentially nonignorable competing causes of censoring. Biometrics. 2001, 57 (1): 103-13. 10.1111/j.0006-341X.2001.00103.x.
Ma G, Troxel AB, Heitjan DF: An index of local sensitivity to nonignorable drop-out in longitudinal modelling. Stat Med. 2005, 24 (14): 2129-50. 10.1002/sim.2107.
Kraemer HC, Kupfer DJ: Size of treatment effects and their importance to clinical research and practice. Biol Psychiatry. 2006, 59 (11): 990-6. 10.1016/j.biopsych.2005.09.014.
Glaser BG, Strauss AL: The discovery of grounded theory: Strategies for qualitative research. 1967, Chicago: Aldine Publishing Company
Strauss AL, Corbin J: Basics of qualitative research: Techniques and procedures for developing grounded theory. 1998, Thousand Oaks: Sage, 2
Charmaz K: Grounded Theory. Qualitative Psychology. Edited by: Smith JA. 2003, London: Sage, 81-110.
Padgett DK: Qualitative methods in social work research: Challenges and rewards. 1998, Thousand Oaks, CA: Sage
Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD: Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979, 2 (3): 197-207. 10.1016/0149-7189(79)90094-6.
Roberts R, Atkinson C, Mendías R: Assessing the Client Satisfaction Questionnaire in English and Spanish. Hispanic Journal of Behavioral Sciences. 1984, 6: 385-95. 10.1177/07399863840064004.
Bernal G, Bonilla J, Padilla-Cotto L, Perez-Prado EM: Factors associated to outcome in psychotherapy: an effectiveness study in Puerto Rico. J Clin Psychol. 1998, 54 (3): 329-42. 10.1002/(SICI)1097-4679(199804)54:3<329::AID-JCLP4>3.0.CO;2-K.
Hibbard JH, Mahoney ER, Stockard J, Tusler M: Development and testing of a short form of the patient activation measure. Health Serv Res. 2005, 40 (6 Pt 1): 1918-30.
Hibbard JH, Tusler M: Assessing activation stage and employing a "next steps" approach to supporting patient self-management. J Ambul Care Manage. 2007, 30 (1): 2-8.
Skolasky RL, Mackenzie EJ, Wegener ST, Riley LH: Patient activation and adherence to physical therapy in persons undergoing spine surgery. Spine. 2008, 33 (21): E784-91. 10.1097/BRS.0b013e31818027f1.
DiGuiseppi C, Atkins D, Woolf SH, editors: Report of the U S Preventive Services Task Force. 1996, Alexandria, Virginia: International Medical Publishing Inc, 2
Ware J, Kosinski M, Keller SD: A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996, 34 (3): 220-33. 10.1097/00005650-199603000-00003.
Salyers MP, Bosworth HB, Swanson JW, Lamb-Pagone J, Osher FC: Reliability and validity of the SF-12 health survey among people with severe mental illness. Med Care. 2000, 38 (11): 1141-50. 10.1097/00005650-200011000-00008.
Marin GS, Gamba RJ: A new measurement of acculturation for Hispanics: The bidimensional acculturation scale for Hispanics. Hispanic Journal of Behavioral Sciences. 1996, 18 (3): 297-316. 10.1177/07399863960183002.
Cabassa LJ, Zayas LH: Latino immigrants' intentions to seek depression care. Am J Orthopsychiatry. 2007, 77 (2): 231-42.
Manos MM, Leyden WA, Resendez CI, Klein EG, Wilson TL: Bauer HM. A community-based collaboration to assess and improve medical insurance status and access to health care of Latino children. Public Health Rep. 2001, 116 (6): 575-84.
We would like to thank Susan Essock, Enola Proctor, Mary McKay, Scott Stroup, Richard Younge, Peter Guarnaccia, José Luchsinger, Naihua Duan, Harold Pincus, Miguel Muñoz-Laboy, John Landsverk, Lawrance Palinkas, David Lowenthal, and Goretti Almeida for their comments and assistance in preparing this grant proposal. We would also like to thank the staff from the New York State Center of Excellence for Cultural Competence at the New York State Psychiatric Institute for their assistance in preparing this proposal. Preparation for this manuscript was supported by the New York State Office of Mental Health, NIH grants: K01 MH091118 (LJC), K24 MH075867 (BD), AG03113-01A2 (YW), R01 MH076051 (RLF), and by the Implementation Research Institute (IRI) at the George Warren Brown School of Social Work, Washington University in St. Louis through an award from the National Institute of Mental Health (R25 MH080916-01A2) and the Department of Veterans Affairs, Health Services Research & Development, Quality Enhancement Research Initiative (QUERI).
To LJC, BD, and YW declare that they have no competing interests. RLF received research support from Eli Lilly & Co.
LJC drafted the paper. The other authors reviewed the manuscript and provided extensive feedback. All authors have read and approved the final manuscript.
Electronic supplementary material
About this article
Cite this article
Cabassa, L.J., Druss, B., Wang, Y. et al. Collaborative planning approach to inform the implementation of a healthcare manager intervention for hispanics with serious mental illness: a study protocol. Implementation Sci 6, 80 (2011). https://doi.org/10.1186/1748-5908-6-80
- Intervention Mapping
- Serious Mental Illness
- Community Advisory Board
- Stakeholder Interview
- Body Mass Indent