Skip to main content
Download PDF
Download ePub

An audience research study to disseminate evidence about comprehensive state mental health parity legislation to US State policymakers: protocol

Implementation Science volume 12, Article number: 81 (2017) Cite this article

Abstract

Background

A large proportion of the US population has limited access to mental health treatments because insurance providers limit the utilization of mental health services in ways that are more restrictive than for physical health services. Comprehensive state mental health parity legislation (C-SMHPL) is an evidence-based policy intervention that enhances mental health insurance coverage and improves access to care. Implementation of C-SMHPL, however, is limited. State policymakers have the exclusive authority to implement C-SMHPL, but sparse guidance exists to inform the design of strategies to disseminate evidence about C-SMHPL, and more broadly, evidence-based treatments and mental illness, to this audience. The aims of this exploratory audience research study are to (1) characterize US State policymakers’ knowledge and attitudes about C-SMHPL and identify individual- and state-level attributes associated with support for C-SMHPL; and (2) integrate quantitative and qualitative data to develop a conceptual framework to disseminate evidence about C-SMHPL, evidence-based treatments, and mental illness to US State policymakers.

Methods

The study uses a multi-level (policymaker, state), mixed method (QUAN→qual) approach and is guided by Kingdon’s Multiple Streams Framework, adapted to incorporate constructs from Aarons’ Model of Evidence-Based Implementation in Public Sectors. A multi-modal survey (telephone, post-mail, e-mail) of 600 US State policymakers (500 legislative, 100 administrative) will be conducted and responses will be linked to state-level variables. The survey will span domains such as support for C-SMHPL, knowledge and attitudes about C-SMHPL and evidence-based treatments, mental illness stigma, and research dissemination preferences. State-level variables will measure factors associated with C-SMHPL implementation, such as economic climate and political environment. Multi-level regression will determine the relative strength of individual- and state-level variables on policymaker support for C-SMHPL. Informed by survey results, semi-structured interviews will be conducted with approximately 50 US State policymakers to elaborate upon quantitative findings. Then, using a systematic process, quantitative and qualitative data will be integrated and a US State policymaker-focused C-SMHPL dissemination framework will be developed.

Discussion

Study results will provide the foundation for hypothesis-driven, experimental studies testing the effects of different dissemination strategies on state policymakers’ support for, and implementation of, evidence-based mental health policy interventions.

Background

Inadequate insurance coverage for mental health services is a major barrier to accessing mental health care in the USA [1,2,3,4,5,6,7]. A significant coverage-related barrier to care is insurance providers’ practice of imposing restrictions on the utilization of mental health services that are more restrictive than those for physical health services (e.g., fewer covered mental health visits, higher deductibles and copays for mental health services) [8, 9]. Federal legislation has attempted to curb this practice [10, 11], but substantive discrepancies in coverage of mental health versus physical health services persist [12,13,14]. As a result, a substantial portion of the 19% of the US population with a mental illness [15] has restricted access to mental health services, including evidence-based treatments (EBTs), and the benefits they produce.

Comprehensive state mental health parity legislation (C-SMHPL) is an evidence-based policy intervention that enhances mental health insurance coverage and improves access to mental health services, and thus also EBTs [16]. C-SMHPL is defined as public policy that requires insurers to provide the same level of coverage for all mental health and physical health benefits with no discrepancy [17]. C-SMHPL is recommended by the US Community Preventive Services Task Force [18] an independent, non-government panel of experts that provides evidence-based recommendations about preventive interventions. Systematic reviews demonstrate that C-SMHPL increases coverage and the utilization of mental health services and does not significantly increase insurance premium costs [16, 19]. Despite strong evidence of C-SHMPL’s benefits, only 19 states have implemented C-SMHPL as of December 2015 [17].

US State policymakers have the exclusive authority to implement C-SMHPL. Research on physical activity [20, 21] and cancer [22,23,24] policy interventions has found that policymaker support is integral to implementation of evidence-based policies and that support can be cultivated through dissemination strategies that target knowledge and attitudes, and account for state-level contexts [25]. Thus, C-SMHPL uptake might be improved by dissemination strategies that target state policymakers’ knowledge deficiencies and attitudinal barriers and are targeted to state-level factors related to C-SMHPL support.

Surveys of health care providers and the general public have found low-levels of knowledge about C-SMHPL and that support varies according to attitudes about mental illness [26,27,28,29], but no data exist on state policymakers’ knowledge or attitudes about C-SMHPL or how these attributes are associated with support. More broadly, reviews [30,31,32,33,34] highlight that few studies have focused on the dissemination of mental health evidence to policymakers, in the USA or abroad. Furthermore, US State policymakers are an understudied audience in the field of dissemination research [25, 34] and minimal guidance exists to inform the design of strategies to disseminate evidence about C-SMHPL, and more generally information about mental health and EBTs, to this audience [35].

The current study aims to address these knowledge gaps through an exploratory audience research study that uses a multi-level (policymaker, state), sequential mixed method (QUAN→ qual) design with the ultimate goal of developing an empirically grounded framework to guide the dissemination of evidence about C-SMHPL, EBTs, and mental illness to US State policymakers (Fig. 1).

Fig. 1
figure 1

Shows the squence of study methods. Quant. = Quantitative, Qual. = Qualitative

Full size image

Mental health parity laws in the USA

For nearly 50 years, federal and state legislation in the USA has attempted to promote equal insurance coverage (i.e., “parity”) of mental and physical health benefits [36]. Parity coverage has been a focus of three federal laws: the 1996 Mental Health Parity Act, the 2008 Mental Health Parity and Addiction Equity Act, and the 2010 Patient Protection and Affordable Care Act. Although these laws have increased coverage for mental health services, they have been limited in their ability to achieve equal coverage because most authority to regulate insurance exists at the state-level. C-SMHPL is needed to supplement federal parity laws, help achieve equal coverage, and therein maximize access to mental health services and EBTs. Table 1 defines the three major types of state parity laws and shows their implementation status across the USA.

Table 1 Types of state mental health parity legislation and implementation status in the USA, December 2015
Full size table

Evidence base for comprehensive state mental health parity legislation

In 2012, the US Community Preventive Services Task Force classified C-SMHPL as an evidence-based intervention and recommended its widespread implementation [16]. The recommendation was based on a review of 30 studies which found strong evidence that C-SMHPL expands insurance coverage, increases utilization of mental health services, and improves financial protections for people with mental illness [18]. For example, the review found that C-SMHPL increased the proportion of employed adults with coverage for mental health services by a median of 13.6 percentage points. An economic review concluded that C-SMHPL does not substantially increase insurance provider or beneficiary costs [19]. C-SMHPL also has potential to de-institutionalize the stigma of mental illness [37,38,39].

Factors related to comprehensive state mental health parity legislation implementation

Individual-level knowledge and attitudes among the public and policymakers

Although no studies have investigated knowledge or attitudes related to C-SMHPL among state policymakers, studies of non-policymaker provide indication of factors that might be associated with C-SMHPL support. The US public has limited knowledge about parity laws and support varies according to attitudes about mental illness. Only 7% of adults have heard of “mental health parity” and, more broadly, the US public has limited knowledge about mental illness and EBTs [28, 40,41,42]. A 2013 survey found that 69% of US adults supported the concept of parity and that higher levels of mental illness stigma, defined as negative attitudes towards people with mental illness [39], were associated with less support [26]. This finding is consistent with evidence indicating that mental illness stigma is highly prevalent and associated with lower levels of support for mental health interventions [37,38,39]. Studies show that conservative political ideology is associated with higher mental illness stigma while personal experience with mental illness is associated with lower levels of stigma and higher support for C-SMHPL [28, 43, 44]. Focusing events, such as mass shootings, increase public concern about mental illness and support for policies to address it [45,46,47,48,49], although these policies are often not evidence-based [50, 51]. Understanding if and how these factors are associated with state policymakers’ support for C-SMHPL can contribute to the development of targeted, effective dissemination strategies.

State-level social, economic, and political contexts

One study investigated state-level factors associated with C-SMHPL implementation [52]. Hernandez and Uggen analyzed longitudinal ecologic data and found that high state unemployment and conservative political leadership reduced the likelihood of C-SMHPL implementation. Although the study did not collect data from actual state policymakers, it provides indication of contextual factors that might influence state policymakers decisions related to C-SMHPL.

Audience research to enhance policymaker-focused dissemination strategies

C-SMHPL has tremendous potential to increase access to EBTs and improve population mental health. In order for C-SMHPL to be brought to scale; however, information about it must be effectively disseminated to US State policymakers. Dissemination does not occur spontaneously [53] and the ‘passive’ dissemination strategies typically used by researchers (e.g., scientific publications, conference presentations) are generally ineffective at reaching policymakers and satisfying their information needs [54, 55]. Contextual factors such as political climate, economic environment, and public opinion often further complicate the transmission of research evidence and implementation of evidence-based policies [25, 56,57,58,59]. Targeted dissemination strategies can bridge the gap between the production of mental health evidence and implementation of evidence-based mental health policies.

Audience research is a critical first step in developing these strategies [60,61,62]. Audience research is defined as the formative assessment of an audience’s knowledge and attitudes about an issue or preferences for receiving information about it [62]. In accordance with the National Institutes of Health, dissemination research is defined as the study of how, why, and under what circumstances information on evidence-based interventions spreads. As an audience research dissemination study, the current study will characterize US State policymakers’ knowledge and attitudes about C-SMHPL and identify individual- and state-level attributes associated with support for C-SMHPL. Study findings will inform the design and testing of strategies to disseminate evidence about C-SMHPL, EBTs, and mental illness to US State policymakers.

Specific aims

Aim 1

Characterize state policymakers’ knowledge and attitudes about C-SMHPL and identify individual- and state-level attributes associated with support for C-SMHPL.

Rationale for Aim 1

State policymaker support for C-SMHPL is essential to its widespread implementation. Knowledge and attitudes are mutable constructs that influence support and can be modified through targeted dissemination strategies. Yet no data exist to inform the design of C-SMHPL dissemination strategies for state policymaker audiences.

Aim 2

Integrate quantitative and qualitative data to develop a conceptual framework to disseminate C-SMHPL evidence to state policymakers.

Rationale for Aim 2

A framework is needed to effectively disseminate evidence to policymakers. Frameworks exist to guide the dissemination of information about physical health interventions to policymakers [21], but none are focused on information about mental health interventions, such as C-SMHPL. A targeted dissemination framework is needed because policymakers likely have stigmatizing attitudes towards people with mental illness [37,38,39, 43, 63,64,65] and limited knowledge about mental health research evidence [28, 40,41,42].

Contribution to dissemination science

By achieving these aims, the current study addresses important knowledge gaps and advances dissemination science in at least four ways. First, policymakers are essential to maximizing the scale-up of EBTs, but are an understudied audience in dissemination and implementation research—especially in the USA [34]. A review of projects funded through the NIH’s Dissemination and Implementation Research in Health Program Announcements between 2007 and 2014 found that only 12 (8.2%) of the projects were focused on public policy, just four (3.3%) of which were classified as dissemination research [34]. Policymaker-focused dissemination research is a more developed field in Australia [66, 67] and Canada [68] but it is not clear whether or how results from these studies are applicable to US State contexts.

Furthermore, policymaker-focused dissemination research conducted in the USA and abroad has largely been limited to physical, not mental, health issues. A systematic review of interventions aimed at increasing the use of research evidence in mental health policymaking did not identify any studies that collected data from US policymakers [30], results consistent with two earlier reviews [32, 69] The lack of mental health-focused dissemination research with US State policymakers is compounded by an absence of frameworks to guide dissemination to this audience. A review of 61 dissemination and implementation frameworks found few that addressed dissemination at the policy-level and none that were focused on mental health evidence [33]. As a result, sparse empiric guidance exists to inform strategies to disseminate evidence on C-SMHPL and mental health to US State policymakers. The current study will address these knowledge gaps by collecting and integrating primary data (quantitative and qualitative) from US State policymakers.

Second, the current study will conduct audience research to enhance the reach and spread of C-SMHPL—an evidence-based intervention that has not been previously studied in dissemination research. C-SMHPL has been the focus of numerous outcome evaluations [16], but no studies have investigated how knowledge, attitudes, and other contextual factors are associated with C-SMHPL support among state policymakers—the audience with exclusive implementation authority. By focusing on C-SMHPL and policymakers, the current study will support the scale-up of C-SMHPL and ultimately the reach of EBTs.

Third, the current study is the first to investigate US State policymakers’ knowledge and attitudes about mental health, EBTs, and mental illness stigma. These topics have been extensively studied among clinicians [70,71,72,73] and the general public [26, 40, 43, 46, 74], but not state policymakers. Although the current study is specifically focused on C-SMHPL, it will produce an empirically grounded framework that can help guide the dissemination of a wider range of mental health research findings to state policymakers.

Fourth, the current study employs a multi-level design that is infrequently used in policy dissemination research. The few dissemination studies conducted with US State policymakers have been limited to a focus on individual-level factors. The current study nests policymakers’ survey and interview responses within ecologic measures of the state contexts in which they reside and make policy decisions related to C-SMHPL and EBTs. The multi-level design allows for identification of how individual- and state-level factors jointly influence support for C-SMHPL and the design and testing of targeted dissemination strategies that account for contextual factors at the state-level.

Methods

Practice partners

The current study was conceptualized in collaboration with five practice partner organizations that will serve in an advisory capacity throughout the project. The partner organizations are the National Conference of State Legislatures (NCSL), a non-governmental organization that serves as an informational resource for US State legislators and their staff; the National Association of State Mental Health Program Directors, a member organization that represents the executives of state public mental health service systems; the National Association of Insurance Commissioners, an organization created and governed by states’ chief insurance regulators that provides guidance on best practices for the regulatory oversight of insurance markets; Mental Health America, a national advocacy organization focused on addressing the needs of people affected by mental illness; and Parity Track, an organization that works to monitor and elevate implementation of federal and state parity laws.

Conceptual framework

Few dissemination frameworks are focused on US State policymakers [33] and none are specifically designed to disseminate information about evidence-based mental health policy interventions (e.g., C-SMHPL) to this audience. Thus, the current study is guided by Kingdon’s Multiple Streams Framework [75] and adapted to incorporate constructs from Aarons’ Model of Evidence-Based Implementation in Public Sectors [71] (Fig. 2). Multiple Streams is a political science framework founded on the premise that countless issues are constantly competing for policymakers’ attention. When policy, problem, and political “streams” converge around an issue a “policy window” opens and policy is implemented to address it. In the current study, the problem is inadequate insurance coverage for mental health services, the policy is C-SMHPL, and the politics are public opinion and interest group pressure related to C-SMHPL, mental illness, and EBTs.

Fig. 2
figure 2

MH = mental health, MI = mental illness, EBTs = evidence-based mental health treatments, C-SMHPL = comprehensive state mental health parity legislation. * Adapted from Kingdon’s Multiple Streams Framework of the policymaking process [75], adapted to incorporate constructs from Aarons’ Model of Evidence-Based Implementation in Public Sectors [71]

Full size image

Multiple Streams is regarded as a dissemination framework [33], but was not created with the intent of structuring dissemination research [53]. For the purpose of the current study, a deficit of Multiple Streams is that it does not account for individual attributes of state policymakers (i.e., the adopters of C-SMHPL). These characteristics are important because they are mutable targets that can be altered by targeted dissemination strategies [28]. Thus, Multiple Streams was supplemented with the concepts of inner- and outer-contextual factors from Aarons’ Model of Evidence-Based Implementation in Public Sectors [71]. Inner-contextual factors are individual attributes of the adopters of an intervention, whereas outer-contextual factors constitute features of the external environment that affect adoption. Figure 2 depicts inner- and outer-contextual factors within each of the three streams postulated, on the basis of extant research [26,27,28,29, 37,38,39,40,41,42,43, 45,46,47,48,49, 52, 63,64,65, 70,71,72,73,74], to be associated with state policymaker support for C-SMHPL. Supplementing Multiple Streams is acceptable because the framework is rated as having high construct flexibility for dissemination research [33].

Aim 1 methods

Aim 1 methods consist of a quantitative survey of 600 US State policymakers—500 state legislators (i.e., elected policymakers) and 100 administrators (i.e., appointed policymakers)—collection of state-level ecologic data, and exploratory multi-level regression analyses to identify inner- and outer-contextual factors associated with policymaker support for C-SMHPL.

Policymaker survey instrument and measures

Table 2 shows policymaker-level (i.e., inner-contextual) variables, how they will be measured, and the sources from which items are derived (legislator survey as Additional file 1). The primary dependent variable is global support for C-SMHPL and the secondary dependent variables are support for specific benefits covered at parity (e.g., co-pays, visit limits) and mental health conditions and substance use disorders covered at parity (e.g., major depression disorder, opioid use disorder). A definition of C-SMHPL will be provided towards the beginning of each survey.

Table 2 Inner-contextual policymaker-level variables
Full size table

The primary independent variables are knowledge and attitudes (i.e., inner-contextual factors) that are postulated to be associated with C-SMHPL support. Knowledge of C-SMHPL research evidence (i.e., that C-SMHPL increases insurance coverage for mental health services and does not increase premium costs) and mental health literacy (e.g., knowledge about the prevalence of mental illness and attitudes about the effectiveness of EBTs) will be assessed. Attitudes about people with mental illness (i.e., stigma) will be measured in addition to history of personal experience with mental health and substance use disorder treatments. Information of research dissemination preferences (e.g., important features of disseminated research, preferred sources of disseminated research) and research utilization practices will be collected in addition measures of political ideology and demographics.

Cognitive pre-testing of policymaker survey instrument

Many of the survey items related to C-SMHPL, mental health, and mental illness have been validated in prior research with the general public, but not policymakers. Thus, to ensure data quality, the survey instrument will be cognitively pre-tested with at least 15 state policymakers (legislative and administrative) before fielding. These policymakers will be identified and recruited in collaboration with the study’s partner organizations. In accordance with recommendations for cognitive pre-testing [76], the process will entail telephone-based interviews in which each survey item will be presented, a response will be obtained, and then questions will be asked about the item. The questions will span four domains: comprehension (e.g., what do respondents think questions are asking?), retrieval (e.g., what information do respondents need to recall to answer questions?), judgment (how do respondents formulate answers to questions?), and response (e.g., how do response options and social desirability influence the answers?). The survey instrument will be revised to address issues identified through pre-testing.

Survey sample selection, recruitment, and data collection

Sample frames will be constructed of the two types of state policymakers with ability to affect C-SMHPL implementation: state legislators and state administrative policymakers.

State legislators

There are 7383 state legislators in the USA. A list of all US State legislators as of January 2017 and their contact information will be purchased from NCSL. Newly elected state legislators serving their first term in 2017 (n = 1229) will be excluded from the sample frame because of their limited time in office when data collection occurs. To ensure variation in the current status of parity legislation and other state-level contextual factors that could affect survey responses, 30 state legislators will be randomly selected from each state and recruited to complete the survey (30 legislators per state * 50 states = 1500 state legislators in original sample frame). Assuming a response rate of approximately 30%, consistent with prior survey research with US State legislators [77,78,79,80], this will result in approximately 500 state legislators completing the survey. If the response rate is inadequate to achieve a sample size of 500, the sample frame will be extended and additional state legislators will be recruited.

State legislator survey data will be collected by a professional survey research firm using an assertive recruitment strategy that combines e-mail, post-mail, and telephone-based modes of recruitment and data collection. First, each legislator in the sample frame will receive a personalized post-mail and e-mail invitation describing the study and inviting them to complete the survey online using a unique ID and password. Then, over the course of the next 28 weeks, each legislator will receive two post-mailed paper versions of the survey with self-addressed postage-paid return envelopes, 10 e-mail invitations to complete the survey online, and up to 15 telephone calls in the last 4 weeks of the data collection period. In total, a legislator who does not complete the survey nor opt-out of the sample frame will be contacted a total of 29 times.

Two additional strategies will be used to increase the chances of a high response rate. First, the survey concludes with a question asking the legislator to indicate the two primary reasons for completing the survey (e.g., concern about mental health and substance abuse issues among their constituents, a desire to have research findings more effectively disseminated to them). These responses will be analyzed while the survey is still in the field and results about the motivations for survey completion will inform the messaging of recruitment materials. Second, because the dates of the legislative session vary between states, in-session or out-of-session contact information for each legislator will be used according to whether their legislature is in-session or out-of-session on the date of each contact attempt.

State administrative policymakers

Through discussions with practice partners, it was determined state health insurance commissioners and state mental health programs directors were the two types of state administrative policymakers with the most influence on C-SMHPL implementation decisions, through enforcement of parity laws or by serving in an advisory capacity to the state legislature. The names and contact information for these policymakers is publically available and centralized on the National Association of State Mental Health Program Directors and National Association of Insurance Commissioners websites. These two policymakers from each state (two administrative policymakers per state * 50 states = 100 state policymakers in sample frame) will be recruited by e-mail and telephone over a 29-week period to complete a web-based version of the survey. The administrative policymaker survey will be modeled after the legislator survey, but modified in collaboration with practice partners to reflect differences in the scope of authority and responsibly between the different types of policymakers.

State-level measures

Table 3 shows state-level (i.e., outer-contextual) variables that will be measured for all 50 states using the most recent data available. The first four variables listed were used in Hernandez and Uggen’s study of C-SMHPL implementation and will be measured using identical methods [52]. State mental health parity status (i.e., C-SMHPL, limited-SMHPL, non-parity) will be obtained from NCSL [17]. Interest group pressure for mental health parity will be measured by the number of years that the National Alliance on Mental Illness (NAMI) has been registered each state [81]. Economic pressure against mental health parity will be measured by seasonally adjusted state unemployment rates for the month prior to when each survey is completed [82]. State government ideology will be measured using a composite index based on state legislative voting [83] and state government partisanship will be measured according to NCSL’s designation based on controlling political party in control of the state’s legislature and governor’s office [84].

Table 3 Outer-contextual state-level variables
Full size table

Given the increased incidence of mass shootings in the USA [85] and research indicating these events generate public support for policies to address mental illness [46,47,48,49], the Stanford Mass Shootings of America Database [86] will be used to measure (a) the number of mass shooting events and (b) the number of people injured in these events, within each state in the 2 years prior to the date when the survey is completed. A mass shooting is operationalized in the database as an event in which three or more people were injured. Seventy-seven of these events occurred in 2014 and 2015, suggesting adequate variability between states. Lastly, state prioritization of mental health will be measured using the quartile rank of each state’s Mental Health America Access to Care Score, a composite score based on nine metrics [87].

Quantitative analysis

A single de-identified dataset will be created in which survey responses from each policymaker will be linked to data on the state-level variables for the state in which they reside. The legislator survey includes 59 items and nine a priori domains. Cronbach’s alpha will be used to statistically confirm whether survey items assess a similar construct. First, variables will be characterized using descriptive statistics (e.g., frequencies, central tendencies) and plots (e.g., stem and leaf plots, q-q plots). Then, multi-level regression models will be used to investigate the relative strength of policymaker- versus state-level measures in determining support for C-SMHPL. The models will also produce estimates and standard errors accounting for the hierarchical nature of the data. Multi-level multinomial and binary logistic regression models will be used for each of the three dependent variables (i.e., global support for C-SMHPL, support for specific benefits covered at parity, support for specific conditions covered at parity) to estimate odds ratios (ORs) of each level of support compared to strong opposition.

For each outcome, the intra-class correlation coefficient will first be calculated to estimate the proportion of variability attributable to policymaker- versus state-level variation. Adjusted multi-level random effects regression models will then be used to estimate ORs for associations of the policymaker- and state-level measures with the outcome. A sequential model-building approach will be used in which blocks of policymaker-level variables will first be entered according to domain (e.g., mental illness stigma) followed by the addition of state-level variables.

Statistical power

The total sample of 600 US State policymakers will provide sufficient power to detect anticipated effect sizes of policymaker and state-level measures. Alpha at 0.05 and prevalence of strong support for C-SMHPL at 50% will provide 88% power to detect a 40% reduction in odds of support associated with a standard deviation difference in a state-level variable. Power analyses were conducted using Optimal Design Plus Empirical Evidence Software, Version 3.01 [88].

Aim 2 methods

Aim 2 methods consist of semi-structured interviews with approximately 50 US State policymakers to develop a framework to disseminate evidence about C-SMHPL, EBTs, and mental illness to this audience. All Aim 2 methods will be informed by quantitative findings from Aim 1 and begin after preliminary quantitative analyses are complete.

Interview guide development

A semi-structured interview guide will be developed in collaboration with practice partners to shed additional light on quantitative findings (sample interview questions in Additional file 2). The guide will contain seven to ni ne primary open-ended questions, with multiple follow-up and probing questions, and span domains such as experiences with C-SMHPL, perceptions of barriers and facilitators to C-SMHPL implementation, opinions about EBTs and mental illness, and processes through which research influences (and does not influence) state mental health policymaking.

Interview respondent selection, recruitment, and data collection

The interview sample frame will consist of all policymakers who completed a quantitative survey (Aim 1). A purposive sampling strategy will be used in which respondents will be selected based on known characteristics, not at random [89]. In accordance with recommendations for mixed method research [90, 91], policymakers will be selected based on characteristics that will allow us to explore findings that emerge from quantitative analyses.

Interviews will be conducted until “saturation” is achieved (i.e., the point at which no new information is yielded from the data) [92]. Research shows that meaningful themes within sub-groups typically emerge after six interviews and saturation often occurs after 12 interviews [92]. Recruiting from the two policymaker populations (i.e., legislative and administrative) and allowing for three sub-group comparisons within each population, between 36 and 72 interviews [2 × 3 × (6 to 12) = 36 to 72] will be conducted in total. Each respondent will be contacted ten times in a 3-week period before selecting an alternate. Interviews will be approximately 30 min in duration, telephone-based, audio recorded, transcribed verbatim, and imported into NVivo 10, a qualitative data management program.

Qualitative analysis and framework development

Qualitative analysis will be structured around the objective of developing a framework to disseminate evidence about C-SMHPL, EBTs, and mental illness to US State policymakers and guided by Jabareen’s procedure for conceptual framework development [93]. Accordingly, qualitative analysis will progress over the course of six steps.

  • Step 1: Review quantitative findings and existing dissemination frameworks. This step serves to identify, a priori, concepts that have potential utility in the framework. Key findings from quantitative analyses will be transformed into preliminary concepts with names and definitions (e.g., mental illness stigma/C-SMHPL support association). Using previous reviews [33, 94], existing dissemination frameworks will be reviewed to identify key dissemination concepts (e.g., message source). This step will orient activities in Steps 2 through 4.

  • Step 2: Read, code, and categorize interview data. This step consists of organizing interview data into categories at a low-level of abstraction. All interview transcripts will be read by two coders who will assign sections of text to inductively generated categories in NVivo [91]. Coders will meet regularly to discuss coding decisions and establish category names and definitions. Coders will write memos throughout the coding process to capture ideas (e.g., variations in themes by state-level context) and discuss these memos with the project team to refine categories [95].

  • Step 3: Establish core concepts. This step entails coding transcripts at a higher level of abstraction and creating core concepts that reflect commonalities between multiple categories [96]. Concepts will be created through an iterative process using analytic techniques such as coding matrixes, quote tables, and querying for divergent findings [95]. After core concepts have been named and defined, two coders will re-read and code all transcripts and kappa statistics of inter-rater reliability will be calculated for each concept. Concepts with less than “moderate agreement” (kappa ≤ .60) [97] will be discarded.

  • Step 4: Create framework. The purpose of this step is to synthesize quantitative and qualitative findings and create a conceptual framework that provides a comprehensive understanding of how evidence about C-SMHPL, EBTs, and mental illness can be most effectively disseminated to US State policymakers. To achieve this, diagrams will be created that depict sequences, contingencies, and inter-relationships among concepts at and between policymaker- and state-levels.

  • Step 5: Validate framework. This step uses “member checking,” a qualitative validation technique in which research participants review and comment on the study’s findings [98], to assess whether the framework makes sense to policymakers. To elicit feedback and while accommodating policymakers busy schedules, an asynchronous strategy will be used in which the framework diagram and accompanying narrative will be e-mailed to interview respondents with an accompanying request for them to provide feedback via brief, open-ended questions that will be answered through a web-based survey. Responses will be imported into the NVivo database and analyzed using thematic content analysis.

  • Step 6: Revise framework. At this step, in collaboration with practice partners, feedback obtained in Step 5 will be integrated and the framework will be revised accordingly.

Summary of activities to mix quantitative and qualitative data and methods

To reiterate, quantitative and qualitative data and methods will be mixed in three ways. First, quantitative findings will inform qualitative sampling by providing policymaker- and state-level criteria for selecting interview respondents and aiding the identification policymakers who meet these criteria. Second, quantitative findings will inform qualitative data collection as qualitative interview questions will be developed to elaborate upon quantitative findings. Third, quantitative findings will be transformed into qualitative concepts that will be used in the qualitative conceptual framework development process.

Discussion

If successful, the current project will advance the US National Institute of Mental Health’s (NIMH) Objective to “Strengthen the Public Health Impact of NIMH-Supported Research” by producing knowledge that will enhance the dissemination of C-SMHPL evidence to state policymakers and therefore scale-up a policy intervention that expands access to mental health services and EBTs. Study results will provide the foundation for hypothesis-driven, experimental studies testing the effects of different dissemination strategies on state policymakers’ knowledge and attitudes about, support for, and implementation of, evidence-based mental health policy interventions.

There is at least one aspect of the current study that warrants additional consideration—the national political context at the time of data collection and emergent demands on US State legislators that could potentially contribute to a sub-optimal response rate. Survey data will be collected in spring and summer 2017, a time of elevated political turmoil and policy change in the USA. A new President and broad proposed changes in the federal administration and its policies (e.g., health insurance reform, environmental regulation, immigration enforcement, state funding) are likely to place increased pressure on state legislators to respond to constituents needs and develop new legislation. By straining their already finite time resources, these demands could potentially make state legislators less likely to complete the survey. The study’s assertive (i.e., up to 29 contact attempts) and multi-modal (i.e., telephone, post-mail, e-mail) recruitment strategy should maximize the chances of obtaining a satisfactory response rate despite these challenges.

Abbreviations

C-SMHPL:

Comprehensive state mental health parity legislation

EBTs:

Evidence-based mental health treatments

NIH:

National Institute of Health

NIMH:

National Institute of Mental Health

References

  1. Gonzalez ML, Butler AS, England MJ: Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence-based standards. Washington: National Academies Press; 2015.

  2. Rowan K, McAlpine DD, Blewett LA. Access and cost barriers to mental health care, by insurance status, 1999–2010. Health affairs. 2013;32:1723–30.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Kilbourne AM. Care without coverage: too little, too late. Journal of the National Medical Association. 2005;97:1578.

    PubMed Central  Google Scholar 

  4. Walker ER, Cummings JR, Hockenberry JM, Druss BG. Insurance status, use of mental health services, and unmet need for mental health care in the United States. Psychiatric Services. 2015;66:578–84.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Kataoka SH, Zhang L, Wells KB. Unmet need for mental health care among US children: Variation by ethnicity and insurance status. American Journal of Psychiatry. 2002;159:1548–55.

    Article  PubMed  Google Scholar 

  6. McAlpine DD, Mechanic D. Utilization of specialty mental health care among persons with severe mental illness: the roles of demographics, need, insurance, and risk. Health services research. 2000;35:277.

    CAS  PubMed  PubMed Central  Google Scholar 

  7. Barry CL, Gabel JR, Frank RG, Hawkins S, Whitmore HH, Pickreign JD. Design of mental health benefits: still unequal after all these years. Health Affairs. 2003;22:127–37.

    Article  PubMed  Google Scholar 

  8. Wen H, Cummings JR, Hockenberry JM, Gaydos LM, Druss BG. State parity laws and access to treatment for substance use disorder in the United States: implications for federal parity legislation. JAMA psychiatry. 2013;70:1355–62.

    Article  PubMed  PubMed Central  Google Scholar 

  9. McGinty EE, Busch SH, Stuart EA, Huskamp HA, Gibson TB, Goldman HH, Barry CL. Federal parity law associated with increased probability of using out-of-network substance use disorder treatment services. Health Affairs. 2015;34:1331–9.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Barry CL, Huskamp HA, Goldman HH. A political history of federal mental health and addiction insurance parity. Milbank Quarterly. 2010;88:404–33.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Barry CL. The political evolution of mental health parity. Harvard review of psychiatry. 2006;14:185–94.

    Article  PubMed  Google Scholar 

  12. Mechanic D, McAlpine DD. Mission unfulfilled: potholes on the road to mental health parity. Health Affairs. 1999;18:7–21.

    Article  CAS  PubMed  Google Scholar 

  13. Buchmueller TC, Cooper PF, Jacobson M, Zuvekas SH. Parity for whom? Exemptions and the extent of state mental health parity legislation. Health Affairs. 2007;26:w483–7.

    Article  PubMed  Google Scholar 

  14. Goodell S: Health Policy Brief: enforcing mental health parity. Health Affairs [serial on the Internet] 2015. http://www.healthaffairs.org/healthpolicybriefs/brief.php?brief_id=147.

  15. Substance Abuse and Mental Health Services Administration, Results from the 2012 National Survey on Drug Use and Health: Summary of National Findings, NSDUH Series H-46, HHS Publication No. (SMA) 13-4795. Rockville, MD: Substance Abuse and Mental Health Services Administration, 2013.

  16. Sipe TA, Finnie RK, Knopf JA, Qu S, Reynolds JA, Thota AB, Hahn RA, Goetzel RZ, Hennessy KD, McKnight-Eily LR. Effects of mental health benefits legislation: A community guide systematic review. American journal of preventive medicine. 2015;48:755–66.

    Article  PubMed  PubMed Central  Google Scholar 

  17. National Conference of State Legislatures: Mental Health Benefits: State Laws Mandating or Regulating [Available from: http://www.ncsl.org/research/health/mental-health-benefits-state-mandates.aspx]. Accessed 22 June 2017.

  18. Community Preventive Services Task Force. Recommendation for Mental Health Benefits Legislation. Am J Prev Med. 2015;48:767–70.

    Article  Google Scholar 

  19. Jacob V, Qu S, Chattopadhyay S, Sipe T, Knopf J, Goetzel R, Finnie R, Thota A, Force CPST. Legislations and policies to expand mental health and substance abuse benefits in health insurance plans: a community guide systematic economic review. The journal of mental health policy and economics. 2015;18:39.

    PubMed  PubMed Central  Google Scholar 

  20. Dreisinger ML, Boland EM, Filler CD, Baker EA, Hessel AS, Brownson RC: Contextual factors influencing readiness for dissemination of obesity prevention programs and policies. Health education research 2011;(2):292-306.

  21. Owen N, Glanz K, Sallis JF, Kelder SH. Evidence-based approaches to dissemination and diffusion of physical activity interventions. American journal of preventive medicine. 2006;31:35–44.

    Article  Google Scholar 

  22. Stamatakis KA, McBride TD, Brownson RC. Communicating prevention messages to policy makers: the role of stories in promoting physical activity. Journal of Physical Activity and Health. 2010;7:S99–S107.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Allen P, Sequeira S, Jacob RR, Hino AAF, Stamatakis KA, Harris JK, Elliott L, Kerner JF, Jones E, Dobbins M. Promoting state health department evidence-based cancer and chronic disease prevention: a multi-phase dissemination study with a cluster randomized trial component. Implementation Science. 2013;8:141.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Brownson RC, Dodson EA, Stamatakis KA, Casey CM, Elliott MB, Luke DA, Wintrode CG, Kreuter MW: Communicating evidence-based information on cancer prevention to state-level policy makers. J Natl Cancer Inst. 2011;103(4):306-16.

  25. Brownson RC, Colditz GA, Proctor EK: Dissemination and implementation research in health: translating science to practice. Oxford: Oxford University Press; 2012.

  26. Barry CL, McGinty EE. Stigma and public support for parity and government spending on mental health: a 2013 national opinion survey. Psychiatric Services. 2014;65:1265–8.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Hanson KW: Public opinion and the mental health parity debate: lessons from the survey literature. Psychiatr Serv. 1998;49(8):1059-66.

  28. American Psychological Association: Mental Health Parity Survey 2014. [Available from: http://www.apa.org/helpcenter/parity-survey-2014.pdf]. Accessed 22 June 2017.

  29. Mickus M, Colenda CC, Hogan AJ. Knowledge of mental health benefits and preferences for type of mental health providers among the general public. Psychiatric Services. 2000;51:199–202.

    Article  CAS  PubMed  Google Scholar 

  30. Williamson A, Makkar SR, McGrath C, Redman S. How can the use of evidence in mental health policy be increased? A systematic review. Psychiatric Services. 2015;66:783–97.

    Article  PubMed  Google Scholar 

  31. Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC health services research. 2014;14:2.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Goldner EM, Jeffries V, Bilsker D, Jenkins E, Menear M, Petermann L. Knowledge translation in mental health: A scoping review. Healthcare Policy. 2011;7:83.

    PubMed  PubMed Central  Google Scholar 

  33. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. American journal of preventive medicine. 2012;43:337–50.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Purtle J, Peters R, Brownson RC. A review of policy dissemination and implementation research funded by the National Institutes of Health, 2007–2014. Implementation Science. 2016;11:1.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Purtle J, Brownson RC, Proctor EK: Infusing Science into Politics and Policy: The Importance of Legislators as an Audience in Mental Health Policy Dissemination Research. Administration and Policy in Mental Health and Mental Health Services Research. 2016;1-4.

  36. Frank RG, Glied SA: Better but not well: Mental health policy in the United States since 1950. Baltimore: JHU Press; 2006.

  37. National Academies of Sciences E, Medicine: Ending discrimination against people with mental and substance use disorders: The evidence for stigma change. Washington: National Academies Press; 2016.

  38. Corrigan PW, Druss BG, Perlick DA. The impact of mental illness stigma on seeking and participating in mental health care. Psychological Science in the Public Interest. 2014;15:37–70.

    Article  PubMed  Google Scholar 

  39. Cummings JR, Lucas SM, Druss BG. Addressing public stigma and disparities among persons with mental illness: The role of federal policy. American journal of public health. 2013;103:781–5.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Link BG, Phelan JC, Bresnahan M, Stueve A, Pescosolido BA. Public conceptions of mental illness: labels, causes, dangerousness, and social distance. American journal of public health. 1999;89:1328–33.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Pescosolido BA, Jensen PS, Martin JK, Perry BL, Olafsdottir S, Fettes D. Public knowledge and assessment of child mental health problems: Findings from the National Stigma Study-Children. Journal of the American Academy of Child & Adolescent Psychiatry. 2008;47:339–49.

    Article  Google Scholar 

  42. Olsson DP, Kennedy MG. Mental health literacy among young people in a small US town: recognition of disorders and hypothetical helping responses. Early Intervention in Psychiatry. 2010;4:291–8.

    Article  PubMed  Google Scholar 

  43. Parcesepe AM, Cabassa LJ. Public stigma of mental illness in the United States: a systematic literature review. Administration and Policy in Mental Health and Mental Health Services Research. 2013;40:384–99.

    Article  PubMed  Google Scholar 

  44. Corrigan PW, Watson AC. Factors that explain how policy makers distribute resources to mental health services. Psychiatric Services. 2003;54:501–7.

    Article  PubMed  Google Scholar 

  45. McGinty EE, Kennedy-Hendricks A, Choksy S, Barry CL. Trends In News Media Coverage Of Mental Illness In The United States: 1995–2014. Health Affairs. 2016;35:1121–9.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Saad L: Americans fault mental health system most for gun violence. Gallup Politics. 2013;20. http://www.gallup.com/poll/164507/americans-fault-mental-health-system-gun-violence.aspx.

  47. Barry CL, McGinty EE, Vernick JS, Webster DW. After Newtown—public opinion on gun policy and mental illness. New England journal of medicine. 2013;368:1077–81.

    Article  CAS  PubMed  Google Scholar 

  48. Metzl JM, MacLeish KT. Mental illness, mass shootings, and the politics of American firearms. American Journal of Public Health. 2015;105:240–49.

  49. Wilson LC, Ballman AD, Buczek TJ. News Content About Mass Shootings and Attitudes Toward Mental Illness. Journalism & Mass Communication Quarterly. 2016;93:644–58.

    Article  Google Scholar 

  50. Rozel JS, Mulvey EP. The link between mental illness and firearm violence: implications for social policy and clinical practice. Annual Review of Clinical Psychology. 2017;13:445-69.

  51. Swanson JW, McGinty EE, Fazel S, Mays VM. Mental illness and reduction of gun violence and suicide: bringing epidemiologic research to policy. Annals of epidemiology. 2015;25:366–76.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Hernandez EM, Uggen C. Institutions, politics, and mental health parity. Society and mental health. 2012;2:154–71.

    Article  Google Scholar 

  53. Jones MD, Peterson HL, Pierce JJ, Herweg N, Bernal A, Lamberta Raney H, Zahariadis N. A River Runs Through It: A Multiple Streams Meta‐Review. Policy Studies Journal. 2016;44:13–36.

    Article  Google Scholar 

  54. Brownson RC, Royer C, Ewing R, McBride TD. Researchers and policymakers: travelers in parallel universes. American journal of preventive medicine. 2006;30:164–72.

    Article  PubMed  Google Scholar 

  55. Bogenschneider K, Corbett TJ: Evidence-based policymaking: Insights from policy-minded researchers and research-minded policymakers. Abingdon-on-Thames: Routledge; 2011.

  56. Mitton C, Adair CE, McKenzie E, Patten SB, Perry BW. Knowledge transfer and exchange: review and synthesis of the literature. Milbank Quarterly. 2007;85:729–68.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Shonkoff JP, Bales SN. Science does not speak for itself: Translating child development research for the public and its policymakers. Child Development. 2011;82:17–32.

    Article  PubMed  Google Scholar 

  58. Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J. How can research organizations more effectively transfer research knowledge to decision makers? The Milbank Quarterly. 2003;81:221–48.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Shonkoff JP. Science, policy, and practice: Three cultures in search of a shared mission. Child development. 2000;71:181–7.

    Article  CAS  PubMed  Google Scholar 

  60. Brownson RC, Jacobs JA, Tabak RG, Hoehner CM, Stamatakis KA. Designing for dissemination among public health researchers: findings from a national survey in the United States. American journal of public health. 2013;103:1693–9.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Nisbet MC, Maibach E, Leiserowitz A. Framing peak petroleum as a public health problem: Audience research and participatory engagement in the United States. American Journal of Public Health. 2011;101:1620–6.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Slater MD. Theory and method in health audience segmentation. Journal of health communication. 1996;1:267–84.

    Article  CAS  PubMed  Google Scholar 

  63. Corrigan PW, Morris SB, Michaels PJ, Rafacz JD, Rüsch N. Challenging the public stigma of mental illness: a meta-analysis of outcome studies. Psychiatric Services. 2012;63:963–73.

    Article  PubMed  Google Scholar 

  64. Stuber JP, Rocha A, Christian A, Link BG. Conceptions of mental illness: Attitudes of mental health professionals and the general public. Psychiatric services. 2014;65:490–7.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Corrigan PW, Watson AC, Warpinski AC, Gracia G. Stigmatizing attitudes about mental illness and allocation of resources to mental health services. Community mental health journal. 2004;40:297–307.

    Article  PubMed  Google Scholar 

  66. Haynes A, Brennan S, Carter S, O'Connor D, Schneider CH, Turner T, Gallego G. Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study). Implementation Science. 2014;9:113.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Investigators C. Supporting Policy In health with Research: an Intervention Trial (SPIRIT)—protocol for a stepped wedge trial. BMJ open. 2014;4:e005293.

    Article  Google Scholar 

  68. Lavis JN, Wilson MG, Grimshaw JM, Haynes RB, Hanna S, Raina P, Gruen R, Ouimet M. Effects of an evidence service on health-system policy makers' use of research evidence: A protocol for a randomised controlled trial. Implementation Science. 2011;6:1.

    Article  Google Scholar 

  69. Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC health services research. 2014;14:1.

    Article  Google Scholar 

  70. Hodges B, Inch C, Silver I. Improving the psychiatric knowledge, skills, and attitudes of primary care physicians, 1950–2000: a review. American Journal of Psychiatry. 2001;158:1579–86.

    Article  CAS  PubMed  Google Scholar 

  71. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research. 2011;38:4–23.

    Article  PubMed  Google Scholar 

  72. Loeb DF, Bayliss EA, Binswanger IA, Candrian C. Primary care physician perceptions on caring for complex patients with medical and mental illness. Journal of general internal medicine. 2012;27:945–52.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Wallace JE. Mental health and stigma in the medical profession. Health. 2012;16:3–18.

    Article  PubMed  Google Scholar 

  74. Centers for Disease Control and Prevention, Substance Abuse and Mental Health Services Administration, National Association of County Behavioral Health & Developmental Disability Directors, National Institute of Mental Health, The Carter Center Mental Health Program. Attitudes Toward Mental Illness: Results from the Behavioral Risk Factor Surveillance System. Atlanta (GA); Centers for Disease Control and Prevention; 2012.

  75. Kingdon JW. Agendas, Alternatives, and Public Policies. New York: Addison-Wesley Educational Publishers, Inc.; 2003.

    Google Scholar 

  76. Collins D. Pretesting survey instruments: an overview of cognitive methods. Quality of life research. 2003;12:229–38.

    Article  PubMed  Google Scholar 

  77. Brownson RC, Dodson EA, Kerner JF, Moreland-Russell S. Framing research for state policymakers who place a priority on cancer. Cancer Causes & Control. 2016;27:1035–41.

    Article  Google Scholar 

  78. Purtle J, Dodson EA, Brownson RC. Uses of research evidence by State legislators who prioritize behavioral health issues. Psychiatric Services. 2016;67:1355–61.

    Article  PubMed  Google Scholar 

  79. Welch PJ, Dake JA, Price JH, Thompson AJ, Ubokudom SE. State legislators' support for evidence-based obesity reduction policies. Preventive medicine. 2012;55:427–9.

    Article  PubMed  Google Scholar 

  80. Fisher SH, Herrick R. Old versus New The Comparative Efficiency of Mail and Internet Surveys of State Legislators. State Politics & Policy Quarterly. 2013;13:147–63.

    Article  Google Scholar 

  81. Phillips TY: Encyclopedia of Associations: Regional, State, and Local Organizations. Farmington Hills: Gale Research Incorporated; 2015.

  82. US Bureau of Labor Statistics: Local Area Unemployment Statistics [Available at https://www.bls.gov/web/laus/laumstrk.htm]. Accessed 22 June 2017.

  83. Berry WD, Fording RC, Ringquist EJ, Hanson RL, Klarner CE. Measuring citizen and government ideology in the US states: A re-appraisal. State Politics & Policy Quarterly. 2010;10:117–35.

    Article  Google Scholar 

  84. National Conference of State Legislatures: Partisan Composition During the 2017 Legislative Session [Available at http://www.ncsl.org/research/about-state-legislatures/partisan-composition.aspx#2017]. Accessed 22 June 2017.

  85. Krouse WJ, Richardson DJ: Mass murder with firearms: Incidents and victims, 1999-2013. In. Congressional Research Service, Library of Congress; 2015. https://fas.org/sgp/crs/misc/R44126.pdf.

  86. The Stanford Mass Shootings of America Database: The Stanford Mass Shootings of America Database [Available at https://library.stanford.edu/projects/mass-shootings-america]. Accessed 22 June 2017.

  87. Mental Health America: Ranking the States [Available at http://www.mentalhealthamerica.net/issues/ranking-states]. Accessed 22 June 2017.

  88. Raudenbush S, Spybrook J, Congdon R, Liu X, Martinez A, Bloom H, Hill C: Optimal design plus empirical evidence (Version 3.0)[Computer Software]. 2011.

  89. Coyne IT. Sampling in qualitative research. Purposeful and theoretical sampling; merging or clear boundaries? Journal of advanced nursing. 1997;26:623–30.

    Article  CAS  PubMed  Google Scholar 

  90. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research. 2011;38:44–53.

    Article  PubMed  Google Scholar 

  91. Creswell JW, Clark VLP: Designing and conducting mixed methods research. California: Sage Publications; 2007.

  92. Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field methods. 2006;18:59–82.

    Article  Google Scholar 

  93. Jabareen Y. Building a conceptual framework: philosophy, definitions, and procedure. International Journal of Qualitative Methods. 2009;8:49–62.

    Article  Google Scholar 

  94. Green LW, Ottoson JM, Garcia C, Hiatt RA. Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annual review of public health. 2009;30:151–74.

    Article  PubMed  Google Scholar 

  95. Richards L: Handling qualitative data: A practical guide. Thousand Oaks: Sage; 2014.

  96. Kuckartz U: Qualitative Text Analysis: A Guide to Methods. Practice & Using Software Sage London 2014.

  97. Landis JR, Koch GG: The measurement of observer agreement for categorical data biometrics. 1977;33:159-74.

  98. Lincoln YS, Guba EG: Naturalistic inquiry. Thousand Oaks: Sage; 1985.

  99. Jorm A. Mental health literacy: Public knowledge and beliefs about. British journal of Psychiatry. 2000;177:317–27.

    Article  Google Scholar 

  100. Bogenschneider K, Little OM, Johnson K. Policymakers' Use of Social Science Research: Looking Within and Across Policy Actors. Journal of Marriage and Family. 2013;75:263–75.

    Article  Google Scholar 

  101. Zardo P, Collie A. Predicting research use in a public health policy environment: results of a logistic regression analysis. Implementation Science. 2014;9:142.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors are grateful to Karman Hanson at the National Conference of State Legislatures, Brian Hepburn and Meighan Haupt at the National Association of State Mental Health Program Directors, Brian Webb at the National Association of Insurance Commissioners, Nathaniel Counts at Mental Health America, Tim Clement and Amanda Mauri at Parity Track, and Benjamin Borchers at the Drexel University Dornsife School of Public Health.

Funding

Support for this project comes from the National Institute of Mental Health (R21MH111806; R25MH080916). The contents of this article are solely the responsibility of the authors and do not necessarily represent the official views of the NIH.

Availability of data and materials

The datasets that result from the current study will be available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

  1. Department of Health Management and Policy, Dornsife School of Public Health, Drexel University, 3215 Market St, Philadelphia, PA, 19104, USA

    Jonathan Purtle & Paul Shattuck

  2. Department of Epidemiology and Biostatistics, Dornsife School of Public Health, Drexel University, 3215 Market St, Philadelphia, PA, 19104, USA

    Félice Lê-Scherban

  3. A.J. Drexel Autism Institute, Drexel University, 3215 Market St, Philadelphia, PA, 19104, USA

    Paul Shattuck

  4. Center for Mental Health Services Research, Brown School of Social Work, Washington University in St. Louis, St. Louis, MO, USA

    Enola K. Proctor

  5. Prevention Research Center in St. Louis, Brown School of Social Work, Washington University in St. Louis, St. Louis, MO, USA

    Ross C. Brownson

  6. Division of Public Health Sciences and Alvin J. Siteman Cancer Center, Washington University School of Medicine, Washington University in St. Louis, St. Louis, MO, USA

    Ross C. Brownson

Authors
  1. Jonathan Purtle
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Félice Lê-Scherban
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paul Shattuck
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Enola K. Proctor
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ross C. Brownson
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JP led the conceptualization and design of the study and writing of the protocol. FLS, PS, EP, and RB all contributed to the conceptualization and design of the study, reviewed, and revised the protocol.

Corresponding author

Correspondence to Jonathan Purtle.

Ethics declarations

All aspects of the study were approved by the Drexel University IRB (1608004754).

Consent for publication

N/A.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Legislator survey instrument. (DOCX 53 kb)

Additional file 2:

Sample interview questions. (DOCX 49 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Purtle, J., Lê-Scherban, F., Shattuck, P. et al. An audience research study to disseminate evidence about comprehensive state mental health parity legislation to US State policymakers: protocol. Implementation Sci 12, 81 (2017). https://doi.org/10.1186/s13012-017-0613-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-017-0613-9

Keywords

Implementation Science

ISSN: 1748-5908