The evaluation of a tailored intervention to improve the management of suspected viral encephalitis: protocol for a cluster randomised controlled trial
© Backman et al.; licensee BioMed Central. 2015
Received: 17 December 2014
Accepted: 23 December 2014
Published: 27 January 2015
Viral encephalitis is a devastating condition for which delayed treatment is associated with increased morbidity and mortality. Clinical audits indicate substantial scope for improved detection and treatment. Improvement strategies should ideally be tailored according to identified needs and barriers to change. The aim of the study is to evaluate the effectiveness and cost-effectiveness of a tailored intervention to improve the secondary care management of suspected encephalitis.
The study is a two-arm cluster randomised controlled trial with allocation by postgraduate deanery. Participants were identified from 24 hospitals nested within 12 postgraduate deaneries in the United Kingdom (UK). We developed a multifaceted intervention package including core and flexible components with embedded behaviour change techniques selected on the basis of identified needs and barriers to change. The primary outcome will be a composite of the proportion of patients with suspected encephalitis receiving timely and appropriate diagnostic lumbar puncture within 12 h of hospital admission and aciclovir treatment within 6 h. We will gather outcome data pre-intervention and up to 12 months post-intervention from patient records. Statistical analysis at the cluster level will be blind to allocation. An economic evaluation will estimate intervention cost-effectiveness from the health service perspective.
Controlled Trials: ISRCTN06886935.
KeywordsEncephalitis Cluster randomised controlled trial Guideline implementation Protocol
There is evidence that the current clinical management of serious acute neurological infections is suboptimal [1-3]. Encephalitis, inflammation of the brain tissue, is most commonly caused by herpes simplex virus in the United Kingdom (UK) [4,5]. When herpes simplex virus encephalitis is treated promptly with aciclovir, there is a significant improvement in patient outcomes [6,7]. Encephalitis affects between five and eight people per 100,000 per year . Sequelae after hospital discharge can include significant morbidities such as epilepsy, memory loss, and speech and behavioural disorders [9,10], which also impair patients return to work .
Whilst herpes simplex virus encephalitis is relatively rare , clinical presentations including features consistent with suspected encephalitis occur relatively frequently but in different ways to other brain injuries. Encephalitis typically presents with one or more of headache, fever, new-onset seizures, altered consciousness, and behavioural disturbances . This variable and non-specific presentation often results in delayed diagnosis, especially in children who may only present with fever and irritability . Furthermore, delays in using the main diagnostic technique, lumbar puncture, may further delay treatment [13-16].
Clinical guidelines have been developed in response to these problems [1-3,5,17]. However, simple dissemination of clinical guidelines is often unlikely to bring about significant changes in clinical practice [18-20]. Furthermore, interventions to implement clinical guidelines should ideally be based upon a diagnosis of barriers to change, preferably focusing on those most amenable to change .
We developed a multifaceted intervention package including core and flexible components with embedded behaviour change techniques selected on the basis of identified needs and barriers to change (Backman, submitted). We will evaluate the effectiveness and cost-effectiveness of a tailored intervention to improve the secondary care management of suspected encephalitis.
Participating sites will be randomly allocated to intervention or control (no intervention) arms in a cluster randomised controlled trial.
This trial takes place in the context of ENCEPH UK—Understanding and Improving the Outcome of Encephalitis, an ongoing research programme assessing the epidemiology and clinical outcomes of encephalitis. In order to reduce the likelihood of any unintended co-intervention effects we sought hospitals not directly participating in other ENCEPH UK studies. Sites had to have facilities to perform lumbar punctures and neuroimaging and willing to be randomised to intervention or control arms. We aimed to recruit a range of types of hospital, providing secondary, tertiary, (specialist) and paediatric care, to broadly represent national provision and improve the generalizability of subsequent findings.
We were aware that trainee doctors, one key target intervention group, work and rotate between different hospitals within postgraduate deaneries. If we randomised hospitals to intervention and control arms within the same deanery, there would be a risk of contamination. We therefore used deaneries as the unit of randomisation to minimise contamination.
Acute or sub-acute (<4 weeks) alteration in consciousness, cognition, personality or behaviour persisting for more than 24 h. Personality/behaviour change includes: agitation, psychosis, somnolence, insomnia, catatonia, mood liability, altered sleep pattern and (in children) new-onset enuresis or irritability.
Plus any two of:
Fever (≥38°C) or prodromal illness—acute or sub-acute
Focal neurological signs of acute or sub-acute onset, including focal weakness, oromotor dysfunction, movement disorders (chorea, athetosis, dystonia, hemiballismus, stereotypies, orolingual dyskinesia and tics) including Parkinsonism (bradykinesia, tremor, rigidity and postural instability) and amnesia
Pleocytosis: cerebrospinal fluid white cell count of more than four cells per microlitre
Neuroimaging compatible with encephalitis
Electroencephalogram (EEG) compatible with encephalitis
There was an initial clinical suspicion of encephalitis.
There was a clinical suspicion of encephalitis, and the patient died before investigations were completed.
Using theoretically informed semi-structured interviews based upon the Theoretical Domains Framework [23,24], we explored barriers and enablers to diagnosing and managing patients with suspected encephalitis, specifically performing lumbar punctures and initiating antiviral therapy within 6 h (Backman, submitted). We mapped identified barriers and enablers to the patient pathway. We matched behaviour change techniques targeting clinicians to the most salient barriers and enablers and embedded them within an intervention package .
Intervention description using the TIDieR guidelines for intervention reporting 
Overview of component
Modes and frequency of delivery
Where it will take place
Training day (core component)
Investigators were invited to attend a training day where the intervention was showcased and key behaviour change techniques to be communicated to their trainees were highlighted
Senior clinicians were provided with all the paper-based intervention materials in a bound form for reference. Materials were also provided in an electronic form for all study team members
Key behaviour changes and materials were delivered by the study team and a representative from The Encephalitis Society also shared their patient journey
Delivered once per site at the start of the intervention
Took place in a central location with additional local meetings as required
Feedback from this session led to the modification of intervention materials to make them more applicable to each hospital
Action planning meeting (core component)
Following training, investigators were asked to plan an implementation of intervention components
A form was provided which provided key topics to discuss and plan around
Each local PI ran the meeting
Training preceded this meeting, and it was requested that at least one was held prior to any educational sessions
Within each hospital with core team members
Sites could meet as frequently as required
Audit and feedback newsletter (core component)
An audit and feedback newsletter was produced with personalised data alongside an action planning element
Electronic and laminated copies were provided which contained personalised audit data, a link to the guidelines to promote action planning, and space to add local clinical leaders to add credibility
The study team provided the materials with the local clinical leaders distributing to their team
This was delivered electronically and in hard copy for distribution and display alongside all other intervention components
This will be displayed within the hospital nearby the other components such as the poster or the guideline algorithm
This newsletter was personalised to contain audit data from each hospital. It also contained a comparison with other anonymised hospitals, as well as to the recommended time frames for care
Lumbar puncture box (core component)
A refillable box with all the key equipment to perform a lumbar puncture was provided with sample collection information which could be locally modified as required
A box containing equipment for the procedure alongside a sheet detailing sample collection was provided. Adult and paediatric boxes were available due to different sample collection requirements
The study team supplied 2–6 boxes to each hospital as required
Boxes were delivered at the start of the intervention period and on an ad hoc basis
Boxes were placed in relevant locations as designated by each hospital
The sample sheet could be locally modified by each site to accommodate sample procedures
Pre-made lectures with integrated behaviour change techniques were produced for the following uses: - A session focused upon the diagnostic lumbar puncture - A session focused upon the management of suspected encephalitis - A session for nurses on how to help with lumbar punctures
Pre-made lectures were provided alongside a range of other multimedia resources including: - A DVD showing nurses how to assist with the procedure - Two clinical vignettes - The Encephalitis Society YouTube channel - TS’ ‘Big Brain’ event on YouTube
The study team provided the resources for the local team to deliver as required
Sites were able to choose the frequency of delivery, with a recommended minimum of one per 6 months
All training will take place within the hospital and will be delivered by clinicians
These materials can be locally modified with a core set of slides so preserve behaviour change integrity. Furthermore, these are all modified for use in both an adult and paediatric setting and can be used as often as required by the local team
Educational survey (optional component)
An online multiple choice educational survey was developed with tailored questions for doctors and nurses. This online tool can be accessed at any time and all participants can download a certificate of completion
An online multiple choice educational survey was developed. A certificate of completion was awarded with additional checklists and action planning tools
Site PIs were able to circulate this online link to all junior doctors
The trainee would only complete the survey once with a certificate of completion
This could take place during a teaching session or during private study
Two surveys were available with questions tailored for doctors and nursing staff
ClickClinica  (optional component)
An app containing all current guidelines was developed. This has been promoted within our package both within the education and also within the personalised invitation letter as a useful tool
An app has been developed for use with iPhones whereby all guidelines are available in one place
This app was promoted through local clinical leaders
The link to download the app was within the educational sessions and contained within the direct mail letter
Guidelines can be checked and downloaded on the ward or within private study
None available for this component
Encephalitis Society leaflets and video (optional component)
The Encephalitis Society YouTube channel was included as a resource which could be incorporated into the education. Furthermore, patient leaflets will be disseminated to the investigators during the study
Printed materials for the patients and healthcare professionals were provided. These materials were also featured within the educational sessions
These were provided by The Encephalitis Society, forwarded by the study team and disseminated by the local clinical leaders
These were provided at the start and middle of the intervention period with reinforcement from the educational sessions
The YouTube videos could be used during the educational session or within a private study session as part of a critical reflection
None available for this component
A quality improvement cycle (plan, do, study, act (PDSA)) was developed and included: - A summary page with the key guideline recommendations - A short list of key check box items to monitor current practice - An excel sheet which pre-plots the progress
Printed packs were provided alongside an electronic excel sheet with pre-plotting graphs to enable feedback
The study team provided all materials and these were locally disseminated by the clinical leader
Electronic materials were provided at the start of the study with printed materials provided within the 6-month update. Local clinical leaders were encouraged to ask a junior doctor to assess current management and feedback performance data
Within the ward where the local PI is based as part of a post-take ward round. The quality improvement graphs should also be displayed within this area
Junior doctors are able to feedback the areas of compliance they feel are most relevant to the department
Basis of modifiable care pathway (optional component)
The front sheet from the quality improvement cycle could also be modified to form the basis of a care pathway for suspected encephalitis patients. This will be locally driven and implemented at each site
A traffic light coloured sheet with the critical patient management items was provided as a basis to modify
The study team provided the resource and it was then adapted by the local clinical team
This was provided once at the start of the intervention
Local clinical leaders will modify and display in key areas of the hospital
This sheet was to be locally adapted if taken up
Algorithm (optional component)
The algorithm contained within the guidelines was reproduced with two additional features; a QR code which links directly to the guidelines and a box that contained details for local senior support
A laminated guideline algorithm was provided with a QR code to link to the original guidelines and a space for local modification with the additional of a local contact
The study team provided the materials, and they were disseminated throughout the hospital by the local clinical team
A minimum of five were provided to each site at the start and a further five were also provided after 6 months
These will be placed in key areas of the hospital as denoted by the local clinical leader
These are available in adult and paediatric forms and can be locally modified by the addition of a suitable contact if clinical decision support is required
Posters (optional component)
Posters with key symptoms and relevant QR codes were designed and graphics covered paediatric, adults and geriatrics
Three posters were provided to cover a variety of ages alongside the key clinical symptoms. A QR code to the guideline was also incorporated
The study team provided the materials, and they were disseminated throughout the hospital by the local clinical team
A minimum of five were provided to each site at the start, and a further five were also provided after 6 months
These will be placed in key areas of the hospital as denoted by the local clinical leader
None available for this component
Stickers (optional component)
Small stickers with ‘Think brain infection’ were produced for application to blood sample bottles
‘Think brain infection’ stickers were provided to raise awareness during the sample taking procedure
The local study team provided these on an ad hoc basis and the local clinical leaders affixed these to sample bottles as required
These were provided on an ad hoc basis with supplements sent within the 6-month update
These will be added to all relevant bottles as denoted by the study team
None available for this component
Invitation letter (optional component)
A template invitation letter from the consultant inviting the junior doctor to attend each of the education session was developed for local modification. Details of the lumbar puncture box and ClickClinica were also included
An electronic letter was made for each of the educational sessions
The study team provided the basis of a letter which will then be modified and sent by the consultant
This invitation letter can be sent prior to all educational sessions
Letters will be sent directly to the junior doctors to personally invite them to attend the educational session
The basis of the letter was provided for local modification
We presented the package to a 1-day meeting of senior doctors and nurses from intervention hospitals. We emphasised their roles in directly delivering the various intervention components locally and recommended that they each convene an action planning meeting on return to their hospitals.
The primary outcome is a composite measure of the proportion of patients with suspected encephalitis whose care meets both of the following criteria: aciclovir given within 6 h from admission to hospital and a lumbar puncture performed within 12 h of hospital arrival unless clinically contraindicated.
The proportion of all adults started on intravenous aciclovir within an appropriate dosage range for a neurological presentation who met the definition of suspected encephalitis
The proportion of all children started on intravenous aciclovir within an appropriate dosage range for a neurological presentation who met the definition of suspected encephalitis
The proportion of patients with suspected encephalitis who had a lumbar puncture performed within 12 h unless there was a clinical contraindication
The proportion of patients with suspected encephalitis who had a lumbar puncture at any point during the index presentation
The proportion of patients with suspected encephalitis who had either magnetic resonance imaging (MRI) or computer tomography (CT) scan within 24 h of admission
The proportion of patients with suspected encephalitis having had a lumbar puncture, who had the following cerebrospinal fluid (CSF) investigations performed: ratio of glucose within the cerebrospinal fluid and the serum calculated and having herpes simplex virus polymerase chain reaction (PCR) performed
We will also compare outcomes between adults and children.
We recognise that suspected cases would go through one or more of several types of hospital department but mainly paediatrics, neurology, infectious diseases, medical assessment unit, accident and emergency and microbiology. Staff in participating hospitals will identify suspected cases retrospectively by performing two mandatory searches, of discharge codes for encephalitis in the preceding 12 months and of all patients undergoing a lumbar puncture within the same time period. Hospitals can also find eligible patients via records of intravenous aciclovir prescriptions or of orders for cranial CT scan or MRI within the last 12 months. We are using these combined approaches to maximise likelihood of case identification and reduce differences in ascertainment between hospitals. We included both adult and paediatric cases.
Pre-intervention, we collected data to pilot outcome measures and provide data for the feedback intervention. We aimed for 30 adult and paediatric cases per hospital to allow for possible under-recruitment in some of the smaller hospitals; however, we later sought some additional cases from higher recruiting hospitals to better inform exploratory analyses of the baseline data and to compensate for lower recruiting sites. We plan to ask for a further 30 cases per hospital in the final trial data collection, thus the total patient sample size will be a maximum of 720. We anticipate a degree of imbalance between hospitals to achieve the total required sample size, limited by the upper limit of 40 cases per hospital.
Data are collected using structured case review forms. No patient identifiable information is sent to the central trial team. We trained data collectors, mainly nurses and trainee doctors, via face-to-face meetings and/or written briefing materials. We emphasised the need for a systematic approach to case identification to reduce the likelihood of selection bias. The trial research fellow (RB) is monitoring fidelity to the intervention via regular telephone and email contact with relevant hospitals. She is also collecting qualitative data from staff interviews and observational field notes in a sub-sample of four intervention hospitals data as part of a process evaluation.
Sample size estimates for the trial
Number of eligible patients recruited per hospital (M)
Proportion meeting the primary outcome criteria under the intervention ( P )
As explained above, we used deaneries as the unit of randomisation to minimise contamination between hospitals within the same deanery. We defined two blocks of deaneries, a block of six including hospitals (outside of the trial) where research teams were already actively involved in other ENCEPH UK studies and a block of six where there were no such ongoing studies (Figure 1). An independent statistician randomised equal numbers of clusters within each block to the intervention and routine arms, blinded to hospital identity.
We will analyse the results in R (http://www.r-project.org) using a generalised linear mixed model  with binomial errors, logistic link, fixed effects for blocks and treatments, random effects for deanery and for hospital. If the intervention is effective, it will raise awareness of suspected encephalitis and lead to increased documentation in the clinical records of encephalitis as a differential diagnosis. In our baseline (pre-intervention analysis), we found that cases mainly included on this basis (method two) tended to be less likely to comply with the primary outcome criteria. One explanation is that these may represent clinical presentations at lower risk of having encephalitis and may therefore tend to be investigated and treated less thoroughly compared with more strongly suspected cases. It is therefore likely that the intervention will result in differential case mixes between the intervention and control arms, in this scenario diluting any real intervention effect. In our analysis of the outcome data, we will adjust for any relationship between the method of inclusion and compliance with the primary outcomes and analysis will be undertaken by a statistician blind to hospital assignment.
The economic evaluation will take the perspective of the UK National Health Service (NHS). We will use trial records and observations to estimate the costs of intervention delivery. Data on health care resource utilisation will be gathered from case record reviews. Unit costs will be obtained from publicly available routine data [29,30]. Costs and health benefits occurring over 12 months will be discounted at 3.5% per annum. Therefore, results will include, in addition to incremental costs and benefits, an estimate of total cost per patient for each arm. In order to estimate quality-adjusted life years (QALYs), utility values will be estimated from the results of administering the EQ-5D, primary economic outcome, and the SF-6D utility scores derived from the SF-36, following Brazier’s methodology .
We will analyse cost data using regression methods for handling censored cost data and accounting for clustered nature of the data . We will analyse costs and benefits jointly using a bivariate probability distribution. Sample uncertainty in estimated cost difference and incremental cost-effectiveness ratios between arm groups will be described using bootstrapped confidence intervals  as well as with cost-effectiveness acceptability curves. Parameter uncertainty and robustness of findings will be accounted for through univariate sensitivity analysis and probabilistic sensitivity analysis.
Estimates of costs and health outcome (utilities) will be used to populate a model of suspected encephalitis patient management in both intervention and control conditions. The model will cover the remaining patient lifetime within which the (probability of) cost-effectiveness of the alternative will be analysed . Data analysis will be performed using Stata .
The study was reviewed by Preston North West Research Ethics Committee (13/NW/0279) (Additional file 2).
The trial is ongoing with pre-intervention data collection completed; we are yet to undertake post-intervention outcome data collection and analysis.
This paper summarises the independent research funded by the National Institute for Health Research under its Programme Grants for Applied Research scheme (“Understanding and Improving the Outcomes of Viral Encephalitis”; RP-PG-0108-10048). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.
UK National Institute for Health Research (NIHR) Programme for Applied Research: “Understanding and Improving the Outcomes of Viral Encephalitis”; RP-PG-0108-10048.
- Michael BD, Sidhu M, Stoeter D, Roberts M, Beeching NJ, Bonington A, et al. North West Neurological Infections Network. Acute central nervous system infections in adults—a retrospective cohort study in the NHS North West region. QJM. 2010;103(10):749–58.PubMedView ArticleGoogle Scholar
- Bell DJ, Suckling R, Rothburn MM, Blanchard T, Stoeter D, Michael BD, et al. Management of suspected herpes simplex encephalitis in adults in a U.K. teaching hospital. Clin Med. 2009;9(3):231–5.PubMedView ArticleGoogle Scholar
- Kelly C, Sohal A, Michael BD, Riordan A, Solomon T, Kneen R. Suboptimal management of central nervous system infections in children: a multi-centre retrospective study. BMC Pediatr. 2012;12:145.PubMed CentralPubMedView ArticleGoogle Scholar
- Michael BD, Solomon T. Seizures and encephalitis: clinical features, management, and potential pathophysiologic mechanisms. Epilepsia. 2012;53:63–71.PubMedView ArticleGoogle Scholar
- Solomon T, Michael BD, Smith PE, Sanderson F, Davies NWS, Hart I, et al. National Encephalitis Guidelines Developement and Stakeholders Group. Management of suspected viral encephalitis in adults—Association of British Neurologists and British Infection Association National Guidelines. J Infect. 2012;64:347–73.PubMedView ArticleGoogle Scholar
- Hughes PS, Jackson AC. Delays in initiation of acyclovir therapy in herpes simplex encephalitis. Can J Neurol Sci. 2012;39:644–8.PubMedView ArticleGoogle Scholar
- Raschilas F, Wolff M, Delatour F, Chaffaut C, De Broucker T, Chevret S, et al. Outcome of and prognostic factors for herpes simplex encephalitis in adult patients: results of a multicenter study. Clin Infect Dis. 2002;35(3):254–60.PubMedView ArticleGoogle Scholar
- Granerod J, Cousens S, Davies NWS, Crowcroft NS, Thomas SL. New estimates of incidence of encephalitis in England. Emerg Infect Dis. 2013;19(9):1455–62.PubMed CentralView ArticleGoogle Scholar
- McGrath N, Anderson NE, Croxson MC, Powell KF. Herpes simplex encephalitis treated with aciclovir: diagnosis and long term outcome. J Neurol Neurosurg Psychiatry. 1997;63:321–6.PubMed CentralPubMedView ArticleGoogle Scholar
- Mailles A, De Broucker T, Costanzo P, Martinez-Almoyna L, Vaillant V, Stahl J-P. Long-term outcome of patients presenting with acute infectious encephalitis of various causes in France. Clin Infect Dis. 2012;54(10):1455–64.PubMedView ArticleGoogle Scholar
- Solomon T, Hart IJ, Beeching NJ. Viral encephalitis: a clinician’s guide. Pract Neurol. 2007;7:288–305.PubMedView ArticleGoogle Scholar
- Kneen R, Jakka S, Mithyantha R, Riordan A, Solomon T. The management of infants and children treated with aciclovir for suspected viral encephalitis. Arch Dis Child. 2010;95:100–6.PubMedView ArticleGoogle Scholar
- Kneen R, Solomon T, Appleton R. The role of lumbar puncture in suspected CNS infection—a disappearing skill? Arch Dis Child. 2002;87(3):181–3.PubMed CentralPubMedView ArticleGoogle Scholar
- Hasbun R, Abrahams J, Jekel J, Quagliarello V. Computed tomography of the head before lumbar puncture in adults with suspected meningitis. N Engl J Med. 2001;345(24):1727–33.PubMedView ArticleGoogle Scholar
- Heyderman RS, Lambert HP, O’Sullivan I, Stuart JM, Taylor BL, Wall RA. Early management of suspected bacterial meningitis and meningococcal septicaemia in adults. J Infect. 2003;46:75–7.PubMedView ArticleGoogle Scholar
- Kneen R, Solomon T, Appleton R. The role of lumbar puncture in children with suspected central nervous system infection. BMC Pediatr. 2002;2:8.PubMed CentralPubMedView ArticleGoogle Scholar
- Kneen R, Michael BD, Menson E, Mehta B, Easton A, Hemingway C, et al. Management of suspected viral encephalitis in children—Association of British Neurologists and British Paediatric Allergy Immunology and Infection Group National guidelines. J Infect. 2012;64:449–77.PubMedView ArticleGoogle Scholar
- Thomas RH, Smith PE. Encephalitis guidelines: a recipe for success? Clin Med. 2009;9(3):210–1.PubMedView ArticleGoogle Scholar
- Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PAC. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65.PubMedView ArticleGoogle Scholar
- Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw JM. How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011;6:26.PubMed CentralPubMedView ArticleGoogle Scholar
- Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. The Cochrane Database of Systematic Reviews. 2010;3, CD005470. Doi:10.1002/14651858.CD005470.pub2.PubMedGoogle Scholar
- Granerod J, Ambrose H, Davies N, Clewley J, Walsh A, Morgan D, et al. Causes of encephalitis and differences in their clinical presentations in England: a multicentre, population-based prospective study. Lancet Infect Dis. 2010;10(12):835–44.PubMedView ArticleGoogle Scholar
- Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80.View ArticleGoogle Scholar
- Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37.PubMed CentralPubMedView ArticleGoogle Scholar
- Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.PubMedView ArticleGoogle Scholar
- Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.PubMedView ArticleGoogle Scholar
- Michael B, Geleta D. Development of ClickClinica: a novel smartphone application to generate real-time global disease surveillance and clinical practice data. BMC Med Inform Decis Mak. 2013;13:70.PubMed CentralPubMedView ArticleGoogle Scholar
- Breslow NE, Clayton DG. Approximate inference in generalized linear mixed models. J Am Stat Assoc. 1993;88:9–25.Google Scholar
- Health Do: Reference costs guidance 2013–14. In. Edited by Health Do; 2014.Google Scholar
- Curtis L: PSSRU Unit Costs of Health & Social Care 2013. In. University of Kent (United Kingdom); 2013.Google Scholar
- Brazier J, Roberts J, Deveril M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21:271–92.PubMedView ArticleGoogle Scholar
- Grieve R, Cairns J, Thompson SG. Improving costing methods in multicentre economic evaluation: the use of multiple imputation for unit costs. Health Econ. 2010;19(8):939–54.PubMedView ArticleGoogle Scholar
- Chaudhary M, Stearns S. Estimating confidence intervals for cost effectiveness ratios: an example from a randomized trial. Stat Med. 1996;15:1447–58.PubMedView ArticleGoogle Scholar
- Fenwick E, Claxton K, Sculpher M. Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001;10:779–87.PubMedView ArticleGoogle Scholar
- StataCorp. Stata statistical software. 9th ed. College Station, TX: StataCorp LP; 2005.Google Scholar
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.