- Short report
- Open Access
- Open Peer Review
A theory-based evaluation of a dissemination intervention to improve childcare cooks’ intentions to implement nutritional guidelines on their menus
Implementation Science volume 11, Article number: 105 (2016)
Childcare services represent a key setting to implement nutritional interventions to support the development of healthy eating behaviours in young children. Childcare-specific nutritional guidelines outlining recommendations for provision of food in care have been developed. Despite this, research suggests that few childcare services currently implement these guidelines. This study aimed to examine the impact of providing printed educational materials on childcare service cooks’ intentions to use nutritional guidelines and provide fruit and vegetables on their menu.
A randomised controlled trial was conducted with 77 childcare services (38 control and 39 intervention). Intervention service cooks were mailed a two-page educational material together with a menu planning checklist. Intervention development and evaluation was guided by the theory of planned behaviour. Outcome data assessing intentions to use nutritional guidelines and serves of fruit and vegetables provided on menus (primary outcomes) as well as secondary outcomes (attitudes, behavioural regulation and social norms) were collected via a telephone interview with cooks. Relative to the comparison group, cooks in the intervention arm had significantly higher intentions to use the guidelines (p value 0.0005), accompanied by significant changes in perceived behavioural control (p value 0.0008) and attitudes (p value 0.0071). No significant difference in serves of fruit (p value 0.7278) and vegetables (p value 0.0573) was observed.
The use of educational materials can improve childcare service cooks’ intentions to use nutritional guidelines; however, as a standalone strategy, it may not improve provision of food on menus.
Poor nutrition is a leading risk factor for the development of chronic diseases including cardiovascular disease, type 2 diabetes and some cancers . Interventions to improve children’s diet are recommended as a strategy to reduce the burden from dietary risk factors, as dietary behaviours established in young children track into adulthood .
Childcare services represent a key setting to implement healthy eating interventions as they provide broad reach to young children in the population . Systematic reviews report that environmental and educational interventions to improve childcare provision of food and/or healthy eating curriculum can improve child dietary intake . Internationally, countries including Australia have introduced nutritional guidelines to support provision of healthier foods in childcare services [5, 6]. Despite this, research suggests that few childcare providers adhere to these guidelines .
Research suggests that a lack of knowledge of dietary guidelines as well as childcare staff attitudes and perceptions towards the provision of food may represent barriers to provision of foods consistent with guidelines . Education resources  may represent a useful strategy to overcome such barriers to guideline implementation. Systematic review and randomised controlled trial evidence describing the effectiveness of education resources in changing clinician guideline implementation has reported that such interventions have a limited impact on changing provider intentions and behaviour [10–14]. These reviews, however, noted limitations such as insufficient sample sizes and inappropriate analyses . A recent Cochrane systematic review which presented findings from 14 randomised controlled trials found that printed educational material had a small effect on physician practice (including guideline implementation) when compared to no intervention .
Given the potential of educational materials to make a contribution to improving the menus of childcare services at scale, this study aimed to examine the impact of providing printed educational materials on childcare service cooks’ intentions to use nutritional guidelines and provide fruit and vegetables on their menu. As a secondary outcome, attitudes, perceived behavioural regulation and social norms was also assessed.
Ethical approval was provided by Hunter New England and the University of Newcastle Human Research Ethics Committee (HREC). This trial was prospectively registered (ACTRN12615000712505).
In the state of New South Wales (NSW), Australia, childcare accreditation standards require that services provide foods consistent with the 2013 Australian dietary guidelines . To support this, the state government released the Caring for Children resource (2014), which outlines the recommended number of serves of food groups that childcare services should provide .
Design and setting
This study was a parallel group randomised controlled trial, with post-intervention data collection only. Long day care services (centre-based services typically open ≥8 hours/day) located within NSW, Australia, served as the sampling frame. Services were excluded if they did not undertake menu planning on site or where cooks did not understand English sufficiently to complete the survey.
An information statement was sent to service cooks 2 weeks prior to being called and invited to participate in a computer assisted telephone interview (CATI).
Randomisation and allocation
Childcare services were randomly allocated to either the intervention or control condition by a blinded research assistant using a random number function in Microsoft Excel in a 1:1 ratio.
Approximately 6 weeks prior to being sent the information statement, intervention cooks were mailed a two-page education resource and the menu planning checklist from the Caring for Children resource . The two-page educational material was developed by a local health promotion team consisting of dietitians, behavioural scientists and health promotion practitioners. Consistent with evidence for the development of educational materials, the resource included coloured visuals outlining recommended serve sizes, had endorsement from a reputable health promotion organisation and targeted a specific behaviour (menu planning) . The content of the material was guided by the theory of planned behaviour (TPB). Accordingly, the material was designed to address behavioural, social and control beliefs identified as impeding the use of guidelines in menu planning and food provision . Based on formative work undertaken in the childcare setting, key beliefs were identified and strategies to address each applied to the resource (Additional file 1) .
The control group received usual care. All services could access the Caring for Children resource online  and may have been offered support from their local health promotion staff.
Data collection and measures
Outcomes were assessed between July and September 2015 via CATI, administered according to a standard protocol by trained interviewers who were blind to group allocation.
Cooks and service characteristics
Cooks were asked to report on their age, sex, nutrition qualifications, number of years they had been employed as a service cook and the number of hours worked. Service postcode was obtained from centralised records obtained from a state government agency.
A 21-item questionnaire, adapted from previously validated tools, assessing intentions (four items), attitudes (five items), social norms (six items) and perceived behavioural control (six items) was used to assess the constructs from the TPB  (Additional file 2). The items were scored on a seven-point Likert scale ranging from strongly disagree to strongly agree. Mean values were generated to create a single composite score for all TPB constructs (post-test Cronbach’s alpha for intentions 0.79; social norms 0.73; perceived behavioural control 0.73). Cooks reported using a single question, the number of serves of fruit and vegetables provided on their menu in the last week. Cooks were asked to refer to their menu while reporting.
Awareness of the guidelines and other implementation support
Cooks were asked if they had received a copy of the Caring for Children resource and whether they had received any implementation support in the past 6 months.
Cooks reported whether they recalled receiving the educational material and if so how long ago they received it. Those who reported receiving the material were asked if they had used the resource to help plan their menus.
Sample size calculation
Based on estimates from a previous study, assuming a standard deviation of 0.5, a sample size of 78 (39 intervention and 39 control) would allow the detection of a difference in mean score of 0.3 in intentions to use, with 80 % power . For serves of fruit and vegetables, assuming a standard deviation of 1, 78 services would allow the detection of 0.45 differences between intervention and control services, with 80 % power. As no prior knowledge was available regarding a meaningful effect of education interventions in childcare centres, the effect sizes was based on a consensus between study investigators.
Analysis was undertaken using STATA 11.0. Services with postcodes ranked in the top 50 % were categorised as ‘higher socioeconomic status’, and those grouped in the lower 50 % were categorised as ‘lower socioeconomic status’ (SES) using the 2011 Socio-Economic Indexes For Australia (SEIFA) scores . This was compared between consenters and non-consenters using Pearson’s Chi-squared test. Descriptive statistics were generated for all responses and compared between intervention and control groups using appropriate univariate tests. Mean scores for each TPB construct were generated and compared between groups using student’s t test. A two-sided significance value of 0.05 was employed. Mean scores in intentions to use and serves of fruit and vegetable were also reported by whether services received the resource as well as by duration receiving the resource (four or more weeks ago or less than 4 weeks).
Of the 220 services, 106 were ineligible for the following reasons: menu planning did not occur onsite (n = 85, 31.7 %); cooks did not understand English (n = 16, 15.1 %); and others (n = 5, 4.7 %). Thirty-four services did not consent, 14 could not be contacted and 77 (68 % of eligible) (39 controls and 38 intervention) consented. There was no difference in SES between services that consented and did not consent to participate (44 % lower SES for consenters; 31 % lower SES for non-consenters; p value 0.1857). There were also no significant differences in cook and service characteristics between the groups (Table 1).
Overall, 32 (85 %) cooks in the intervention arm reported receiving the material, with time between receiving resource and participation in the follow-up assessment ranging from 1 to 8 weeks. Of those who reported receiving the resource, 19 (59 %) used the resource to plan their menu and 13 (41 %) reported that they were intending to use the resource.
Cooks in the intervention arm had significantly higher mean scores on intentions to use the guidelines (p value 0.0005), perceived behavioural control (p value 0.0008) and attitudes (p value 0.0071) but not for social norm (p value 0.6088) (Table 2) compared to the control group. No significant differences were observed in serves of fruit and vegetables on the menu (Table 2). Mean scores for intentions to use and number of serves of fruit and vegetables on menus were also reported by whether services received the resource and length of time since receipt of the resource (see Table 3).
Awareness of the guidelines and other implementation support
Seventy-nine percent of the control group and 84 % of the intervention group received a printed version of the Caring for Children resource (p value 0.570); and 51 % of the control group and 47 % of the intervention group received other support to implement the guidelines (p value 0.536). Of those receiving support, 61 % had attended a training workshop, 43 % participated in cooks network meetings and 57 % received face-to-face support from their local health promotion units.
In contrast to a previous trial undertaken in primary care , cooks who had received a printed educational resource had significantly higher intentions to use nutritional guidelines, together with perceived behavioural control and attitudes, compared to the control group. No difference in number of serves of fruit and vegetables on menus were observed suggesting that inclusion of education resources as part of multi-component interventions are likely required to modify food provision in care. This finding is consistent with reviews of trials undertaken in the health care setting which report small, but non-significant improvements to provider behaviour . Findings in relation to provision of vegetables (p value 0.0573) appear promising and warrant further investigation using trials powered to detect small but meaningful changes in food provision.
The strengths of the study include its randomised design, blinded outcome assessment and theory-informed intervention development and evaluation. A one-item question was used to assess the provision of fruit and vegetables on menus. This measure is not validated and is likely to result in an overestimation of effect. This study only collected post-intervention data, which limits the ability to assess whether the intervention had differential effects on particular baseline characteristics. The study also had a short follow-up period of up to 2 months. The variation in time (1 to 8 weeks) between receiving the resource and when cooks undertook post-intervention data collection may have impacted on study findings as cooks had variable time to implement changes to their menus.
This study found that the use of printed educational materials can improve childcare service cooks’ intentions to use nutritional guidelines when planning their menus. Others strategies to support implementation however may be required to improve food provision in care.
Institute for Health Metrics and Evaluation. GBD compare. Seattle: IHME, University of Washington; 2015. http://vizhub.healthdata.org/gbd-compare. Accessed 13th November 2015.
Interventions on Diet and Physical Activity: What Works: Summary Report. Geneva: World Health Organization; 2009. Available from: http://www.ncbi.nlm.nih.gov/books/NBK177205/.
Australian Bureau of Statistics. Childhood education and care, Australia, June 2014. Canberra: ABS; 2015. http://www.abs.gov.au/ausstats/abs@.nsf/mf/4402.0. Accessed 13 Nov 2015.
Mikkelsen MV, Husby S, Skov LR, Perez-Cueto F. A systematic review of types of healthy eating interventions in preschools. Nutr J. 2014;13(1):56.
NSW Ministry of Health. Caring for children birth to 5 years (food, nutrition and learning experiences). NSW Ministry of Health. 2014. http://www.healthykids.nsw.gov.au/downloads/file/teacherschildcare/CaringForChildrenManualWEBBOOKMARKCOMPLETEMANUALFeb15.pdf. Accessed 13 Nov 2015.
Neelon SEB, Briley ME. Position of the American Dietetic Association: benchmarks for nutrition in child care. J Am Diet Assoc. 2011;111(4):607–15.
Yoong SL, Skelton E, Jones J, Wolfenden L. Do childcare services provide foods in line with the 2013 Australian Dietary guidelines? A cross‐sectional study. Aust N Z J Public Health. 2014;38(6):595–6.
Pollard CM, Lewis JM, Miller MR. Food service in long day care centres—an opportunity for public health intervention. Aust N Z J Public Health. 1999;23(6):606–10.
Effective Practice and Organisation of Care. EPOC taxonomy. 2015. https://epoc.cochrane.org/epoc-taxonomy. Accessed 13 Nov 2015.
Davis DA, Taylor-Vaisey A. Translating guidelines into practice: a systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. Can Med Assoc J. 1997;157(4):408–16.
Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance: a systematic review of the effect of continuing medical education strategies. JAMA. 1995;274(9):700–5.
Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362(9391):1225–30.
Grimshaw JM, Presseau J, Tetroe J, Eccles MP, Francis JJ, Godin G, et al. Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians’ diabetic retinopathy referrals. Implement Sci. 2014;9(1):86.
Grudniewicz A, Kealy R, Rodseth RN, Hamid J, Rudoler D, Straus SE. What is the effectiveness of printed educational materials on primary care physician knowledge, behaviour, and patient outcomes: a systematic review and meta-analyses. Implement Sci. 2015;10(1):164.
Giguère A, Légaré F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, et al. Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Libr. 2012;10:CD004398. doi:10.1002/14651858.CD004398.pub3.
National Health and Medical Research Council. Australian dietary guidelines. Canberra: National Health and Medical Research Council; 2013. https://www.nhmrc.gov.au/_files_nhmrc/publications/attachments/n55_australian_dietary_guidelines_130530.pdf. Accessed 13 Nov 2015.
Ajzen I. Behavioral interventions based on the theory of planned behavior. 2006. https://people.umass.edu/aizen/pdf/tpb.intervention.pdf. Accessed 13 Nov 2015.
Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50(2):179–211.
Australian Bureau of Statistics. Census of population and housing: Socio-Economic Indexes for Areas (SEIFA), Australia, 2011. Canberra: ABS; 2013. http://www.abs.gov.au/ausstats/abs@.nsf/mf/2033.0.55.001. Accessed 4th May 2016.
The authors acknowledge the funding support of Hunter New England Population Health and Hunter Medical Research Institute and thank participating childcare services and Christophe Lecathelinais for his statistical advice.
SY and LW conceived the intervention concept. JJ, JM, KS, MF and AF contributed to the research design and trial methodology. JW provided significant intellectual input into the interpretation of trial outcomes and manuscript development. All authors contributed to and approved the final version of the manuscript.
The authors declare that they have no competing interests.
About this article
Cite this article
Yoong, S.L., Jones, J., Marshall, J. et al. A theory-based evaluation of a dissemination intervention to improve childcare cooks’ intentions to implement nutritional guidelines on their menus. Implementation Sci 11, 105 (2015) doi:10.1186/s13012-016-0474-7
- Childcare services