Educational outreach to general practitioners reduces children's asthma symptoms: a cluster randomised controlled trial
© Zwarenstein et al; licensee BioMed Central Ltd. 2007
Received: 04 January 2007
Accepted: 24 September 2007
Published: 24 September 2007
Childhood asthma is common in Cape Town, a province of South Africa, but is underdiagnosed by general practitioners. Medications are often prescribed inappropriately, and care is episodic. The objective of this study is to assess the impact of educational outreach to general practitioners on asthma symptoms of children in their practice.
This is a cluster randomised trial with general practices as the unit of intervention, randomisation, and analysis. The setting is Mitchells Plain (population 300,000), a dormitory town near Cape Town. Solo general practitioners, without nurse support, operate from storefront practices. Caregiver-reported symptom data were collected for 318 eligible children (2 to 17 years) with moderate to severe asthma, who were attending general practitioners in Mitchells Plain. One year post-intervention follow-up data were collected for 271 (85%) of these children in all 43 practices.
Practices randomised to intervention (21) received two 30-minute educational outreach visits by a trained pharmacist who left materials describing key interventions to improve asthma care. Intervention and control practices received the national childhood asthma guideline. Asthma severity was measured in a parent-completed survey administered through schools using a symptom frequency and severity scale. We compared intervention and control group children on the change in score from pre-to one-year post-intervention.
Symptom scores declined an additional 0.84 points in the intervention vs. control group (on a nine-point scale. p = 0.03). For every 12 children with asthma exposed to a doctor allocated to the intervention, one extra child will have substantially reduced symptoms.
Educational outreach was accepted by general practitioners and was effective. It could be applied to other health care quality problems in this setting.
Asthma is common among children in Cape Town, South Africa, and is of great concern to the relatively poor communities where rates are highest, and where understanding of the disease and treatment adherence are poor [1, 2]. Although South African guidelines for childhood asthma have been in the public domain for a decade , like elsewhere in the world , asthma is underdiagnosed by primary care doctors, prescribing is often inappropriate, and care is provided episodically .
In Cape Town, tax-funded public health care provides for the uninsured through a network of ambulatory care centres where nurses triage and doctors diagnose, prescribe, or refer to specialist care at public hospitals . This system is free to children under the age of 13. However, for reasons of convenience, confidence, and personalised care, many residents of Mitchells Plain, the suburb in which this study took place, both with and without insurance, seek private sector primary care for their children.
Mitchells Plain is a dormitory town 30 km from Cape Town with a population of 300,000 people. Racially classified in the apartheid era as 'coloured', the residents suffered severe discrimination, with resulting social problems including high unemployment, overcrowded accommodation, poverty, alcohol and drug abuse, and criminal and family violence.
Educational outreach (or academic detailing)  involves a trained messenger delivering one or more educational messages to a healthcare professional, and is a generally promising method of modifying health professional behaviour , though it has not been effective in changing the practise of primary care for childhood asthma in developed countries , and has never been evaluated in a lower- or middle-income setting for this purpose. This study evaluated the effect of academic detailing on the outcome of physician provided primary care for children with asthma in a cluster randomised controlled trial in an African setting.
The design was a cluster randomised controlled trial with the general practices as the unit of randomisation, intervention, and analysis. The study conforms to the Consort group recommendations for such trials  and was analysed on an intention to treat basis (see additional file 2).
A list of practices was composed in 1998, after identifying practitioners named in the baseline data from the medical register and telephone directory. Practices within the study area were numbered and randomised to two groups using a computer-generated list of random numbers.
We included all general practitioners, both practice principals and their hired doctors, working in private practice in Mitchells Plain. There were no multipartner practices. We included all schoolchildren up to age 17 living in the study area and their preschool siblings two years old or older with moderate to severe asthma. We determined their eligibility based on their answers to parent self-administered questionnaires and confirmatory face-to-face interviews conducted three months later.
Barriers to diagnosis and treatment
Physician reported barriers to diagnosis
Physician reported barriers to successful treatment
Doctors find diagnostic criteria confusing
Fear of side effects of steroids
Insufficient consultation time for history, examination, peak flow measurement
Fear of addiction to inhalers
Organisation of care necessitates instant diagnosis (lack of continuity of care, leads to
Excessive antibiotic use
Organisation of care necessitates instant diagnosis (lack of continuity of care, leads to episodic approach cash payment and fee for service discourage repeat visits)
Cost of chronic medication
Masking by respiratory tract infection and by oral bronchodilator syrup
Poor patient understanding, adherence and inhalation technique
Passive smoke exposure in the home
High symptom tolerance in the community
Strong community belief in emotional cause of asthma discourages medical treatment
Doctor hopping prevents follow-up
The eight key messages delivered to general practitioners
Rely on a history of recurrent chestiness as a diagnostic indicator
Preferentially prescribe inhaler over oral therapy
Prescribe using a treatment algorithm based on asthma severity
Appropriately prescribe inhaled anti-inflammatory therapy
Demonstrate and encourage patients to use home-made spacers
Prescribe short-course oral steroids for exacerbations of asthma
Recall patients for regular follow-up care
Encourage parents to avoid smoking near asthmatic children
The principal outcome for the trial was the change in an individual child's asthma symptom score reported by the parent or guardian before and after the intervention. The South African Consensus guidelines use a severity grading of childhood asthma based on frequency of attacks of tight chest, nocturnal coughing, and nocturnal waking, hospital admissions, and peak flow rate. The three attack frequency questions were amenable for use in a brief interview, and were weighted by zero to three points, according to frequency of episodes in the previous 12 months, using weights developed in a previous study in this community , where one to two episodes equalled one point, three episodes equalled two points, and four or more episodes equalled three points (see additional file 1).
The score obtained for these three frequency questions was added to give a total score. The maximum score attainable was nine points and the minimum score attainable was zero points. Children with the highest pre-intervention symptom scores were included until the desired sample size for the trial was obtained. In contrast with the specific symptom questions in the score, we also asked parents a number of questions designed to measure their perception of the child's asthma severity and the effect of asthma on participation in usual activities such as school (see additional file 1).
Initially, parents completed a self-administered asthma screening survey for their primary school children and younger siblings, distributed via the primary schools in the study area. In later rounds, parents of those children identified from the returned screening questionnaires as having moderate or severe asthma symptom scores and a regular private doctor were interviewed face-to-face in their homes by experienced and trained fieldworkers before the intervention and one year later (1999). Self administered questionnaires and interviews were completed in the respondents chosen language. Interviewers and parents were blinded as to the allocation of practitioners.
The process was designed to obtain a group of children whose parents consistently reported their usual source of care as one or more participating private practitioners, and whose pre-intervention symptoms were compatible with moderate to severe asthma. We thus excluded at screening children whose parents reported no usual private general practitioner, or whose home address was outside Mitchells Plain. At the baseline face-to-face interview, we also excluded children whose parents reported that their child's usual family practitioner was outside the study area, and at follow-up face-to-face interview, we further excluded children whose parents identified as their practitioner a doctor who was not on our list of randomised practitioners.
We wished to detect a clinically meaningful improvement, 0.5 standard deviations, in the symptom score between intervention and control groups . We assumed a standard deviation of one, 5% significance, 80% power, and an intracluster correlation coefficient of 0.17 (similar to primary care practices in other countries ). With 43 available clusters, we needed 15 patients per cluster, for a total of 280 patients .
Data were collected on paper and entered into a computer. They were managed and analysed using SAS (Version 8.2. SAS Institute Inc., Cary, NC, USA). We report univariate descriptions, cross-tabulations with chi-squares, and, for adjusted analysis of the principal outcome, the asthma symptom score, we report a linear regression analysis on the change in asthma symptom score from pre-to post-intervention evaluation. The clustered design was accommodated by fitting the generalised estimating equation version of the linear regression model with an exchangeable working correlation model. To check the findings of the linear model on the change scores, an ordinal logistic regression analysis using the proportional odds model was carried out on the post intervention score . Since the results were corroborated, only the linear model with change scores is reported. The variables included in the model, decided a priori, were the baseline score and the number of visits to the usual practitioner during the study period. We conducted the adjusted analysis using Proc GENMOD in SAS.
Ethics and consent
Permission to contact parents of schoolchildren to complete a survey was obtained from the Department of Education for the province, and then, during an information meeting at each of the primary schools in the study area, permission was sought from, and granted by, each school principal and class teacher.
Plain language explanations of the purpose of the study and its voluntary nature were included with the self-administered questionnaire sent to parents. Return of the questionnaire indicated consent to use the data. During home visits, the study was again explained and confirmatory verbal consent was obtained.
Intervention group practitioners were contacted to obtain an appointment for the academic detailing visit. At the beginning of the visit, some well-known problems of asthma care and the academic detailing intervention were outlined, and the doctor's participation in an evaluation of the intervention was invited. No monetary reward was offered. Control group practices received a hand-delivered copy of the then current South African childhood asthma guideline. Because practitioner records were not used for identification or follow-up of children with asthma, no permission was required from practitioners for this element of the study.
Ethical approval for the study was granted by the Medical Research Council of South Africa Ethics Committee.
Comparability of practitioners and practices
Up to 10 years since physician registered
11–20 years since registration
More than 20 years since registration
0 – 5 children with asthma in practice
>5 children with asthma in practice
Comparability of children between study arms
Mean age in years (range)
7.5 (1 – 17)
7.7 (1 – 17)
Number of girls (%)
Number of boys (%)
Children in the intervention group (n = 126) ranged from 1 to 17 years of age (median, 7.5 years), with an equal number of boys and girls. Children in the control group (n = 145) also ranged from 1 to 17 years of age (median, 7.7 years), with 70 boys and 75 girls (Table 4).
Change in score
Estimated Intervention Effect Mean (95%CI)
p-value from GEE model
Pre-intervention mean score
Post-intervention mean score
0.84 (0.10; 1.58)
Pre-post difference adjusted for number of physician visits
0.85 (0.21 ;1.48)
At baseline, the mean asthma symptom score was higher in the intervention group, suggesting a slightly more severe distribution of disease in that group (Table 5). Adjusting for the baseline difference using ordinal logistic regression produces an odds ratio (rather than a mean difference) that is consistent with the unadjusted results (OR = 1.48, 95% CI 1.00 – 2.20, p = 0.049).
To investigate the effect on the principal outcome measure of the number of visits to the specified physician, this factor was added to the model as a linear effect. The estimated intervention effect (Table 5) was close to the unadjusted intention to treat analysis, but with a narrower confidence interval. Children with more frequent physician visits had a non-significant tendency towards smaller symptom changes (slope of -1.41, p = 0.10). The slope was similar in both intervention and control groups.
Subjective assessments of well-being and impact
Subjective assessments of well-being and impact
Intervention % (n)
Control % (n)
Breathing problems improved compared to 12 months previously
Chest problems create little or no problem for child school activities
This study appears to be the first to show improvements in childhood asthma symptoms in a lower or middle income country following educational outreach. The measure of outcome has not been formally validated. However, it is a simple set of symptoms that are a commonly occurring feature of the disease, well known to parents, and thus the measure has high face validity. In addition, when used in a randomised trial as here, error and poor recall would bias towards a null effect. The substantial effect on symptoms which we found is therefore likely to be an underestimate of the true effect of this intervention.
The improvement in asthma symptoms is unlikely to be explained by bias, because the intervention and control patients and practitioners were comparable at outset, the analysis was by intention to treat, there was no loss to follow-up among practices, and little differential loss to follow-up of patients.
Identification of patients through a school-based survey rather than practice records protected the study against possible bias from differences in recordkeeping standards and reduced logistical difficulties. Collecting data from schools also minimised the impact of the trial on physicians' awareness and possible changes in behaviour due to that awareness. It also enabled us to measure the effect of the intervention on unselected practitioners rather than on volunteers. The results are therefore likely to be applicable and useful in similar settings.
Only one practitioner refused the outreach visits, and his patients were analysed in the allocated group, and the result is thus a real world finding. Academic detailing was a welcome intervention in practice settings such as these, as demonstrated in accompanying qualitative research reported elsewhere . It is likely that this finding is applicable wherever physicians are relatively isolated from their colleagues.
The decline in reported symptoms over one year in both the intervention and control groups was likely due to aging of the children in the study, and may also be due to regression to the mean. The intervention reduced asthma symptoms even further in the intervention group (0.84). For a cut point of six or above on the nine point symptom scale that was used, one additional child in the intervention practices benefited for every 12 children cared for in those practices
In contrast with the improvement in asthma symptoms, there were no improvements in well-being or burden of the disease, as measured by global questions. This might be due to the high threshold of response to illness in a relatively poor community, the insensitivity of global questions in comparison to the very specific and memorable events tapped by the symptom severity questions in the scale, or the lack of power for the global questions, which were dichotomous.
Few other studies of educational outreach have measured health outcomes, few have been undertaken in private practice in a poor urban community, and none have measured outcomes using a school-based survey rather than medical records or administrative databases. These pragmatic characteristics of this trial increase its relevance in this setting, widen its applicability, and demonstrate that it is possible to conduct rigorous evaluations of behaviour change interventions in low and middle income settings.
Alongside this study we explored physicians' perceptions of the outreach visits through qualitative means, described in reports available elsewhere . Although it would have been too complicating in this trial to have used survey instruments to study the processes leading to behaviour change, other researchers may consider incorporating such embedded evaluations of these processes in future studies.
The setting in which the intervention was applied was a difficult one with individual storefront practices, where physicians have very little organisational support. The main source of treatment information in such practices is likely to be from drug company representatives. Using the familiar drug company detailing model, we were able to meet with practitioners and tailor the message to their needs and conceptions of the problem.
This intervention appeared affordable for a low-to middle-income country like South Africa, and would add about 0.01% to the annual public sector healthcare budget for each condition at which outreach was aimed, if used nationwide once per physician per annum. We also have successfully used an educational outreach approach to nurse clinicians in even more impoverished and rural parts of South Africa . Policymakers in similar settings could consider introducing publicly funded outreach visits as a potentially cost-effective way to improve the quality of care given by isolated providers in both public and private health care sectors, and thereby, improve health outcomes.
National Asthma Education Programme for support and advice, Department of Education of the Western Cape Province for permission and access, the schools, principals, teachers, general practitioners, parents and children of Mitchells Plain, South Africa for their support, patience and participation, and the fieldworkers and fieldwork supervisor for data and fieldwork management. Funding provided by: Medical Research Council, South Africa; Department of Science and Technology, South Africa; Departments of Paediatrics and Community Health, University of Cape Town, South Africa; European Commission, International Co-operation, Developing Countries and GlaxoSmithKline, South Africa (unrestricted research grant). None of the sponsors played any role in any stage of the research, and none saw or commented on the data or the manuscript.
- Ehrlich RI, Bourne DE: Asthma deaths among coloured and white South Africans: 1962 to 1988. Respir Med. 1994, 88: 195-202. 10.1016/S0954-6111(05)80347-6.View ArticlePubMedGoogle Scholar
- Jones SL, Weinberg M, Ehrlich RI, Roberts K: Knowledge, attitudes, and practices of parents of asthmatic children in Cape Town. J Asthma. 2000, 37: 519-28. 10.3109/02770900009055479.View ArticlePubMedGoogle Scholar
- South African Childhood Asthma Working Group: Management of childhood and adolescent asthma. 1994 consensus. S Afr Med J. 1994, 84: 862-6.Google Scholar
- Finkelstein JA, Lozano P, Shulruff R, Inui TS, Soumerai SB, Ng M, Weiss KB: Self-reported physician practices for children with asthma: are national guidelines followed?. Pediatrics. 2000, 106 (Suppl 4): 886-96.PubMedGoogle Scholar
- Ehrlich RI, Jordaan E, du Toit D, Volmink JA, Weinberg E, Zwarenstein M: Underrecognition and undertreatment of asthma in Cape Town primary school children. S Afr Med J. 1998, 88: 986-94.PubMedGoogle Scholar
- Transforming the health sector. Viewed February 15 2005. [http://www.southafrica.info/ess_info/sa_glance/health/923086.htm]
- City of Capetown – economics. Viewed February 15 2005. [http://www.capetown.gov.za/home/economic.asp]
- Soumerai SB, Avorn J: Principles of educational outreach ('academic detailing') to improve clinical decision making. JAMA. 1990, 263: 549-56. 10.1001/jama.263.4.549.View ArticlePubMedGoogle Scholar
- Thomson O'Brien MA, Oxman AD, Davis DA, Haynes RB, Freemantle N, Harvey EL: Educational outreach visits: effects on professional practice and health care outcomes (Cochrane Review). The Cochrane Library. 2004, Chichester, UK: John Wiley & Sons, Ltd, 1Google Scholar
- Witt K, Knudsen E, Ditlevsen S, Hollnagel H: Academic detailing has no effect on prescribing of asthma medication in Danish general practice: a 3-year randomized controlled trial with 12-monthly follow-ups. Family Practice. 2004, 21: 248-253. 10.1093/fampra/cmh306.View ArticlePubMedGoogle Scholar
- Campbell MK, Elbourne DR, Altman DG, CONSORT group: CONSORT statement: extension to cluster randomised trials. British Medical Journal. 328 (7441): 702-8. 10.1136/bmj.328.7441.702. 2004 Mar 20;Google Scholar
- Bheekie A: Pharmacist educational outreach for improved primary care of asthma in children [Pharm D thesis] School of Pharmacy. 2001, University of the Western Cape; Bellville, South AfricaGoogle Scholar
- Steen N, Hutchinson A, McColl E, Eccles MP, Hewison J, Meadows KA, Blades SM, Fowler P: Development of a symptom based outcome measure for asthma. BMJ. 1994, 309: 1065-8.View ArticlePubMedPubMed CentralGoogle Scholar
- Campbell MK, Grimshaw JM, Steen N, for the Changing Professional Practice in Europe Group: Sample size calculations for cluster randomised trials. J Health Serv Res Policy. 2000, 5: 12-16.PubMedGoogle Scholar
- Campbell M: Clusmean software package. 1996, unpublishedGoogle Scholar
- McCullagh P: Regression models for ordinal data. J R Stat Soc Ser B. 1980, 42: 109-142.Google Scholar
- Fairall LR, Zwarenstein M, Bateman ED, Bachman ED, Lombard C, Majara B, Joubert G, English RG, Bheekie A, van Rensburg D, Mayers P, Peters AC, Chapman RD: Effect of educational outreach to nurses on tuberculosis case detection and primary care of respiratory illness: pragmatic cluster randomized controlled trial. British Medical Journal. 2005, 331: 750-754. 10.1136/bmj.331.7519.750.View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.