- Research
- Open access
- Published:
A patient-centered network approach to multidisciplinary-guideline development: a process evaluation
Implementation Science volume 9, Article number: 68 (2014)
Abstract
Background
Guideline development and uptake are still suboptimal; they focus on clinical aspects of diseases rather than on improving the integration of care. We used a patient-centered network approach to develop five harmonized guidelines (one multidisciplinary and four monodisciplinary) around clinical pathways in fertility care. We assessed the feasibility of this approach with a detailed process evaluation of the guideline development, professionals’ experiences, and time invested.
Methods
The network structure comprised the centrally located patients and the steering committee; a multidisciplinary guideline development group (gynecologists, physicians, urologists, clinical embryologists, clinical chemists, a medical psychologist, an occupational physician, and two patient representatives); and four monodisciplinary guideline development groups. The guideline development addressed patient-centered, organizational, and medical-technical key questions derived from interviews with patients and professionals. These questions were elaborated and distributed among the groups. We evaluated the project performance, participants’ perceptions of the approach, and the time needed, including time for analysis of secondary sources, interviews with eight key figures, and a written questionnaire survey among 35 participants.
Results
Within 20 months, this approach helped us develop a multidisciplinary guideline for treating infertility and four related monodisciplinary guidelines for general infertility, unexplained infertility, male infertility, and semen analysis. The multidisciplinary guideline included recommendations for the main medical-technical matters and for organizational and patient-centered issues in clinical care pathways. The project was carried out as planned except for minor modifications and three extra consensus meetings. The participants were enthusiastic about the approach, the respect for autonomy, the project coordinator’s role, and patient involvement. Suggestions for improvement included timely communication about guideline formats, the timeline, participants’ responsibilities, and employing a librarian and more support staff. The 35 participants spent 4497 hours in total on this project.
Conclusions
The novel patient-centered network approach is feasible for simultaneously and collaboratively developing a harmonized set of multidisciplinary and monodisciplinary guidelines around clinical care pathways for patients with fertility problems. Further research is needed to compare the efficacy of this approach with more traditional approaches.
Background
Complex multidisciplinary care is often fragmented and suffers from so-called ‘clinical linkage deficiencies’ [1]. To resolve such deficiencies, many published reports and articles have stressed the importance of implementing integrated and patient-centered care by building bridges between the groups involved [2–6]. Clinical practice guidelines (CPGs) are potential tools for facilitating this shift in clinical care. Unfortunately, the quality of the guidelines varies, and their impact on delivering integrated and patient-centered care is still suboptimal [7–12]. Several problems still hinder CPG development and uptake, namely, inadequate management of conflicts of interest (COIs), limited panel composition, lack of patient involvement, and lack of external review [9]. Furthermore, there is still a strong focus on the single clinical aspects of diseases described in the guidelines rather than on ensuring more integrated care for patients, including attention to matters such as patient-centeredness, coordination and continuity of care. Because of all this, the target users feel no affinity with the guidelines, which impedes full implementation [7, 8, 10].
Clinical networks are defined as collaborative, professionalized structures ranging from fully integrated service delivery systems to informal communities of practice. These networks have previously proven effective in increasing evidence-based practice and improving care models [13, 14]. We aimed to resolve the deficiencies in multidisciplinary guideline (MuG) development and to re-center the focus on the patient’s overall clinical journey rather than independent contributions from each specialty or caring function. Thus, we used the network approach in a clinical area of complex multidisciplinary care, namely, fertility care. We developed a harmonized set of one MuG and four monodisciplinary guidelines (MoGs) around patient clinical pathways, including any care needed for infertile couples (such as aftercare and care given by physicians, gynecologists, and/or urologists). We aimed to assess the feasibility of this patient-centered network approach in a detailed evaluation of the process, professionals’ experiences, and the time required.
Methods
Setting
The Dutch Organization for Health Research and Development (ZonMw) funded our project, which took place within the Dutch program of Knowledge Quality and Curative Care. The program’s objective was to improve the development of multidisciplinary CPGs in terms of innovation, collaboration, and efficiency.
Fertility care
Infertility is commonly defined as ‘any form of reduced fertility with prolonged time of unwanted non-conception’,, and it affects approximately 80 million couples worldwide [15, 16]. Dutch fertility care takes place on three levels. Physicians provide primary care that includes an initial fertility assessment. A physician can refer couples to a gynecologist in a general hospital (secondary care) or a university hospital (tertiary care). The gynecologist completes the fertility assessment, determines the cause of infertility, and defines a treatment plan. If a relevant male factor is found, the couple may be referred to an urologist. Clinical chemists and embryologists are also involved in assessments and preparation for the use of medically assisted reproductive techniques, one of which is in vitro fertilization (IVF). Because infertility has a high emotional and psychological impact that can interfere with work, psychologists and occupational physicians are regularly involved with the clinical course of the infertility problem.
The network
Our steering committee, which included five guideline experts, one implementation expert, and one project coordinator, initiated and coordinated the patient-centered network approach to MuG development. A group of gynecologists, physicians, urologists, clinical embryologists, clinical chemists, a medical psychologist, an occupational physician, and two patient representatives from Freya (the Dutch association for people with fertility problems) assembled to collaborate in developing the guidelines in February 2008. Four MoG groups, including participants mainly from single disciplines, and one MuG group convened to develop the guidelines.
An overlap of participants from the same discipline across the groups and the project coordinator facilitated guideline harmonization. The project coordinator was a member of all five groups and gave feedback to the steering committee. The implementation expert assured attention to the future implementation and anticipated any potential barriers to guideline implementation during all development phases. An independent researcher (MS) evaluated the project.
The network structure consisted of three organized layers comprising seven groups: the centrally located infertile patients and the steering committee, the MuG group, and four MoG groups. For our purposes, this network was to produce one patient-centered MuG on infertility and four related, mainly monodisciplinary owned guidelines. These four included a guideline on general infertility for physicians, a guideline on unexplained infertility for gynecologists, a guideline on male infertility for urologists and gynecologists, and a guideline on semen analysis for clinical embryologists.
Guideline development
Managing conflicts of interest (COIs)
Before starting the guideline development, all members of the groups had to declare any COIs and be officially mandated by their societies. The steering committee discussed all COIs. Participants with significant COIs were excluded from discussions or voting on recommendations for which they had COIs.
Defining the scope and key questions
We explored the care aspects in the clinical pathways of infertile patients. We paid particular attention to improvements that the patients and professionals found necessary. Various methods were used to collect data about the most relevant aspects.
We conducted 12 exploratory interviews with couples facing the spectrum of issues in the main phases of the clinical pathways in fertility care. These phases may include a physician’s initial fertility assessment, a gynecologist’s fertility assessment, treatment with ovulation induction, intrauterine insemination, IVF, and/or intracytoplasmic sperm injection by a gynecologist, a urologist’s care, and aftercare (whether pregnancy occurred or not). The couples were consecutively invited to participate by means of an information letter that they received when they saw a gynecologic resident in a fertility clinic in Nijmegen or Amsterdam. We phoned potential participants—Dutch-speaking couples with fertility problems who reacted positively to the information letter. The selection of couples was random except for their phase in the clinical pathway. The steering committee translated care aspects that the couples said needed improvement into patient-centered key questions.
Two focus groups were conducted among members of the MuG group, including the two patient representatives, and among main target users of the guideline, including four gynecologists, three physicians, and a urologist. The steering committee translated care aspects that the professionals said needed improvement into medical-technical, organizational, and patient-centered key questions. Example questions for these three categories, respectively, are: ‘What are the indications for IVF treatment?’ ‘Which professionals should be part of the treatment team in a university hospital?’ ‘How should patients be informed about adoption?’
All key questions were given a format defined for the MuG. Then the MoG groups addressed the medical-technical questions and the MuG group addressed the organizational and patient-centered questions.
Elaborating key questions and formulating recommendations
The participants worked in pairs. They used the PICO (patient, intervention, comparison, and outcome) method to define their search strategy, conduct a systematic literature review, select relevant evidence, and summarize this evidence in formatted evidence tables. They rated (scale: 1 to 5) the evidence according to quality criteria adapted from the Center for Evidence-Based Medicine, version 1999 [17]. The pairs of members then formulated one or more conclusions, their considerations, and one or more concept recommendations. A level of evidence (A to D) was given for each recommendation to be discussed in the particular guideline group [17]. The project coordinator was a member of all guideline groups and coordinated the entire process, which was part of a strategy for harmonizing recommendations across the groups. The project coordinator checked the rating of evidence and grading of recommendations for errors. The steering committee discussed and resolved any discrepancies. The implementation expert checked and improved the implementability of the concept recommendations and the guidelines as a whole using the items of the Guideline Implementability Appraisal (GLIA) Tool. An extensive internal review of the CPGs across the groups was used to harmonize the recommendations. Many patients also participated by formulating and prioritizing recommendations for the MuG [18].
We used advertisements and mailings over a period of seven months to invite patients with fertility problems to formulate recommendations via the Dutch online wiki-based tool at http://www.freyawiki.nl[18]. A patient representative and two members of the steering committee including the implementation expert modified and assessed the implementability of the patient recommendations with the GLIA Tool. Then we asked patients to select their top three or five recommendations for each wiki section (General care, General practice care, Gynecologic care, Urologic care, and Laboratory) [18]. The guideline group assessed the eligibility of the final set of patients’ recommendations within the scope of the guideline.
Integrating the guidelines
The MoGs addressed medical-technical aspects of care that needed improvement: physician care, care for patients suffering from unexplained infertility or male infertility, and fertility care given by clinical embryologists (semen analysis). The definitive MuG described the overall clinical pathway of patients with fertility problems by merging the main medical-technical, patient-centered, and organizational recommendations from the MuG and MoG groups and the prioritized patient recommendations from WikiFreya [18]. The medical-technical recommendations included transitions in fertility care and care alignment. The patient-centered recommendations dealt with respect for patients’ values, preferences, and needs; information, communication, and education; emotional support; partner involvement; and the attitude of the fertility clinic staff. The organizational recommendations addressed coordination and integration of care, physical comfort, transition and continuity of care, access to care, and staff competence and technical skills. All patient recommendations obtained via WikiFreya were classed as Level P (Patient) evidence. To express patients’ input in the guideline, two patient representatives reformulated patient recommendations as: ‘Patients want to….’ The whole project was planned to be completed in 18 months.
Evaluation
We applied a stepwise process evaluation to the feasibility of this network approach [19]. The primary outcomes were ‘how’ the planned project was actually carried out and ‘how’ participants perceived the process; the secondary outcome was ‘what’ time was invested. We used a mixed-method evaluation including examination of secondary resources (such as project descriptions), interviews with key figures, and a written questionnaire survey among all participants. An independent researcher (MS) conducted the interviews and collected the data.
Data collection
Examination of secondary resources
We collected all the project data from the project descriptions and minutes of meetings to determine whether the project was carried out as planned.
Interviews with key figures
We conducted eight semistructured, in-depth, telephone interviews with eight key figures: the chairpersons of the four MoG groups, four members of the MuG group, and the steering committee (one patient representative, two project leaders, and the project coordinator). We asked the interviewees to chronologically describe the guideline development and their activities in the project. We asked for comments on the overall organization, the methodology of the network approach, the methods of patient involvement. Then we asked for suggestions to improve the approach. Full interviews took approximately 30Â min each, and they were fully transcribed verbatim.
Questionnaire survey
We based our questionnaire on the interview results so that we could assess participant experiences and measure the time needed for the project. The first part of the four-part questionnaire asked about participants’ background characteristics. The second part pertained to participants’ involvement in the preparation and development phase and the time (excluding travel) needed for each of these phases. The third part included five open questions about the network approach (e.g., the methodology and guideline integration), patient involvement, wiki methodology, and patient contributions to the guideline. The fourth part asked participants to describe facilitators of and barriers to the approach and to suggest improvements. All participants received the questionnaire by post, after the draft guidelines were completed. A reminder was sent six weeks later.
Data analysis
We used SPSS (version 16.0 for Windows, Data Entry 4.0, SPSS, Chicago, Ill.) to perform descriptive statistics (frequencies, medians, and ranges) on participant background characteristics and to analyze the time data. We used Kwalitan (version 5.0, Malden, The Netherlands) to qualitatively analyze the transcripts of the interviews and the free text responses from the second part of the questionnaire [20].
Project performance
Two authors (MH and RH) identified all activities and categorized them in the preparation phase or the development phase. The preparation phase included composing development groups, managing COIs, identifying care aspects to be improved, and developing WikiFreya. The development phase included attending meetings, formulating key questions, reviewing, selecting and assessing evidence, writing the guideline and formulating recommendations, harmonizing the guidelines, reviewing and revising draft guidelines, and aligning the guidelines with managing WikiFreya. We compared the actual activities with the planned activities and identified differences.
Time investments
We counted the regular and extra meetings on the attendance lists, and determined the mean meeting participation rates for each group and the steering committee. We calculated the total time the steering committee spent on the preparation phase. We computed the median actual time for the respondent meetings of each development group, total time for extra respondent meetings, and median extra time respondents spent for each development group and for each of the two phases. The total time for meetings for each group, including the project coordinator was assessed as the ‘mean participation rate’ x ‘number of meetings’ x ‘median time investments’. The total extra time needed was defined as the ‘number of participants for each group’ x ‘median extra time spent by each participant’. The values were corrected for non-responders to the questionnaire. We calculated the project coordinator’s extra time separately. Our calculations totaled the time needed for the development phase.
Experiences
We analyzed the data descriptively, and we used a special framework to analyze open question responses. We developed the special framework from the interview topic guide corresponding to our study objectives, which included experience with the methodology of the network approach, patient involvement, barriers to and facilitators of the approach, and suggestions for improvement [21]. Two researchers (EB and MH) studied the interviews and the open question responses independently. They identified and coded the parts of the interviewees’ responses that were relevant to the study objectives. They then discussed key issues and discrepancies between their results. The key issues were structured with a view to the study objectives. The questionnaire was based on the interviews, so we only present the results of the questionnaire for each study objective, but no information found under the heading ‘Organization’.
Results
Participants
Five (four MoG and one MuG) groups were installed in May 2008. None of the members of the groups declared significant COIs, and all of them were officially mandated by their societies. One of the physicians involved in the MuG group dropped out for private reasons two months later. The MuG chairperson, a physician, concurrently fulfilled this role. Overall, 32 participants were involved in the five groups (Table 1). Four participants fulfilled multiple roles: the project coordinator was a member of the steering committee and all five guideline groups; the chairperson of the MoG group for general infertility was a member of the steering committee; one project leader was a member of the steering committee and chairperson of the MuG group; and one member of the MuG group was a member of the steering committee (Table 1).
All participants received the evaluation questionnaire (one patient representative was unavailable). The response rate was 79% (n = 27). Table 2 summarizes the background characteristics of the respondents. Of the 59% who were experienced in guideline development, 63% were also experienced in MuG development.
Guideline development
The project was carried out as planned, except for minor modifications needed to improve the consistency between the concepts of the guidelines. Face-to-face meetings and additional conferences calls were necessary to discuss discrepancies between recommendations concerning the cut-off points for treating infertility. These recommendations were issued by guidelines for male infertility and unexplained fertility. The cut-off points were eventually based on the existing relevant evidence. Further, there was a lack of consensus on some recommendations in the four MoGs for life-style advices (e.g., alcohol and anabolic steroids use) issued in all four MOGs as well as lack of and a lack of underlying evidence. This necessitated two additional consensus meetings, which were attended by four members of the MuG (including the chairperson) and the chairpersons of all MoG groups. These consensus meetings produced overall recommendations for life-style advice based on evidence regarding pre-pregnancy counseling. The MuG group reviewed the drafts of the MoG groups and vice versa. Then, the project coordinator initiated a conference call in order to reach consensus on the recommendations based on the expert opinion of the MoGs. Via WikiFreya, 298 patients formulated 289 recommendations, which 80 patients prioritized into 21 recommendations. These recommendations were included in the definitive guideline [18].
Resulting guidelines
One MuG and four related MoGs were developed in 20Â months; all were written in Dutch:
http://www.nvog-documenten.nl/uploaded/docs/Landelijke%20netwerkrichtlijn%20Subfertiliteit%20def.pdf
The definitive MuG follows the overall clinical care pathway for patients with infertility problems. It addresses patient-centered, organizational, and medical-technical issues on the clinical pathways, from first visiting the physician to completed treatment (with or without a pregnancy) and aftercare from the physician or medical psychologist (Table 3). The MuG consists of 198 recommendations based on the best available evidence or expert opinion; the level of evidence (A to D) is given for each recommendation. All recommendations were linked to the key questions formulated. Of these recommendations, 59% concerned organizational and patient-centered aspects of care (Table 4). The medical-technical recommendations for transitions in fertility care and supporting care alignment were derived from the MoGs. Twenty-one prioritized patients’ recommendations, obtained via WikiFreya, were included in the MuG and graded as level P evidence [18].
Time investments
The median number of two-hour regular group meetings was 10 (range: 5 to 11). The median participation rate was 88% (range: 77 to 94%). Three additional two-hour meetings were necessary for adjustment between guidelines. The steering committee needed 11 two-hour meetings for organizing the project.
Seven participants (20%) were involved in the preparation phase, for which they needed 471 h in total. In the development phase, the participants spent time on meeting preparation, two-hour face-to-face meetings, and minutes of meetings; and extra time on reviewing literature, writing guidelines, and commenting on draft versions. The time all participants spent in the development phase totaled 4,497 hours, including the 281 hours the steering committee members spent organizing this phase (Table 5).
Feedback
Interviews
Most of the eight interviewees thought the guideline groups were well composed. Nevertheless, they perceived combining the role of moderating the meetings and providing clinical input for the content as unsatisfactory. The two project leaders said they underestimated the project coordinator’s workload, particularly in combining the coordination tasks with writing the draft guidelines. Furthermore, views and preferences differed between the chairperson of the MuG and the project coordinator about the scope, format, and content of the guideline; this formed a time-consuming barrier.
Questionnaires
The 27 questionnaires showed that most participants perceived the methodology of the network approach on the one hand as ‘the promising future of guideline development’ and on the other hand as ‘complex and unclear’. Positive notes included the perceived individual learning curves for guideline development, the opportunity of distributing key questions to participants with relevant knowledge, various participants’ perceived respect for autonomy, and the collaborative development of the one MuG. Furthermore, participants reported that the high level of coordination required to carry out the project as planned was a potential barrier to the approach. The different opinions among the professionals caused delays and tension in finalizing the guidelines. Clear expectations about the roles of the participants and a description of the final format for the guideline were lacking.
The integration of the MoGs into the MuG was seen as ‘powerful’, mainly regarding ‘special attention to transitions in different phases of care (alignment)’, ‘the opportunity to check possibly underexposed topics’ and ‘the simultaneous development of all guidelines’. The final equalization of guideline content was ‘too late’ (e.g., when recommendations had already been formulated), ‘difficult’ (due to differing opinions), and ‘time consuming’ (extra meetings). One respondent said integrating MoGs into the MuG was ‘needless’.
Patient involvement
All MuG group respondents described the participation of patient representatives in their group as ‘valuable’ (e.g., influencing discussions by refocusing on the patient) and their contributions as ‘beneficial to the final product’ (e.g., affecting formulations of considerations or expert-based recommendations). The representatives emphasized the need for information about the components of clinical care pathways before they discussed treatment options. More than one-half the respondents described the final patient recommendations as ‘valuable’ or ‘eye-openers’, and ‘useful’ in formulating professional recommendations. Some of them doubted the practical applicability of these recommendations. They questioned the fact that patients recommended that the physician immediately refer patients trying to conceive to the gynecologist. They noted the lack of new insights in patient recommendations.
Facilitators and barriers
Facilitators for the network approach included the selection of the most competent and dedicated participants, the introduction of the project coordinator, and patient contributions. Perceived political barriers, competing professional interests of those involved, and the lack of a more detailed MuG format created barriers. Suggestions for improvement included communication of clear instructions for individual roles and responsibilities, a strict schedule including deadlines, and a clear format for the guidelines. Further, the need for supportive staff and support for literature searches were noted.
Discussion
This study provides detailed insight into the feasibility of a novel patient-centered network approach to MuG development for fertility care. This approach enabled the collaborative development of a harmonized set of one MuG and four MoGs for clinical care pathways for infertile couples. The approach helped us foresee possible barriers analogous to the US Institute of Medicine recommendations for developing trustworthy and transparent CPGs [9].
All the relevant stakeholders were included in the guideline groups. Collaboration between balanced groups of key stakeholders is an important success factor for clinical networks and may lead to a more valid method of developing guidelines [9, 10]. A crossover of stakeholders from one guideline group to another helped harmonize the guideline content and distribute questions among the groups. This emphasized specific professional contributions and created a feeling of affinity with the guidelines. The development required intensive patient engagement, and the contributions of patient representatives in the MuG group and individual patients acting via WikiFreya were considered valuable [18].
The MuG follows patient clinical pathways and uses a network structure that includes all stakeholders, so that it pays much attention to the organization of the different phases of fertility care and transitions from one phase to another. This ensures better-integrated care (e.g., referral from the physician to the gynecologist) [22]. The attention to patient preferences, needs, and values may have increased the level of patient-centeredness [23]. The approach included an extensive review of the guidelines throughout the development. It used the network structure for which extra time was needed, but it enabled broader support of the guidelines and may enhance future guideline implementation [24, 25].
The participants liked the approach and viewed it as a promising format for developing MuGs. Enthusiastic patients and the energetic project coordinator helped make the approach work well. Suggestions for improving the approach were reported mainly at the organizational level (e.g., previous communication about individual roles and responsibilities, a detailed time line, and a detailed format for the guidelines). This correlates with the existing literature about clinical networks, which implies that using clinical networks requires a high degree of managerial organization [13, 14, 22, 26]. More support staff might enhance the efficiency of the network approach. Engaging a librarian to help with literature searches might accelerate guideline development and increase efficiency [27]. However, the approach seemed time consuming for developing our set of five related guidelines simultaneously. Unfortunately, it is difficult to compare our time investments with those of regular guideline development, since there is a dearth of published studies about this topic.
Strengths and limitations
Although the use of a clinical network has been suggested as an effective strategy for implementing CPGs, this is the first study that has applied this approach in developing MuGs [28–31]. Our guideline development closely paralleled the main recommendations of the US Institute of Medicine [9]. However, recommendations were not graded and to express patients’ input, patients’ recommendations were secondarily reformulated to a non-actionable form incongruent to the GLIA instrument. This non-actionable form could impede harmonization of patients and stakeholders generated inputs. In addition to other studies on guideline development approaches, we also evaluated the feasibility of the approach. Nevertheless, a basis for comparing time data is lacking, which is a limitation of our study and a major limitation of current study designs of guideline development. In our opinion, guideline development is time consuming and expensive. Time should always be weighed against benefits, especially for introducing new approaches.
We have applied the patient-centered network approach to a MuG program for fertility care. This clinical area is characterized by the involvement of intensively collaborating professionals and responsible patients, which might be an argument against generalizability for other clinical areas. However, addressing practice change and sustaining clinical networks generally requires great motivation and is not specific to fertility care [32, 33]. In this light, the level of our participants’ experience may have been a success factor in realizing the project in a relatively short time, but it may also be an argument against generalizability. Nevertheless, basic knowledge of guideline development methodologies is necessary in all approaches. Moreover, not only were our participants pretty experienced in guideline development, they were also opinion leaders within their own medical specialties. This may be an important success factor for disseminating and implementing the definitive guidelines. Despite this, we realize that, because our participants are rather experienced in their own usual way of developing guidelines, they might have been more critical of such a new approach. For instance, they regarded the lack of a detailed format as a barrier. This factor may have hindered the guideline development.
Although the guidelines clearly address organizational and patient-centered aspects (altogether, in 59% of the recommendations), we did not compare the proportion of these aspects to proportions in conventionally developed guidelines. However, we expect that the proportion of patient-centered aspects is rather small in other guidelines because patient participation in guideline development is still not common practice [34]. This mechanism may also apply to the organizational aspects, which are mainly addressed in guideline-related products, such as local protocols.
Although the participating member societies and organizations are committed to disseminating the final, harmonized guidelines, our detailed process evaluation was limited to the first phases of the guideline development and did not include the dissemination and implementation phases. We assume that this approach will enhance the implementation and our network might be an effective strategy in the further efforts that are still required [28–32, 35].
Conclusions and implications for further research
The novel approach of the patient-centered network is feasible for simultaneously and collaboratively developing a harmonized set of MuGs and MoGs for the clinical pathways of infertile couples. The approach is a potential strategy for developing more trustworthy and transparent guidelines. If consensus on the guideline format is reached beforehand, instructions on individual responsibilities within the network are provided, more support staff is employed, and a librarian is engaged to conduct systematic literature searches, then the network approach can be used in other guideline development programs too.
We believe that this approach may apply especially to patients who travel numerous complex pathways. Our study focuses on the network needed for patients who receive multidisciplinary fertility care and form the center of the network. However, other patients who travel different or multiple complex clinical pathways may also profit from this approach. Multiple networks can be connected or extended where necessary. However, this approach might be less valuable when patients travel a clear monodisciplinary pathway; for example, the pathway for a simple bone fracture. Further research is needed to compare the efficacy of this approach with more traditional approaches regarding content, time investments, and actual adoption of guidelines in a pragmatic randomized controlled trial.
Ethics approval
Ethical approval was not required for this study. However, all participants gave informed consent before taking part. All observational data and transcripts of interviews were anonymized.
Authors’ information
Jean Vriezen and Jacintha van Balen from the Dutch College of General Practitioners, Utrecht, contributed to the study design, were members of the steering committee, and contributed to the revisions of the paper.
Abbreviations
- CPG:
-
Clinical practice guideline
- IVF:
-
in vitro fertilization
- MoG:
-
Monodisciplinary guideline
- MuG:
-
Multidisciplinary guideline.
References
Halvorson GC: Health Care Reform Now!: A Prescription for Change. 2007, San Francisco, CA: Jossey-Bass
Alston CPL, Halvorson G, Paget L, Novelli B, Guest B, McCabe P, Hoffman K, Koepke C, Simon M, Sutton S, Okun S, Wicks P, Undem T, Rohrbach V, Von K: Discussion Paper. Communicating With Patients on Health Care Evidence. 2012, Washington, DC: Institute of Medicine, [http://www.iom.edu/evidence]
Novelli WD, Halvorson GC, Santa J: Recognizing an opinion: findings from the IOM evidence communication innovation collaborative. JAMA. 2012, 308: 1531-1532. 10.1001/jama.2012.13369.
Smith M, Halvorson G, Kaplan G: What’s needed is a health care system that learns: recommendations from an IOM report. JAMA. 2012, 308: 1637-1638. 10.1001/jama.2012.13664.
Landon BE, Grumbach K, Wallace PJ: Integrating public health and primary care systems: potential strategies from an IOM report. JAMA. 2012, 308: 461-462. 10.1001/jama.2012.8227.
Wynia MK, Von Kohorn I, Mitchell PH: Challenges at the intersection of team-based and patient-centered health care: insights from an IOM working group. JAMA. 2012, 308: 1327-1328. 10.1001/jama.2012.12601.
Burgers JS, Cluzeau FA, Hanna SE, Hunt C, Grol R: Characteristics of high-quality guidelines: evaluation of 86 clinical guidelines developed in ten European countries and Canada. Int J Technol Assess Health Care. 2003, 19: 148-157.
Grilli R, Magrini N, Penna A, Mura G, Liberati A: Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet. 2000, 355: 103-106. 10.1016/S0140-6736(99)02171-6.
Clinical Practice Guidelines We Can Trust. Edited by: Medicine TIO. 2011, Washington, DC: National Academy Press
Alonso-Coello P, Irfan A, Sola I, Gich I, Delgado-Noguera M, Rigau D, Tort S, Bonfill X, Burgers J, Schunemann H: The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010, 19: e58-
Kung J, Miller RR, Mackowiak PA: Failure of clinical practice guidelines to meet institute of medicine standards: two more decades of little, if any, progress. Arch Intern Med. 2012, 172: 1628-1633. 10.1001/2013.jamainternmed.56.
Shaneyfelt TM, Centor RM: Reassessment of clinical practice guidelines: go gently into that good night. JAMA. 2009, 301: 868-869. 10.1001/jama.2009.225.
Cunningham FC, Ranmuthugala G, Plumb J, Georgiou A, Westbrook JI, Braithwaite J: Health professional networks as a vector for improving healthcare quality and safety: a systematic review. BMJ Qual Saf. 2012, 21: 239-249. 10.1136/bmjqs-2011-000187.
Goodwin NPG, Peck E, Freeman T, Posaner R: Report to the national co-ordinating centre for NHS Service Delivery and Organisation R&D (NCCSDO). Managing Across Diverse Networks of Care: Lessons from Other Sectors. 2004, NCCSDO, [http://www.nets.nihr.ac.uk/__data/assets/pdf_file/0006/64455/FR-08-1218-039.pdf]
Boivin J, Bunting L, Collins JA, Nygren KG: International estimates of infertility prevalence and treatment-seeking: potential need and demand for infertility medical care. Hum Reprod. 2007, 22: 1506-1512. 10.1093/humrep/dem046.
Gnoth C, Godehardt E, Frank-Herrmann P, Friol K, Tigges J, Freundl G: Definition and prevalence of subfertility and infertility. Hum Reprod. 2005, 20: 1144-1147. 10.1093/humrep/deh870.
Centre for Evidence Based Medicine (CEBM). [http://www.cebm.net/explanation-2011-ocebm-levels-evidence/]
den Breejen EM, Nelen WL, Knijnenburg JM, Burgers JS, Hermens RP, Kremer JA: Feasibility of a wiki as a participatory tool for patients in clinical guideline development. J Med Internet Res. 2012, 14: e138-10.2196/jmir.2080.
Hulscher ME, Laurant MG, Grol RP: Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003, 12: 40-46. 10.1136/qhc.12.1.40.
Peters V, Wester F: How qualitative data analysis software may support the qualitative analysis process. Quality & Quantity. 2007, 41: 635-659. 10.1007/s11135-006-9016-8.
Richie J, Spencer L: Qualitative Data Analysis for Applied Policy Research. Analysing Qualitative Data. Edited by: Bryman A, Burgess B. 1994, London: Routledge, 173-194.
Cunningham FC, Ranmuthugala G, Westbrook JI, Braithwaite J: Net benefits: assessing the effectiveness of clinical networks in Australia through qualitative methods. Implement Sci. 2012, 7: 108-10.1186/1748-5908-7-108.
The Institute of Medicine: Crossing the Quality Chasm. 2001, Washington, DC: National Academy Press
Boivin A, Currie K, Fervers B, Gracia J, James M, Marshall C, Sakala C, Sanger S, Strid J, Thomas V, van der Weijden T, Grol R, Burgers J, G-I-N PUBLIC: Patient and public involvement in clinical guidelines: international experiences and future perspectives. Qual Saf Health Care. 2010, 19: e22-10.1136/qshc.2007.025700.
Boivin J, Domar AD, Shapiro DB, Wischmann TH, Fauser BC, Verhaak C: Tackling burden in ART: an integrated approach for medical staff. Hum Reprod. 2012, 27: 941-950. 10.1093/humrep/der467.
Pagliari C, Grimshaw J, Eccles M: The potential influence of small group processes on guideline development. J Eval Clin Pract. 2001, 7: 165-173. 10.1046/j.1365-2753.2001.00272.x.
Borgonjen RJ, van Everdingen JJ, Bik CM, Tuut MK, Spuls PI, van de Kerkhof PC: Prospective comparison of three guideline development methods for treatment of actinic keratosis. BMJ Qual Saf. 2011, 20: 832-841. 10.1136/bmjqs.2010.050443.
Laliberte L, Fennell ML, Papandonatos G: The relationship of membership in research networks to compliance with treatment guidelines for early-stage breast cancer. Med Care. 2005, 43: 471-479. 10.1097/01.mlr.0000160416.66188.f5.
Ray-Coquard I, Philip T, de Laroche G, Froger X, Suchaud JP, Voloch A, Mathieu-Daude H, Fervers B, Farsi F, Browman GP, Chauvin F: A controlled ‘before-after’ study: impact of a clinical guidelines programme and regional cancer network organization on medical practice. Br J Cancer. 2002, 86: 313-321. 10.1038/sj.bjc.6600057.
Tolson D, McIntosh J, Loftus L, Cormie P: Developing a managed clinical network in palliative care: a realistic evaluation. Int J Nurs Stud. 2007, 44: 183-195. 10.1016/j.ijnurstu.2005.11.027.
Greene A, Pagliari C, Cunningham S, Donnan P, Evans J, Emslie-Smith A, Morris A, Guthrie B: Do managed clinical networks improve quality of diabetes care? Evidence from a retrospective mixed methods evaluation. Qual Saf Health Care. 2009, 18: 456-461. 10.1136/qshc.2007.023119.
Rogers S, Humphrey C, Nazareth I, Lister S, Tomlin Z, Haines A: Designing trials of interventions to change professional practice in primary care: lessons from an exploratory study of two change strategies. BMJ. 2000, 320: 1580-1583. 10.1136/bmj.320.7249.1580.
Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam WM, Froehle CM, Margolis P: The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010, 88: 500-559. 10.1111/j.1468-0009.2010.00611.x.
Krahn M, Naglie G: The next step in guideline development. JAMA. 2008, 300: 436-438. 2008:436–438
Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: iii-iv. 1–72
Acknowledgements
The authors thank all participants of the focus groups, the guideline development groups, and all participating patients.
Data access
All authors had full access to all the study data and take responsibility for the integrity of the data and the accuracy of the data analysis.
Data sharing
No additional data are or were available.
Funding
The Netherlands Organization for Health Research and Development (ZonMW) funded this project with grant no.150020015, The Hague. This funder did not have any role in the study design; in the collection, analysis, or interpretation of data; in the writing of the report; or in the decision to submit this article. All researchers were independent of the funders.
License for publication
The corresponding author has the right to grant on behalf of all authors and does grant on behalf of all authors, a worldwide license to the Publishers and its licensees in perpetuity, in all forms, formats and media (whether known now or created in the future), to publish, reproduce, distribute, display and store the Contribution; translate the Contribution into other languages, create adaptations, reprints, include within collections and create summaries, extracts and/or abstracts of the Contribution; create any other derivative work(s) based on the Contribution, iv) to exploit all subsidiary rights in the Contribution; the inclusion of electronic links from the Contribution to third party material wherever it may be located; and, license any third party to do any or all of the above.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
All authors have completed the Unified Competing Interest form at http://www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organization for the submitted work, no financial relationships with any organizations that might have an interest in the submitted work in the previous three years, and no other relationships or activities that could appear to have influenced the submitted work.
Authors’ contributions
EB was a guarantor, helped design the study, analyze the data, interpret the analysis, and draft the paper. MH was a guarantor, helped design the study, conducted the in-depth interviews, and contributed to the questionnaire, the data analysis, interpretation of the analysis, and the draft of the paper. WN and TW helped design the study and draft the paper. JB helped interpret the analysis and draft the paper. JK was the principal investigator, and helped design the study and draft the paper. RH led the research team, contributed to the study design, the questionnaire, the data analysis, the analysis interpretation, and the drafting of the paper. All authors reviewed the consecutive drafts of the paper and gave their final approval of the version to be published.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Den Breejen, E.M., Hilbink, M.A., Nelen, W.L. et al. A patient-centered network approach to multidisciplinary-guideline development: a process evaluation. Implementation Sci 9, 68 (2014). https://doi.org/10.1186/1748-5908-9-68
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1748-5908-9-68