- Open Access
Preferences for peer-reviewed versus other publication sources: a survey of general dentists in the National Dental PBRN
Implementation Science volume 14, Article number: 19 (2019)
Medical professionals have access to a broad range of resources to address clinical information needs. While much attention is given to new sources of data such as those available on the internet, it is less clear how clinicians choose between peer-reviewed research literature and other publication-based sources. This analysis distinguishes between possible drivers of publication type preference (namely, practice setting, advanced training, professional development experiences). Dentists enrolled in the National Dental Practice-Based Research Network (PBRN) are the population for this study. Theories of human and intellectual capital and institutional logics theory are used to understand how advanced training and other clinical experiences may explain the choices that dentists make when faced with clinical questions.
An online questionnaire was implemented with general dentists in the US National Dental PBRN. A series of logistic and Ordinary Least Squares (OLS) regression models were used to explain the use of peer-reviewed and other publications. Measures of knowledge-based human capital distinctions (advanced clinical training and research engagement, advanced professional status, personal motivation for professional advancement) were used to explain preferences for research literature as a clinical resource.
General dentists with advanced training, as well as those with a skill advancement motivation, show a preference for peer-reviewed materials. General dentists who have been practicing longer tend to favor other dental publications, preferring those sources as a resource when faced with clinical challenges. Human capital and professional motivation distinguish the information preferences among general dentists. Further, these factors explain more variance in use of peer-reviewed materials than practice setting does. Few differences by demographic groups were evident.
Results point to a distinct variation in the general dentistry professional community. Advanced training among general dentists, as well as the types of procedures typically conducted in their practice, distinguishes their information preferences from other general dentists, including those with more years of clinical experience.
By improving knowledge on how information is accessed by clinical professionals, decisions about implementing information dissemination strategies can be made to more effectively get information into the hands of clinicians. Studies of information-seeking behavior in clinical settings have increasingly focused on the modality of knowledge access (print, internet, and interpersonal sources) [1,2,3,4,5,6,7,8,9,10,11], where peer-reviewed journals that provide access to clinical trial research findings, case reports, and systematic reviews, remain relevant to the delivery of new clinical knowledge in the practice setting. The focus on how clinicians access these information sources, however, does not adequately address differences in the content nor selectivity of the information sources, leaving a gap in our understanding of what explains preferences for high-quality peer-reviewed materials over other published materials. A natural next step is to establish if preferences for different types of publication resources vary and to look for factors that explain this variation. Our interest is not whether dentists access information online or not, nor how they seek information from colleagues. Instead, we ask, what determines these preferences?
In a profession where advanced credentials do not necessarily mean a change in position (general dentists typically remain general dentists), how are preferences for information sources affected by the pathways dentists take for ongoing knowledge development relevant to their practice? We focus on general dentists because they comprise the largest group of dental clinicians, work in a range of different practice settings, and provide an array of dental services [12, 13], suggesting different information needs within this population. With 83% of youth and 64% of adults having a dental examination in the past year , understanding the information-seeking behavior of the general dentist may inform ways to increase the uptake of evidence-based research for clinical decision-making in an understudied clinical service delivery area, and could provide insights for other classes of clinical professionals.
Human capital pathways and information preferences in dentistry
While dentists’ information-seeking behavior is presumably driven by a complex set of factors, including problem complexity, information type, and convenience , we argue that personal factors also shape that behavior. Human capital [16,17,18,19] and institutional logics  theories are social-economic and organizational theories that help to frame the variation in information source preferences. “Institutional logic” refers to the “individual norms, assumptions, beliefs, and preferences” that form as a result of the norms and contexts of the setting in which an individual works or operates. In dentistry , studies have addressed the relationship between logics of medical professionalism that value clinical care with business-oriented commercial logics that focus on efficiency and profit in practice management. It is the differences in these “logics” (medical and business) that we argue are embodied in individual clinician choices about building their human capital/knowledge that may shape information preferences .
Human capital refers to the acquired knowledge, skills, judgment, and other traits of individuals, obtained through formal and informal education and experiences [23, 24]. Health professionals are trained to rely to a large extent on their own professional expertise and tacit knowledge in treating patient needs  based on the foundation of professional training and related credentials. Clinicians are also expected (and often required) to formally remain “current” on materials, procedures, disease, and other factors relevant for effective clinical practice , typically through continuing education (CE) . Considerable variability in the rigor, intensity, and reputation of CE sources, coupled with clinician choice of what to attend [28, 29], means that how clinicians obtain CE is highly variable. In addition to clinical values and business sensibilities, we expect that dentists who choose a rigorous and formal pathway to knowledge development via rigorous CE and/or further credentialing will also demonstrate an “academic logic” [30, 31]. It is the differences in these “logics” (medical and business), that we argue are embodied in individual clinician choices about building their human capital/knowledge, that may shape their information preferences. We hypothesize that clinicians who are personally motivated for demanding professional advancement will prefer peer-reviewed resources more than will those clinicians without that experience.
Human capital is also acquired through experience. Clinicians who have accumulated knowledge  through their own career may have less interest or need to navigate complex and time-consuming written materials [2, 4, 7, 32, 33], which may enable them to more easily discern the utility and relevance from other curated sources. We therefore hypothesize that clinicians with knowledge based on accumulated experience will align more with a “medical professionalism” logic and show a lower preference for more difficult to access (peer-reviewed) materials and a higher preference for curated publications (magazines and other publications). Based on the above, we expect that knowledge and the motivation to develop that human capital both matter for information preferences among general dentists.
Our analysis is based on an online questionnaire of dentists and hygienists in the National Dental PBRN, a consortium of dental practitioners and organizations focused on improving the scientific basis for clinical decision-making [13, 34, 35]. The questionnaire was designed by a team of social scientists and dental professionals to gather data about where and how dental practitioners access clinically-relevant evidence. The protocol was approved by the central and regional IRB offices of the National Dental PBRN and was administered online from August to December 2016. PBRN members were alerted to the survey by the PBRN regional coordinators in each US region and were then invited to complete the survey by the study PI via US postal service letter followed by a personal e-mail. Reminders were sent monthly. Consistent with survey design principles , details of the survey purpose were kept to a general level in order to reduce possible bias or priming of the respondents. The survey was pretested [36, 37] using cognitive pretesting with clinicians to address understandability, coverage, and readability of the survey, and a field pretest addressed response patterns. Minor adjustments to the survey content and order were made as a result of these pretests.
The sampling frame of 3106 practicing dentists and hygienists included all network members who were practicing dentists or hygienists but whose primary affiliation was not an academic institution. The sample was stratified by National Dental PBRN geographic regions and oversampled for groups under-represented in the dental profession (female dentists, male hygienists, racial/ethnic minorities). A final adjusted response rate of 58% (N = 1722) was achieved after data cleaning (removing partial responses or individuals not in clinical practice). Given our interests, we limited our focus here to the 1191 general dentists in our sample. General practitioners deliver the majority of dental care, work in a range of practice settings, and provide a range of services [12, 38]. The representativeness of our respondent group was compared to the National Dental PBRN and to the population of dentists and hygienists in the USA (Table 1). On average, our sample is representative of the National Dental PBRN but does differ from the national population of dentists and hygienists in a few demographic aspects. Our deliberate oversampling of female dentists and racial/ethnic minorities for analytical reasons reflects a purposive over-representation of individuals in these groups. The PBRN is least representative of very young dentists (under the age of 35). The questionnaire data were supplemented with data from the PBRN enrollment questionnaire , providing additional demographic and practice information used in this analysis.
Information source use and preferences. Survey respondents were asked “Which of the following journals or publications do you typically consult in instances when you do not have sufficient information to treat or advise a patient? (These may be print or online version.)” Respondents were offered a list of 11 items that included peer-reviewed journals and other dental and medical publications, as well as an “other” option. Journals were selected based on readership patterns identified in prior studies [10, 40] (reflecting those most used) as well as consultation with the clinicians on our study team. First, we created a binary variable for whether respondents indicated that they consulted at least one peer-reviewed dental publication. We then created three variables based on a sum of sources to measure the range of sources: peer-reviewed journals, other publications, and overall (the sum of the previous two categories). We conceptualized this as a range of core sources relevant to general dentistry, rather than a count because we did not offer a comprehensive list to respondents. Finally, we created a proportional measure to examine the mix of publications consulted (E-I Index) . This measure, which ranges from − 1 to + 1, indicates whether some dentists lean more toward peer-reviewed journals (− 1) or other publications (+ 1). Zero indicates an equal distribution between the two types of publications. Missing values (130) for this variable exist due to (a) the 104 general dentists who indicated in an earlier question that they do not turn to dental journals at all when faced with a clinical scenario that they do not know how to treat and (b) 26 respondents who did not indicate a specific journal in a follow-on question, either in the close-ended option or in the fill-in-the-blank “other.”
Clinical complexity and practice setting. Because information needs may vary with practice setting, we included data that differentiated practice contexts. Respondents were asked about the frequency (never, rarely, and routinely) with which they conducted a range of dental procedures. Based on review and input from the dental clinicians on our study team, we categorized these as either “standard” (common procedures in general dentistry) or “complex” (procedures typically performed by dental specialists but may also performed by general dentists) procedures (detailed procedures are listed in in Table 1). While clinicians may perform these complex procedures from time to time, we were most interested in whether a dentist performed them on a regular basis, which would then distinguish these practices from those that are limited to more standard procedures. We then created two count variables, the first reflecting a count of the number of standard procedures performed on a routine basis and the second reflecting the number of complex procedures performed on a routine basis. These two count variables therefore capture the range of procedures performed in a clinician’s office. Regarding other practice context, we also included data on overall patient load, whether the dentist is a solo practitioner, whether they practice full- or part-time, and their rural/urban location (based on county). This allows us to account for accessible interpersonal resources available to our set of general dentists [16, 42].
Knowledge development. We focused on two types of knowledge in our analysis: formal and informal/experiential, where formal knowledge development reflects educational degrees and other credentials and informal knowledge is based on experience. For general dentists, 1- or 2-year residency programs, referred to either as a General Practice Residency (GPR, usually hospital-based) or as an Advanced Education in General Dentistry (AEGD; usually based at an academic institution) program, are advanced options, both involving a rigorous number of hours, as is the AGD master program, which requires 1100 h of continuing education credit in a wide range of general dentistry topics. Few dentists (30% of respondents) met the criteria for advanced training in general dentistry (i.e., did a GPR or an AEGD program), and these respondents were coded as “1.” The two experiential development variables included whether the respondent (a) ever led a clinical study, worked on a clinical study team, or personally applied for research funding (based on a survey question and coded as “1” if they had done any of these)  and (b) has tacit knowledge accumulated through years in practice (based on time since dental school graduation), recognized as a legitimate learning source in clinical and other professions [11, 25, 26, 28] and coded as a continuous variable.
PBRN skill motivation. Individuals differ in motivation to affiliate with a community of practice or research network [43, 44]. Given our interest in understanding differences in information-seeking behavior, we wanted to isolate whether individuals were more motivated by knowledge and skill acquisition, as compared to relational/networking reasons, in their decision to affiliate with the National Dental PBRN. In response to the question “How important were the following reasons in your decision to enroll in the PBRN?” respondents were asked to select from a range of seven individual items. These included networking with current or new colleagues, CE credits, taking part in clinical studies, and the two items used for this measure (skill development and knowledge development) to indicate its importance (not at all important, somewhat important, important, very important). PBRN skill motivation was coded as “1” if respondents indicated PBRN engagement for the purposes of knowledge and skill development rather than networking (indicating another mechanism for dentists to expand their knowledge foundation relevant to clinical dentistry) was “very important.”
Demographics. Under-represented populations in many professions have different experiences from the dominant social group (in this case, white males). We included measures from the National Dental PBRN enrollment questionnaire for female dentists and for under-represented minority dentists (Hispanic, African American, or Native American) as standard control measures to identify any differences by demographic groups.
Analysis involved both descriptive and regression analysis using Stata statistical software (version 14.2). For the descriptive analysis, we examined means and standard deviations, as well as correlation matrices (Table 4). We used logistic regression models to explain the likelihood that a general dentist would consult a peer-reviewed journal when faced with a clinical challenge, given that the dependent variable is binary. For the remaining models, we ran a series of Ordinary Least Squares (OLS) regression models, appropriate for continuous dependent variables, to test the knowledge source effects on the range of peer-reviewed journals, other publications, and overall publication sources consulted (variables are summarized in Table 1). For all models, we present the results in stepwise order, where the practice and knowledge variables are introduced sequentially to better isolate and understand the effects of each of these variables on information preferences. For example, we ran models with only practice characteristics and human capital variables separately and then together. Sampling weights were used due to the stratified sampling procedures used.
The descriptive statistics of the survey results are presented in Table 2. Of the 1191 general dentists who replied to the survey, most were male (63%), and white (68%), reflecting the characteristics of the dentist population. The general dentist respondents varied in their formal and experiential access to human capital as measured in this study. First, 31% of the respondents reported having formal advanced training beyond that required for CE. In terms of experiential intellectual capital development, almost half (40%) reported having had personal experience in clinical research, including having led a clinical study, worked on a clinical study team, or personally applied for research funding. In terms of professional age, respondents graduated from dental school an average of 24 years ago, but the sample also included very new and quite seasoned/near retirement dentists. Note that one criterion was that all survey respondents are still practicing clinical dentistry.
Roughly half of the general dentists were solo practitioners (47%), and on average, reported seeing over 60 patients per week. Respondents also varied in the types of clinical procedures routinely conducted in their practices. Not surprisingly, standard procedures were more common than complex. Respondents on average routinely conducted three of the five standard procedures included in the enrollment questionnaire and about one complex procedure on a routine basis.
Further, we found some variation among the general dentists for our dependent variables of interest—the preference for different publication sources. As expected, the vast majority (87%) of respondents reported that they would typically consult a peer-reviewed dental journal when they needed information to advise or treat a patient and more than half (58%) reported that they would typically consult another type of publication in this case (respondents could check all that apply). On average, general dentists reported consulting three out of six specifically named peer-reviewed journals and a mixed set of other sources, with peer-reviewed sources being more prevalent than other published sources. For the small set of general dentists who did not report turning to peer-reviewed publications, access was not a barrier for most. Time and relevance instead were offered as reasons for not turning to peer-reviewed materials in clinical uncertainty (Fig. 1).
Regression analysis: preference for peer-reviewed sources
Our first question asks how practice setting and the human/intellectual capital of general dentists explain their preference for consulting a peer-reviewed journal when they are faced with a clinical scenario where they lack sufficient information to treat or advise a patient. To address this question, we constructed a stepwise logistic regression model (Table 5). Odds ratios are provided to identify the odds of whether a general dentist with any of the characteristics captured by our independent variables is more or less likely to consult one or more of the peer-reviewed dental journals common to general dental practice. Variable inflation factor (VIF) statistics for each of the models were also run and showed no multicollinearity effects in any of the models.
In the limited logistic regression model, results showed no significant relationship of various demographic or practice characteristics and the likelihood of a general dentist to consult peer-reviewed journals when faced with a clinical question. When aspects of their clinical practice are added to the model, the results showed that an increase in the number of routine procedures regularly conducted resulted in a 20% higher likelihood that a dentist will consult a peer-reviewed dental journal when faced wtih a clinical uncertainty. Notably conducting complex procedures on a routine basis had no significant effect. Regarding human/intellectual capital factors, the results of the full model showed that dentists with advanced training or personal experience with research are no more likely to consult a peer-reviewed source than their colleagues without these experiences. However, those dentists who are seeking skill development through the National Dental PBRN are 70% more likely to consult peer-reviewed journals than their colleagues who joined the PBRN for other reasons. These odds diminished slightly when combined in the full model (Odds ratio = 1.58 for those with PBRN skill motivation, or 58% more likely) but generally held.
Regression analysis: range of peer-reviewed and other sources consulted
While there was little variation in whether dentists consult peer-reviewed journals under conditions of uncertainty as shown above, there was more variation in the breadth and mix of the resources they consult. Tables 5 and 6 show the results of the weighted regression models that examined the extent to which the same set of independent variables explains variation in the number and the mix of peer-reviewed journals and other published sources. Models were stepped to examine human capital and practice effects in more limited models and then to observe the results when these variables were combined. First, to examine the factors that explain the breadth of overall as well as peer-reviewed journals and other resources consulted in cases of clinical uncertainty, Table 6 shows few significant relationships between practice settings and information preference. General dentists working in a practice that conducts a broader range of standard clinical procedures on a routine basis read a wider range of sources overall as well as both peer-reviewed journals and other sources, holding in all models (coefficient ranging from 0.06 to 0.17 depending on the model). Other aspects of practice setting, such as regular complex procedures or overall patient load, did not statistically correspond to preferences for peer-reviewed sources.
When the human and intellectual capital variables were introduced, we observed important effects. General dentists with advanced training (AGD Fellow and other) were more likely to broadly consult the peer-reviewed literature (coefficient 0.368, p < 0.001), but this training was significantly and negatively associated with the breadth of other non-peer-reviewed publications sources consulted overall (− 0.161, p < 0.05). Experiential intellectual capital in terms of years of experience was significant (p < 0.001) (although with small coefficients) in explaining the overall breadth of resources consulted, as well as the other published sources, but was not significantly related to the likelihood of consulting peer-reviewed journals. Clinician interest in increasing their knowledge and skill capital was also important. Motivation for skill development in the form of a rationale for joining the PBRN was positively and significantly associated (p < 0.001) with the breadth of sources consulted overall (coefficient 0.505) in both the peer-reviewed journal (coefficient 0.232) and other publication contexts (coefficient 0.273). Having participated or having led clinical research has no significant effect on source preferences.
Factors reflecting possible isolation were significantly associated with consulting other published knowledge sources (Table 6). General dentists practicing in a rural setting and solo practitioners were significantly more likely to consult a broader range of other sources (coefficient 0.416 and 0.196, p < 0.05 respectively in the full model when we control for all variables), while this was not the case for peer-reviewed journals. We also found that female dentists consulted a narrower range of published sources overall, but this effect disappeared when other factors were introduced to the model, showing that gender factors were minimally related to source preferences.
Regression analysis: mix of peer-reviewed and other sources consulted
Finally, we addressed the proportional mix of sources consulted in order to identify whether general dentists tended to prefer more peer-reviewed or non-peer reviewed material across all of the publication sources they tended to consult. Which factors explained the mix of preferred sources? The final models addressed the balance of publication sources consulted using the E-I index . Table 7 presents the results of the weighted regression model taking into account clinical setting and human and intellectual capital in explaining the proportion of publication preferences consulted by general dentists, i.e., taking into account reliance on peer-reviewed journals versus other sources consulted. Again, an E-I index closer to − 1 means that respondents proportionally consulted more peer-reviewed sources, while closer to + 1 means that they consulted more of the other publication sources.
Looking first at the practice setting model, solo practitioners and general dentists in rural practices tended to consult more sources other than peer-reviewed journals, with results holding when the remaining variables were introduced (coefficients 0.177 and 0.158, p < 0.05 respectively). Finally, for our central interest in the sources of human/intellectual capital, results were as expected. Having advanced training showed a statistically significant preference for a somewhat higher proportion of peer-reviewed journals (with the largest coefficient of − 0.154, p < 0.001), while increased professional age as well as PBRN skills motivation showed a statistically significant preference for a balanced proportion of publication sources with coefficients close to zero (0.006, p < 0.001 and 0.081, p < 0.05). No significant results were found based on other practice characteristics or demographics.
Our purpose was to address the extent to which general dentists favor peer-reviewed sources over other publications when they are faced with a clinical question that requires a search for information beyond their own knowledge. While other research has focused heavily on the modality of information [26, 46,47,48], our attention to the distinction between peer-reviewed and other sources highlights the value placed on the evidence-based pyramid and peer-reviewed publications in the dental profession, regardless of whether they are accessed online or in print form. Not surprisingly, the vast majority (87%) of general dentists in our study acknowledged consulting peer-reviewed journals for clinical needs, leaving a small subset of dentists who do not. However, for the majority who do consult peer-reviewed sources, our results show that beyond this general measure there is considerable variation in the breadth and mix of publications that general dentists consult. As a caveat, these results do not raise a value judgment, but instead, shed light on source preferences and patterns among general dentists.
Perhaps, the most important finding of our work was in the ability to distinguish subgroups within the profession of general dentists, particularly related to advanced knowledge acquisition and knowledge-seeking motivation. Our primary interest was in how clinical knowledge developed professionally or through formal continuing education resources shaped information preferences. Like other knowledge-based professions, dentists initially acquire the foundation for this knowledge through professional training (dental school) and then build on it throughout their careers via both formal investments in their human capital (continuing education or formal residency programs) and informally by continually adapting their knowledge through experiential learning processes of daily practice [28, 29, 49, 50] gaining perspective and experience on successful and failed solutions to clinical challenges , as well as information sources relevant to clinical practice. We expected variation in these knowledge foundations to shape information preferences, at least in part.
Our findings show that, indeed, general dentists are anything but general and differ considerably in their preference for peer-reviewed publications. While the number of general dentists who do not consult peer-reviewed journal sources to address clinical questions is small, we expected that dentists with more intensive postgraduate training would favor these sources. We find that this does not explain whether a general dentist consults peer-reviewed materials at all, but we do find that this is the case when it comes to breadth of peer-reviewed and proportion of sources that they consult. Most importantly, the ways in which dentists develop their professional knowledge matter. Dentists who opt to pursue formal advanced training as a general dentist (in other words, not advanced training to become a specialist) prefer peer-reviewed journals as a resource, while those who have gained their knowledge through years of cumulative practice instead favor publications other than peer-reviewed journals. The latter is also aligned with prior work, raising concerns about the knowledge behavior and acquisition of older dentists  and suggestions that experiential clinical practice may cause clinicians to adapt knowledge but not necessarily add new research/scientific knowledge . Interestingly, getting involved in clinical research studies had no effect on preferences for peer-reviewed or other publications in our sample, suggesting that limited research experiences may not shape these preferences.
Through our analysis, it seems that we may have identified a distinction between the academically inclined and the practitioner general dentist. As dentists professionally mature through years of practice, we find a preference for curated and typically more-condensed materials. Dentists who choose a formal pathway to advanced clinical knowledge development complement their clinical professionalism with an “academic logic” [30, 31], develop comfort and norms for certain materials, and through this intensive process, enhance their absorptive capacity or the ability to identify and apply the academic literature to their own needs . This is important because as Cohen and Leventhal noted in their seminal piece, intensive exposure to diverse knowledge not only enhances the ability to assimilate new knowledge, but also has the added value of enabling a person to connect knowledge to different applications or problems . Studies have shown that while logics may be conflicting, they may also interact . It is the combination of these “logics” that shapes the preferences, norms, and decisions of these general dentists throughout their professional career and that we observe in our analysis .
Similarly, the knowledge- and skills-based motivation to affiliate with the PBRN also seems to identify the general dentist who is eager for more resources. Underscoring the personal nature of information priorities and interests, results show that these dentists who deliberately seek skills and knowledge through the PBRN consulted more of both the peer-reviewed journals as well as other publications (although with preference for the latter). This is consistent with information-seeking models of physicians in PBRN [34, 52, 53] and suggests a potentially different type of dentist than those who have affiliated with the PBRN for other reasons (such as those interested in networking and meeting colleagues).
Acknowledging the variation in the practice settings of general dentists, we also accounted for whether different aspects of the dentists’ work environment played a role in source preferences. Here, we found that different characteristics matter, some in surprising ways. Regarding the nature of their practice work, our expectation was that regularly conducting complex procedures may require greater upkeep of research-based clinical knowledge (and therefore favor peer-reviewed publications). However, the results did not support this expectation; the number of routine complex clinical procedures was not significantly associated with the number of sources, peer-reviewed or otherwise. However, working in an office that had a higher number of standard procedures was significantly associated with preference for a broader set of overall sources, peer-reviewed and other publications. This suggests that it is not the complexity of procedures that causes general dentists to consult materials, but rather the breadth of routinized procedures . Given that many general dentists perform a broad set of procedures, this circumstance may motivate general dentists to keep current on a diverse set of clinical services that they provide.
Our results show that whether dentists practice full- or part-time, or in multiple offices, has no bearing on their preference for peer-reviewed journals or other sources. Based on social capital models of information acquisition [16, 42], this is not necessarily surprising. Since prior studies that have shown preference for interpersonal sources over others, having daily access to other dental colleagues may mean that seeking print resources (peer-reviewed or not) is not a priority, nor the most efficient or effective way to locate information. It is interesting, however, that solo practitioners and dentists in rural practices (who may be more isolated from colleagues outside of their office) consult a broader range of other published sources and also show a preference for proportionally more of these sources over peer-reviewed publications. This is consistent with the notion that journals and other print materials are not a substitute for having a colleague in the practice to readily consult. For example, a recent study of Danish primary care physicians observed that solo physicians are less likely to use colleagues as an information source, while also manifesting no differences in use of other sources . Finally, we found almost no significant results across traditionally under-represented demographic groups (women and under-represented minorities).
Strengths, limitations, and implications
Our findings are important for implementation research and practice because they highlight the information preferences used by one class of medical professionals, dentists, demonstrating that different types of dissemination pathways are reaching distinctly different sets of clinicians. A strength of our work is that the data include details on specific sources beyond the simple binary measure of whether a clinician ever consults the peer-reviewed literature. This binary operationalization is an overly simplistic view and is misleading in suggesting that all peer-reviewed journals are considered accessible and timely sources of information for clinicians. Our results are able to disentangle this to some degree. We are also able to examine not only the use, but also the proportional mix of those sources. Like any information source, it is not a zero-sum game and this approach allowed us to identify preferences in a more nuanced way.
There are also some important limitations to our work. We focused on the journals most read in the dental community, and a larger study of the corpus of dental publications could reveal other source preferences than we are able to reach with our current data. We also do not know the specific types of clinical issues that trigger the need to go beyond one’s expertise to seek out information in published materials. While we excluded dentists who are full-time faculty, we were not able to identify part-time or informal ties with academic institutions that might influence source preferences. Social desirability bias may exist, where dentists with more advanced training may feel compelled to indicate that they consult the peer-reviewed literature. We also do not know whether or how the nature of the information in those sources promoted uptake and implementation in the clinical setting for a particular type of issue, nor do we know how or why advanced training inspires or socializes dentists to give more weight to the peer-reviewed materials. Finally, we do not know enough about the skill versus credential or other motivations of general dentists to pursue advanced continuing education in general dentistry.
Our research has implications for future study, as well as for clinical practice. Future research may address the ways that social capital and access to colleagues shape reliance on or preferences for different types of publications including for rural dentists who are more geographically isolated. Also worth exploring is how residency training programs and advanced continuing education programs shape a general dentist’s professionalism and intellectual capital and why we observe the preferences for peer reviewed materials. Most importantly, it would be informative to know how and under what clinical circumstances general dentists raise questions and how those questions are addressed [52, 56], building on work in medicine [52, 57,58,59].
General dentists vary in their preference for peer-reviewed literature when addressing clinical challenges. Dentists who are motivated to gain additional skills, and those who have achieved high-level postgraduate certifications, rely on a broader set of information resources and show a distinct preference for peer-reviewed sources. Results suggest that absorptive capacity for rigorous peer-reviewed sources may be enhanced through intensive advanced training credentials.
Hughes B, Joshi I, Lemonde H, Wareham J. Junior physician’s use of Web 2.0 for information seeking and medical education: a qualitative study. Int J Med Inform. 2009;78:645–55.
Thompson C, McCaughan D, Cullum N. Research information in nurses’ clinical decision-making: what is useful? Adv Nurs. 2001; http://onlinelibrary.wiley.com/doi/10.1046/j.1365-2648.2001.01985.x/full.
Isham A, Bettiol S, Hoang H, Crocombe LA. Systematic literature review of the information-seeking behavior of dentists in developed countries. J Dent Educ. 2016;80:569–77.
McCaughan D, Thompson C, Cullum N, Sheldon T, Raynor P. Nurse practitioner and practice nurses’ use of research information in clinical decision making: findings from an exploratory study. Fam Pract. 2005;22:490–7.
Hicks D, Isett K, Melkers J. Evolving dental media: implications for evidence-based dentistry. Int J Evidence-Based Pract Dent Hyg. 2017;3:78–84. https://doi.org/10.11607/ebh.86.
Melkers J, Hicks D, Rosenblum S, Isett KR, Elliott J. Dental blogs, podcasts, and associated social media: descriptive mapping and analysis. J Med Internet Res. 2017;19.
Coumou HC, Meijman FJ. How do primary care physicians seek answers to clinical questions? A literature review. J Med Libr Assoc. 2006;94:55–60.
Bocchi J, Eastman JK, Swift CO. Retaining the online learner: profile of students in an online MBA program and implications for teaching them. J Educ Bus. 2004;79:245–53.
Strother EA, Lancaster DM, Gardiner J. Information needs of practicing dentists. Bull Med Libr Assoc. 1986;74:227–30 http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=227838&tool=pmcentrez&rendertype=abstract.
Botello-Harbaum MT, Demko CA, Curro FA, Rindal DB, Collie D, Gilbert GH, et al. Information-seeking behaviors of dental practitioners in three practice-based research networks. J Dent Educ. 2013;77:152–60 http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3832844&tool=pmcentrez&rendertype=abstract.
Landry CF. Work roles, tasks, and the information behavior of dentists. J Am Soc Inf Sci Technol. 2006;57:1896–908.
Gilbert GH, Gordan VV, Korelitz JJ, Fellows JL, Meyerowitz C, Oates TW, et al. Provision of specific dental procedures by general dentists in the National Dental Practice-Based Research Network: questionnaire findings. BMC Oral Health. 2015;15:11. https://doi.org/10.1186/1472-6831-15-11.
Makhija SK, Gilbert GH, Rindal DB, Benjamin P, Richman JS, Pihlstrom DJ. Dentists in practice-based research networks have much in common with dentists at large: evidence from “the Dental PBRN”. Gen Dent. 2009;57:270-275.
National Center for Health Statistics. Health, United States, 2015: With Special Feature on Racial and Ethnic Health Disparities. Heal United States, 2015 With Spec Featur Racial Ethn Health Disparities. 2016;:107. doi:76–641496.
Case D, Given LM. Looking for information: a survey of research on information seeking, needs, and behavior-Ch. 5. In: Looking for information: a survey of research on information seeking, needs, and behavior; 2016. p. 80–96. https://doi.org/10.1108/S2055-53772016.
Nahapiet J, Ghoshal S. Social capital, intellectual capital, and the organizational advantage. Acad Manag Rev. 1998;23:242–66.
Swart J. Intellectual capital: disentangling an enigmatic concept. J Intellect Cap. 2006;7:136–59. https://doi.org/10.1108/14691930610661827.
Vale J, Branco MC, Ribeiro J. Individual intellectual capital versus collective intellectual capital in a meta-organization. J Intellect Cap. 2016;17:279–97. https://doi.org/10.1108/JIC-05-2015-0044.
Coleman JS. Social capital in the creation of human capital. Am J Sociol. 1988:95–120.
Thornton PH, Ocasio W, Lounsbury M. The institutional logics perspective. In: Greenwood, R., Oliver, C., Lawrence, T. B., & Meyer RE, editor. The SAGE handbook of organizational institutionalism; SAGE publications Inc 2012. p. 99–128.
Harris R, Holt R. Interacting institutional logics in general dental practice. Soc Sci Med. 2013;94:63–70.
Greenwood R, Díaz AM, Li SX, Lorente JC. The multiplicity of institutional logics and the heterogeneity of organizational responses. Organ Sci. 2010;21:521–39. https://doi.org/10.1287/orsc.1090.0453.
Sweetland SR. Human capital theory: foundations of a field of inquiry. Rev Educ Res. 1996;66:341–59.
Becker GS. Investment in human capital: a theoretical analysis. J Polit Econ. 1962;70:9–49.
Malterud K. The art and science of clinical knowledge: evidence beyond measures and numbers. Lancet. 2001;358:397–400.
Leckie GJ., Pettigrew KE., Sylvain C. Modeling the information seeking of professionals: a general model derived from research on engineers , health care professionals , and lawyers. Libr Q information, community, Policy 1996;66:161–193.
Schleyer TKL, Dodell D. Continuing dental education requirements for relicensure in the United States. J Am Dent Assoc. 2005;136:1450–6.
Eraut M. Non-formal learning and tacit knowledge in professional work. Br J Educ Psychol. 2000;70:113–36. https://doi.org/10.1348/000709900158001.
McGowan BS, Wasko M, Vartabedian BS, Miller RS, Freiherr DD, Abdolrasulnia M. Understanding the factors that influence the adoption and meaningful use of social media by physicians to share medical information. J Med Internet Res. 2012;14:1–11.
Fini R, Lacetera N. Different yokes for different folks: individual preferences, institutional logics, and the commercialization of academic research. In: Spanning the boundaries and disciplines: university technology commercialization in the idea age: Emerald Group Publishing; 2010. p. 1–25.
Sauermann H, Stephan P. Conflicting logics? A multidimensional view of industrial and academic science. Organ Sci. 2013;24:889–909. https://doi.org/10.1287/orsc.1120.0769.
Spallek H, O’Donnell J, Clayton M, Anderson P, Krueger A. Paradigm shift or annoying distraction: emerging implications of web 2.0 for clinical practice. Appl Clin Inform. 2010;1:96–115. https://doi.org/10.4338/ACI-2010-01-CR-0003.
Wahoush O, Banfield L. Information literacy during entry to practice: information-seeking behaviors in student nurses and recent nurse graduates. Nurse Educ Today. 2014;34:208–13.
Andrews JE, Pearce KA, Ireson C, Love MM. Information-seeking behaviors of practitioners in a primary care practice-based research network (PBRN). J Med Libr Assoc. 2005;93:206–12 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1082937/.
Gilbert GH, Williams OD, Korelitz JJ, Fellows JL, Gordan VV, Makhija SK, et al. Purpose, structure, and function of the United States National Dental Practice-Based Research Network. J Dent. 2013;41:1051–9.
Dillman DA, Smyth JD, Christian LM. Internet, phone, mail, and mixed-mode survey: the tailored design method; 2014.
Presser S, Couper MP, Lessler JT, Martin J, Rothgeb JM. Methods for testing and evaluating survey questions. Public Opin Q. 2004;68:109–30.
Brennan D, Spencer A. The role of dentist, practice and patient factors in the provision of dental services. Community Dent Oral Epidemiol. 2005;33:181–95.
The National Dental Practice-Based Research Network. Rapid disruptions: understanding the dental information networks around alternative nicotine products and other clinical needs relevant to patient health and health. 2016.
Funkhouser E, Agee BS, Gordan VV, Rindal DB, Fellows JL, Qvist V, et al. Use of online sources of information by dental practitioners: findings from the dental practice-based research network. J Public Health Dent. 2014;74:71–9. https://doi.org/10.1111/j.1752-7325.2012.00373.x.
Borgatti SP, Everett MG. Models of core/periphery structures. Soc Networks. 2000;21:375–95.
Wasko MM, Faraj S. Why should I share? Examining social capital and knowledge contribution in electronic networks of practice. MIS Q. 2005;29:35–57.
Andrew N, Ferguson D, Wilkie G, Corcoran T, Simpson L. Developing professional identity in nursing academics: the role of communities of practice. Nurse Educ Today. 2009;29:607–11.
Fagnan LJ, Handley MA, Rollins N, Mold J. Voices from left of the dial: reflections of practice-based researchers. J Am Board Fam Med. 2010;23:442–51.
Krackhardt D, Stern RN. Informal networks and organizational crises: an experimental simulation. Soc Psychol Q. 1988;51:123. https://doi.org/10.2307/2786835.
Dawes M, Sampson U. Knowledge management in clinical practice: a systematic review of information seeking behavior in physicians. Int J Med Inform. 2003;71:9–15.
Straub-Morarend CL, Marshall TA, Holmes DC, Finkelstein MW. Informational resources utilized in clinical decision making: common practices in dentistry. J Dent Educ. 2011;75:441–52.
Iqbal A, Glenny A-M. General dental practitioners’ knowledge of and attitudes towards the employment of dental therapists in general practice. Br Dent J. 2002;193:587–91.
Cohen WM, Levinthal DA. Absorptive capacity: a new perspective on learning and innovation. Adm Sci Q. 1990;35:128–52.
Hurst D, Mickan S. Describing knowledge encounters in healthcare: a mixed studies systematic review and development of a classification. Implement Sci. 2017;12:35.
Sadowsky D, Kunzel C. Professional life cycle changes and their effect on knowledge level of dental practitioners. Soc Sci Med. 1989;29:753–60.
Del Fiol G, Workman TE, Gorman PN. Clinical questions raised by clinicians at the point of care: a systematic review. JAMA Intern Med. 2014;174:710–8. https://doi.org/10.1001/jamainternmed.2014.368.
Gorman PN, Yao P, Seshadri V. Finding the answers in primary care: information seeking by rural and nonrural clinicians. Stud Health Technol Inform. 2004;107(Pt 2):1133–7 doi:D040004921 [pii].
Perrow C. A framework for the comparative analysis of organizations. Am Sociol Rev. 1967;32:194. https://doi.org/10.2307/2091811.
Le JV, Pedersen LB, Riisgaard H, Lykkegaard J, Nexøe J, Lemmergaard J, et al. Variation in general practitioners’ information-seeking behaviour–a cross-sectional study on the influence of gender, age and practice form. Scand J Prim Health Care. 2016;34:327–35.
Brassil E, Gunn B, Shenoy AM, Blanchard R. Unanswered clinical questions: a survey of specialists and primary care providers. J Med Libr Assoc. 2017;105. https://doi.org/10.5195/JMLA.2017.101.
Alper BS, White DS, Ge B. Physicians answer more clinical questions and change clinical decisions more often with synthesized evidence: a randomized trial in primary care. Ann Fam Med. 2005;3:507–13.
Oscheroff J, Forsythe D, Buchanan B, Bankowitz R, Blumenfled B, Miller R. Physician’s information needs: analysis of questions asked during clinical teaching. Ann Intern Med. 1991;114:576–81.
Cook DA, Sorensen KJ, Wilkinson JM, Berger RA. Barriers and decisions when answering clinical questions at the point of care. JAMA Intern Med. 2013;173:1962. https://doi.org/10.1001/jamainternmed.2013.10103.
We thank the reviewers and editorial team for comments and suggestions important in the improvement of this manuscript. We also thank the clinicians in the PBRN who took the time to respond to our survey. We are grateful to our entire study team for their insight and contribution to this project (Eugenio Beltran, DMD, MPH, MS, DrPH, DABDPH, George Ford, DMD, Julie Frantsve-Hawley, RDH, PhD, Ellen Funkhouser, DrPH and Dan Meyer, DDS), members of the PBRN who provided useful edits to the paper (Deborah McEdward, BS, RDH, University of Florida and Valeria V. Gordan, Department of Restorative Dental Sciences, College of Dentistry, University of Florida, Gainesville, FL), as well as the Regional Coordinators who were indispensable in the data collection and follow up process (Meredith Buchberg-Trejo, MPH, Claudia Carcelén, MPH, Colleen Dolan, MPH, Stephanie Hodge, MA, Hanna Knopf, BA, Shermetria Massingale, MPH, CHES, Deborah McEdward, RDH, BS, CCRP, Christine O’Brien, RDH, Stephanie Reyes, BA, Tracy Shea, RDH, BSDH, and Ellen Sowell, BA). Opinions and assertions contained here are those of the authors and are not to be construed as necessarily representing the views of the respective organizations or the National Institutes of Health. The National Dental PBRN Collaborative Group includes practitioner, faculty, and staff investigators who contributed to this activity. A list is available at http://nationaldentalpbrn.org/collaborative-group.php
This work was supported by NIH grant U19-DE-22516. Details about the nation’s network are located at http://NationalDentalPBRN.org.
Availability of data and materials
The data used for this research are available from the corresponding author on reasonable request and subject to IRB guidelines.
Ethics approval and consent to participate
Approval by the institutional review boards of the University of Alabama at Birmingham (#X160129003), the Georgia Institute of Technology (#H15396), and the University of Rochester Medical Center (#RSRB00061243) was obtained prior to the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Melkers, J., Hicks, D., Isett, K.R. et al. Preferences for peer-reviewed versus other publication sources: a survey of general dentists in the National Dental PBRN. Implementation Sci 14, 19 (2019). https://doi.org/10.1186/s13012-019-0854-x
- Information preferences
- General dentist
- Journal articles
- Advanced training