Hostname: page-component-857557d7f7-v48vw Total loading time: 0 Render date: 2025-11-20T08:13:49.780Z Has data issue: false hasContentIssue false

Moving from a pilot study to large pragmatic trial in primary care settings: A study on acute rhinosinusitis

Published online by Cambridge University Press:  06 November 2025

Daniel Merenstein*
Affiliation:
Georgetown University Medical Center, Department of Family Medicine, Washington, DC, USA
Bruce Barrett
Affiliation:
University of Wisconsin - Madison, Department of Family Medicine and Community Health, Madison, WI, USA
Sebastian T. Tong
Affiliation:
University of Washington, Department of Family Medicine, Seattle, WA, USA
Aleksandra E. Zgierska
Affiliation:
Penn State College of Medicine, Department of Family and Community Medicine, Hershey, PA, USA
David P. Rabago
Affiliation:
Penn State College of Medicine, Department of Family and Community Medicine, Hershey, PA, USA
Derjung M. Tarn
Affiliation:
David Geffen School of Medicine at UCLA, Department of Family Medicine, Los Angeles, CA, USA
Keisha Herbin Smith
Affiliation:
Georgetown University Medical Center, Department of Family Medicine, Washington, DC, USA
Gabriela Villalobos
Affiliation:
Virginia Commonwealth University, Department of Family Medicine and Population Health, Richmond, VA, USA
Danielle Schramm
Affiliation:
David Geffen School of Medicine at UCLA, Department of Family Medicine, Los Angeles, CA, USA
Cameron Casey
Affiliation:
David Geffen School of Medicine at UCLA, Department of Family Medicine, Los Angeles, CA, USA
Tina P. Tan
Affiliation:
Georgetown University Medical Center, Department of Family Medicine, Washington, DC, USA
Charles R. Fencil
Affiliation:
Virginia Commonwealth University, Department of Family Medicine and Population Health, Richmond, VA, USA
Stephen Fernandez
Affiliation:
Georgetown University Medical Center, Department of Family Medicine, Washington, DC, USA MedStar Health Research Institute, Columbia, MD, USA
Mihriye Mete
Affiliation:
MedStar Health Research Institute, Columbia, MD, USA
Nawar Shara
Affiliation:
MedStar Health Research Institute, Columbia, MD, USA
Nicholas Franko
Affiliation:
University of Washington, Department of Family Medicine, Seattle, WA, USA
Jessy Sparenborg
Affiliation:
Georgetown University Medical Center, Department of Family Medicine, Washington, DC, USA
Alex H. Krist
Affiliation:
Virginia Commonwealth University, Department of Family Medicine and Population Health, Richmond, VA, USA
*
Corresponding author: D. Merenstein; Email: djm23@georgetown.edu
Rights & Permissions [Opens in a new window]

Abstract

Background:

Acute rhinosinusitis is one of the most common conditions seen in primary care. One in seven adults are diagnosed with ARS annually, resulting in one in five of all antibiotic prescriptions. Yet there has been limited research comparing the effectiveness of widely used treatments such as antibiotics and nasal steroids. Conducting such a trial in the context of decades of established practice poses unique challenges.

Methods:

A feasibility phase was conducted with continuing feedback to provide refinement and guidance regarding the design of a large-scale, pragmatic randomized controlled trial. The pilot trial assessed the ability to enroll, retain, and evaluate adherence to the intervention and assessment protocols.

Results:

The feasibility phase allowed us to seek input from patients and experts. This resulted in changes pre and post pilot that will impact the full study. A priori enrollment targets for the pilot were achieved, and with high adherence rates. In total, 373 patients were pre-screened and 140 patients were enrolled participants. Adherence to data collection via the daily diary was 93% throughout the study, with 95% completing their diary on the day of the primary outcome, 3 post-randomization.

Conclusion:

Expert panels and a patient advisory committee recommended critical changes to our study design. Stakeholder engagement is a key component of this funding source and was widely used throughout the 18-months. An achieved primary goal of the feasibility phase was to evaluate recruitment and study methods prior to implementing a large clinical trial that requires significant resources.

Information

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Association for Clinical and Translational Science

Introduction

The Patient-Centered Outcomes Research Institute (PCORI) has funded pragmatic clinical trials since 2014 [Reference Frank, Basch and Selby1]. Consistent with the mission of PCORI to help patients and clinicians make informed healthcare decisions and improve healthcare delivery and outcomes, these trials represent comparative clinical effectiveness research (CER). The trials are designed to be large, real-world pragmatic studies, that answer questions often not addressed by other funders but nevertheless critical to patients and patient care. Before funding these large, expensive trials, PCORI often requires an 18-month feasibility phase, including a pilot study, the successful completion of which is a requirement prior to the PCORI’s approval to proceed to the full study. We are reporting on how the feasibility phase advanced our understanding and informed the design of our “Nasal Irrigation, Oral Antibiotics, and Subgroup Targeting for Effective Management of Acute Sinusitis” (NOSES) trial.

The NOSES study aims to effectively treat acute sinusitis while reducing inappropriate antibiotic use and growing bacterial resistance. Global overuse of antibiotics increases antibiotic resistance and unnecessary medication-related adverse events [Reference Albrich, Monnet and Harbarth2]. The COVID-19 pandemic has underscored the importance of proper diagnosis and treatment of respiratory infections in primary care. Unfortunately, acute rhinosinusitis (ARS) is one of the most common conditions that is inappropriately treated with antibiotics, although ARS is usually caused by viruses [Reference DeBoer and Kwon3]. In the U.S., one in seven adults is diagnosed with ARS every year, across 30 million office visits, resulting in one in five of all antibiotic prescriptions and accounting for over $11 billion in direct annual costs [Reference Lemiengre, Van Driel, Merenstein, Liira, Mäkelä and De Sutter410]. Because ARS is so prevalent and the impact of inappropriate antibiotic use is so widespread, the populations and health decisions affected by this research will likely have a major impact on public health.

Reducing inappropriate prescribing for ARS is crucial to limiting the development and spread of antibiotic resistance [Reference Goossens, Ferech, Vander Stichele and Elseviers11]. The World Health Organization has identified the overuse of antibiotics and subsequent resistance as a top public health concern, while the United Nations convened a high-level meeting to coordinate approaches to address the root causes of antimicrobial resistance [Reference Merenstein, Gonzalez, Young, Roberts, Sanders and Petterson12], the fourth health issue to ever be addressed by the General Assembly [Reference Avorn, Barrett, Davey, McEwn, O’Brien and Levy13]. Inappropriate use of antibiotics is not just a societal issue but an individual issue as well. Our research group and other researchers have shown significant microbiome and metabolic changes that may have long-term health impacts on individuals [Reference Merenstein, Fraser and Roberts14Reference Guirro, Costa, Gual-Grau and Nerurkar18]. Per the Centers for Disease Control and Prevention (CDC), antibiotics are one of the most common reasons for emergency department visits for adverse drug events, responsible for 16% of all adverse drug reactions [19].

ARS is often inappropriately treated because of the difficulty of distinguishing viral from bacterial ARS and because of the lack of point of care tests or evidence-based clinical prediction rules. Other infections in primary care, such as pharyngitis, COVID-19, urinary tract, or pneumonia, have clinical and/or laboratory tools readily available to distinguish viral from bacterial infections to guide antibiotic prescribing [Reference Lemiengre, Van Driel, Merenstein, Liira, Mäkelä and De Sutter4,Reference Lemiengre, Van Driel, Merenstein, Young and De Sutter20Reference Van Den Broek, Gudden and Kluijfhout23]. A large study is needed to provide this type of data to guide ARS’ treatment with antibiotics, the type of study supported by PCORI’s comparative effectiveness pragmatic trial initiatives. Accordingly, little funding has been expended on ARS, with the most recent Cochrane review finding only 15 studies on ARS care, in comparison to the last Cochrane review on Vitamin D and mortality that included 159 relevant articles [Reference Lemiengre, Van Driel, Merenstein, Liira, Mäkelä and De Sutter4]. We view this as part of the larger problem of too little primary care research, with only 0.3 percent of National Institutes of Health (NIH) funding supporting primary care-driven research [Reference Lemiengre, Van Driel, Merenstein, Liira, Mäkelä and De Sutter4,Reference Cameron, Bazemore and Morley24].

To better understand ARS, a common disease, and provide clinicians with the tools to determine the comparative benefits of antibiotics versus the most commonly used non-antibiotic treatment, intranasal corticosteroids (INCS), we designed NOSES, a parallel 4-arm randomized controlled trial (RCT). All enrolled patients were given options for supportive care, and supplies for nasal saline irrigation. NOSES will evaluate disease-specific quality-of-life outcomes that are patient-reported and -centered and approved by the study’s patient and other stakeholder partners who have advised on the project design and implementation. The specific aims of the NOSES trial are (1) To compare, through patient-reported outcomes, the efficacy of oral antibiotics (amoxicillin-clavulanate), and INCS, for clinical improvement of ARS symptoms among adults who did not improve with supportive care alone during the first 10 days of their symptoms. We expect approximately 60% of individuals will not improve with supportive care. (2) To identify which subgroups of participants benefit most from oral antibiotics (amoxicillin-clavulanate) versus INCS. Potential subgroups of interest, suggestive of bacterial infection, include participants with (a) an elevated C-reactive protein (CRP) level, (b) double-sickening, defined as, “Have you had worsening of sinus symptoms after initial improvement,” (c) evidence of nasal discharge purulence on clinical examination, (d) change in smell (cacosmia), (e) pain in the teeth, or (f) provider’s clinical impression [Reference Young, De Sutter and Merenstein21,Reference Hickner, Bartlett and Besser25Reference Dale, Marchello and Ebell30]. These subgroups are suggestive of bacterial infection [Reference Ebell, McKay, Dale, Guilbault and Ermias28]. (3) To identify which participant subgroups improve with supportive care and do not require antibiotics or INCS. Clinicians could recommend any supportive care but all patients were provided supplies and instructions for saline nasal irrigation.

We report here on the results of our pilot study, which was not powered to find between-group differences, but designed to help us demonstrate feasibility and better understand what is needed to successfully complete the full-scale study projected to start in January 2025. The purpose of this manuscript is to highlight the value of a feasibility phase and discuss how it can influence a large pragmatic study. In order to truly conduct a pragmatic trial, it is helpful to get input from a variety of sources. The primary goal of the pilot study was to assess the ability to enroll (target n = 144), randomize and retain (n ≥ 68), and evaluate adherence to the interventions (greater than 71%) and assessment protocols (greater than 80%). Another important goal of the pilot was to obtain and incorporate feedback from patients, experts, and other stakeholders.

Methods

Study overview and regulatory approval

The feasibility phase centered on two major activities: (1) engagement with patient, clinician, and scientific stakeholders to garner qualitative input to help operationalize study plans; and (2) a pilot RCT to assess the capacity to enroll, retain, and adhere to the protocol.

A single IRB was used, BRANY #23-02-622, and the study was registered prior to recruitment at ClinicalTrials.gov, #NCT06076304. This study followed the Consolidated Standards of Reporting Trials (CONSORT) reporting guideline for clinical trials, and the full trial protocol is currently under review.

Design

Focus groups

In the first few months of the feasibility phase, 3 focus group sessions were held; one session with primary care physicians, one with other primary care clinicians (physician assistants and nurse practitioners), and one with clinic personnel (nurses, medical assistants, front desk, laboratory, etc.). Two semi-structured interview guides with open-ended questions were developed: one tailored for clinicians which focused on the medical aspects of the trial design; one for nonclinical personnel that focused on patient recruitment and staff engagement. Additionally throughout the pilot, we had longitudinal oversight and feedback from our expert and patient advisory panels resulting in advice from these panels on how to adapt the study design both before and after the pilot was conducted.

Engagement activities

Early in the 18-month feasibility phase we set up 4 committees; a Patient Advisory Board (PAB), a Data Safety and Monitoring Board (DSMB), a Study Advisory Committee (SAC), and a Dissemination and Engagement Committee (DEC). The SAC and DEC includes experts and stakeholders interested in primary care and antibiotic stewardship. They have a variety of expertise in different medical fields, statistics, and clinical trial implementation. The PAB includes 2 representatives from each of the 6 clinical sites and has been instrumental in ensuring our questions, outcomes and approaches are amenable to patients. All of these groups work together and information from each is shared with the others, please see Figure 1. We recruited over 30 committee members representing a diverse range of stakeholder groups. These committees met a combined 14 times throughout the study.

Figure 1. Committees.

Pilot RCT setting and participants

A scaled down (unpowered) version of the proposed full-scale protocol was designed to demonstrate whether the target accrual rates for enrollment, retention, and adherence were achievable at the selected clinic sites. Other aspects of the patient experience and impact on clinic workflow were assessed. A schematic of the pilot (Figure 2) shows a timeline of the initial clinician visit, recruitment, enrollment, randomization/allocation, intervention, and follow-up periods, starting from the supportive care period through the final day of the study (day 14). Participants were enrolled into the study based on how many days they had ARS symptoms; if symptoms were present for fewer than 10 days prior, participants started in the supportive care phase – days are referred to as E on the diagram – until E9. All participants were generally healthy, English speakers between 18–65 years of age. Supplemental Table 1 includes the full inclusion/exclusion criteria. We recruited patients from 6 diverse practice-based research networks based at Georgetown University, Virginia Commonwealth University, Penn State College of Medicine, the University of Wisconsin – Madison, the University of Washington, and the University of California, Los Angeles.

Figure 2. Participant flow diagram for pilot study.

Interventions and blinding

Participants who were sick for 9 days or less at enrollment were recommended supportive care. If they did not improve by day E9, or had >9 days of symptoms at enrollment, they were randomized to one of four groups: group one received antibiotics, group two received placebo antibiotics plus INCS, group three received antibiotics plus INCS, and group four received placebo antibiotics. All participants received a Neti pot, salt packets, and instructions for SNI. Participants were followed for 14 days after randomization.

The study antibiotic and dose was amoxicillin-clavulanate 875 –125 mg, taken twice daily for 7 days, as recommended by the aforementioned IDSA guideline. The INCS spray was 32 mcg of budesonide in each metered spray administered in 2 sprays per nostril, once daily. Both were provided to each site by Doyle’s Pharmacy of Houston, TX. The pharmacy over-encapsulated the amoxicillin-clavulanate pills and prepared the matching placebo. We utilized a masking procedure of different unique numbers to ensure proper randomization, blinding, allocation, and implementation of these research procedures. We used permuted block randomization by site with variable block sizes (4, 8, or 12) to enroll patients.

Primary outcome measurements

As previously mentioned, our primary goal were to obtain expert and patient input of the process and experience and to adapt the trial to inform study design. The objectives of the pilot trial were to evaluate if target rates of enrollment (target n = 144), randomization and retention (n≥68) were achievable.

The primary outcome of the full-scale study, patient improvement, is a disease-specific quality-of-life score (the modified Sinonasal Outcome Test (mSNOT-16), which was measured at Day 3 after randomization. Day 3 was chosen based on the Infectious Diseases Society of America guidelines that recommend changing treatment if no improvement after 3 days [Reference Chow, Benninger and Brook31]. The mSNOT-16 is validated but has not been used often; another aim of the feasibility phase was to determine if the scale is an appropriate primary outcome measure for the full-scale study.

Adherence assessment

We assessed study drug adherence through participant self-reports via the daily diary and follow-up interviews. As part of the daily diary, participants recorded the number of capsules taken per day, and use of INCS. Participants were informed to save all unfinished drugs and to report how many capsules were left at the end intervention period. On day 8, participants were asked to photograph the bottle showing the remaining capsules and upload it to the study database. We assessed compliance via a continuous variable; the participant was deemed compliant if 10 or more capsules (out of 14 maximum) of amoxicillin-clavulanate were taken. Participants were also compliant if they used they study INCS for at least 5 of the 7 maximum days. Participant retention throughout their illness and diary completion were also assessed, both with target rates of 80% or higher.

Sample size

For the full-scale study to be sufficiently powered, the sample size was determined to be 3,720 participants (enrolled). Based on focus groups and clinician reports, we estimated that 60% of participants would transition to the randomization phase, and 40% would improve or withdraw during the supportive care phase. The sample size for the pilot was based on the 3,720 participants needed for the full study over the total number of recruitment months. The comparable rate was calculated to be 24 participants per site in two months. Thus, the targeted sample size for the pilot was 24 participants for each of the 6 sites, for a total of 144.

Statistical analysis

Data collected during the pilot were summarized using descriptive statistics, such as means and standard deviations for continuous variables and frequencies and percentages for categorical variables. Bivariate statistics (two-sample t-tests, proportions test, Fisher’s exact test, Chi-square test or Analysis of Variance (ANOVA) were used as appropriate to conduct two-group or four-group comparisons. Linear mixed models were used to analyze longitudinal data for the primary outcome measure mSNOT-16, including time indicator, group indicator, and their interactions with random effects at the patient level to explore trends over time. The mSNOT-16 scores were also compared to the 6-point Patient Global Impression of Change Scale. Stata 17 was used to conduct statistical analyses.

Results

Qualitative feedback

Each of the focus groups provided valuable input on different aspects of the trial [Reference Liu, Fencil and Whitfield32]. A few specific recommendations necessitated further discussion with PCORI, and prompted protocol changes prior to the pilot trial. One such modification was to the earlier exclusion of patients diagnosed with COVID-19 from the trial. The physician focus group properly pointed out that nearly all ARS starts with a virus, and that if patients were still sick with ARS symptoms by day 10, most primary care clinicians would prescribe antibiotics. The protocol was amended to include qualifying patients with positive COVID-19 diagnoses.

In addition to the focus groups, the stakeholder committees (PAB, SAC and DEC) raised suggestions that did not require methodological re-design but that would optimize recruitment and study operations. One significant change was to the follow-up timeline – originally every 3–4 days to daily – and to add an option to complete the diary on a mobile device, as it is now preferred over voice calling. When it became clear that patients and clinicians refer to ARS in many different ways, we updated how we train our research assistants to discuss the study and to be more inclusive in our descriptions.

The PAB was instrumental to the design and language on patient-facing materials, including recruitment flyers, website, and form collection methods. The PAB was highly engaged with the researchers both pre- and post-pilot.

Additional changes were prompted after the study clinicians and committees reviewed the pilot trial data. After reviewing SNI compliance and extensive feedback from the PAB, we were able to refine how saline nasal irrigation will be broached in the next phase. Both the SAC and DEC were strong proponents of adding double-sickening and increasing the age limit to 75 as inclusion criteria to the full-scale study. PCORI agreed with the new inclusion criteria and protocol modifications.

Recruitment success strategies

Consistent with a pragmatic trial, each site adapted their operational and recruitment plans to best work for their team, partner clinics, and patient population. Some sites had research coordinators physically present at the clinic, and clinic staff alerted them of patients who might be eligible. Others used electronic medical records to identify patients coming into the clinic who may have qualified for inclusion. It also was apparent that some clinics had champions who strongly believed in the study aims and talked to their patients about reasons to be enrolled in the study.

Pilot study sample

A total of 373 patients were approached or pre-screened at six study sites for the pilot trial; 140 participants were enrolled (see Figure 3). Five sites enrolled the a priori sample of 24 participants per site; one site started recruitment later than the other sites and enrolled 20 participants. The sample of 140 participants constituted 97% of our goal of 144 enrolled individuals. Demographic data were collected, as permitted by the IRB, from participants who declined or failed inclusion.

Figure 3. CONSORT flow diagram.

Among the 233 individuals screened but not enrolled, 138 provided their age (59%), 131 reported race (56%), and 144 reported sex (61%). Table 1 shows the distribution of age, sex, and race variables for the 140 enrolled and 233 not-enrolled participants; based on the available data, no statistically significant differences were noted in these characteristics between these two groups. The 140 enrolled participants were, on average, 36.9 years old, with 73% identifying as White and 19% as Hispanic/Latino.

Table 1. Demographic characteristics of the participants who enrolled vs. Those who screened out or declined to participate (Not enrolled)

Statistically significant differences were not observed between those who improved on their own before day E9 (N = 44), and those who did not improve (N = 96) and were subsequently randomized (Table 2). The characteristics of those randomized (total and by group status) are presented in Table 3.

Table 2. Overall and by enrollment phase outcome: improved vs not improved (N = 140)

Table 3. Overall and by randomization groups (N = 87)

Adherence to the assessment protocol was higher than anticipated in our sample size calculations. The overall rate of daily diary completion was 93% throughout the study, and over 95% diary completion on day 3 post-randomization, representing the primary outcome measure endpoint. Daily diary data collection adherence varied between 91% and 100% during the initial phase (between enrollment and randomization) and 90% and 98% post-randomization.

Adherence to the intervention protocol was more mixed. During the study, 39% of participants reported trying nasal saline irrigation at least once. Post-randomization, participants reported over 78% adherence to the antibiotic or placebo capsules and 81% compliance with using INCS.

Since the overarching goal of this pilot was not to compare differences in effectiveness between groups, we will not fully report on primary or secondary outcomes. However, it was validating to see that, as expected, all participants improved over time, and confirmed by both the mSNOT-16 and the Patient Global Impression of Change scores (see Figure 4). An important finding that these two quality-of-life scores correlated quite well, Table 4. The Patient Global Impression of Change scale takes less time to complete, and we will continue to assess correlation with the validated mSNOT-16 scores in the full-scale study.

Figure 4. MSNOT over time.

Table 4. Associations between the global rating scale and mSNOT-16 scale for days E9 and R3, continuous mSNOT-16 scores by the ordered categories of the global rating scale

Discussion

A primary goal of the feasibility phase was to evaluate recruitment and study methods prior to implementing a large clinical trial that requires significant resources. Conducting studies that are pragmatic and assess “real world” comparative effectiveness are important to helping address implementation and sustainability in busy primary care and urgent care clinics. Understanding and minimizing potential burdens on participants, clinicians, and clinic personnel are key considerations. Stakeholder input is a cornerstone of such studies.

In Results, we described changes to the study protocol that will be implemented for the larger RCT. The engagement work enabled us to better understand and reconcile issues that can often be overlooked by researchers. These include operational refinements that would not only improve participation but will help enhance the generalizability of future findings.

For example, PAB members emphasized the shift in preferences away from phone communication and willingness to increase the frequency of self-reported collection. Participant self-reports provided the opportunity to gather more information at more frequent intervals; however, each interaction was shorter than anticipated.

Review of the data collected from individuals who declined to participate, failed inclusion, or were not approached, helped the researchers reassess some inclusion and exclusion criteria. We recognized how many patients who would have otherwise qualified but were excluded from the study solely due to age (65–75 years). Extensive feedback from the SAC, DEC, and clinicians in the field challenged the requirement for participants to be sick for at least10 days to be randomized, without the consideration of “double-sickening.” For the full-scale study, procedures have been added to immediately randomize participants with double-sickening.

The other important goal for pilot is to demonstrate that one can follow the protocol and enroll and retain participants within the framework of a randomized placebo-controlled study. It is always difficult to enroll participants when their other option, routine care, means the likelihood of antibiotics being prescribed and no chance of placebo. Participants are advised to talk to their treating clinicians if they had not improved by day 3. This is consistent with IDSA guidelines that recommend switching medications if there was no improvement after day 3. While we recognize that this is indeed a challenge, we were able to enroll and deliver interventions to nearly all the participants we agreed upon within a 2-month time window. Importantly, we needed to ensure that participants would not drop out if they achieved clinical improvement before day 10. Based on focus groups and discussions with clinicians involved in the study, we based our sample size calculation for the full study on 60% being randomized. Achieving this is a significant accomplishment.

In addition to achieving our targets for recruiting, enrolling, and retaining participants, we had much higher compliance rates than anticipated. Overall compliance to the daily diary assessments was 94%, in a timeframe ranging from up to 9 days prior to and 14 days after the day of randomization. That is important as we transition to the full-scale study, as it will allow us to collect nearly all our data electronically and efficiently.

We had lower rates of saline nasal irrigation use than anticipated. To account for variations in local water quality, participants were provided with 2 gallons of distilled water, along with a standard Neti pot and saline packets. Research personnel observed that some patients were reluctant to travel from the clinic with this volume of water. Proper storage of the water after unsealing, and mixing the solution on a per-use basis also discouraged uptake. In response, changes to the protocol and actual nasal irrigation device will be implemented for the full-scale study. The newer nasal irrigation device has a built-in microfilter can be safely used with municipal tap water, avoiding the need to transport distilled water. Additionally, the PAB offered suggestions to improve the discussion and demonstration of SNI rationale and use, detailed written and video instructions, and best practices for communication training of research personnel.

We reported some pilot outcomes in this paper but as expected with the small sample, did not see any differences among the four groups. In addition to our primary outcome reported on the mSNOT-16, we also collected the global assessment of change, a 6-point scale that others have used in ARS. We found they correlated well when comparing these two scales.

We are about to undertake a transformative study in primary care. Like much of primary care, ARS is very common but understudied, with only a few small RCTs reporting heterogeneous results. This study will be nearly 10 times larger than any previous ARS study. This large sample size will allow us to look for subgroups that may benefit, understand the role of a variety of supportive care options and truly use antibiotics properly for ARS. It is clear from all the lessons we learned that we would not have been able to accomplish this without this preparatory time and the freedom to do a pilot study.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/cts.2025.10175.

Acknowledgments

We would like to thank all the research assistants who helped conduct the study, the participants who took part in the study, and the clinics where patients were recruited.

Author contributions

Daniel Merenstein: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Bruce Barrett: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Sebastian T. Tong: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Aleksandra E. Zgierska: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; David P. Rabago: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Derjung M. Tarn: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Keisha Herbin Smith: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Gabriela Villalobos: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Danielle Schramm: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Cameron Casey: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Tina P. Tan: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Charles R. Fencil: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Stephen Fernandez: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Software, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Mihriye Mete: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Software, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Nawar Shara: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Software, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Nicholas Franko: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Jessy Sparenborg: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing; Alex H. Krist: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing-original draft, Writing-review & editing.

Funding statement

This work was supported through a Patient-Centered Outcomes Research Institute (PCORI) Project Program Award (PLACER-2021C3-24476). All statements in this report, including its findings and conclusions, are solely those of the authors and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute (PCORI), its Board of Governors or Methodology Committee.

Competing interests

No authors have any conflicts of interest.

References

Frank, L, Basch, E, Selby, JV. The PCORI perspective on patient-centered outcomes research. JAMA. 2014;312:1513. doi: 10.1001/jama.2014.11100.Google Scholar
Albrich, WC, Monnet, DL, Harbarth, S. Antibiotic selection pressure and resistance in streptococcus pneumoniae and streptococcus pyogenes. Emerg Infect Dis. 2004;10:514517. doi: 10.3201/eid1003.030252.Google Scholar
DeBoer, DL, Kwon, E. Acute Sinusitis. In: StatPearls. StatPearls Publishing, 2024. (http://www.ncbi.nlm.nih.gov/books/NBK547701/) Accessed November 4, 2024.Google Scholar
Lemiengre, MB, Van Driel, ML, Merenstein, D, Liira, H, Mäkelä, M, De Sutter, AI. Antibiotics for acute rhinosinusitis in adults. Cochrane Acute Respiratory Infections Group, ed. Cochrane Database Syst Rev. 2018, 2018. doi: 10.1002/14651858.CD006089.pub5.Google Scholar
Smith, SS, Evans, CT, Tan, BK, Chandra, RK, Smith, SB, Kern, RC. National burden of antibiotic use for adult rhinosinusitis. J Allergy Clin Immun. 2013;132:12301232. doi: 10.1016/j.jaci.2013.07.009.Google Scholar
Good Stewardship Working Group. The “top 5” lists in primary care: meeting the responsibility of professionalism. Arch Intern Med. 2011;171:13851390. doi: 10.1001/archinternmed.2011.231.Google Scholar
Fairlie, T, Shapiro, DJ, Hersh, AL, Hicks, LA. National trends in visit rates and antibiotic prescribing for adults with acute sinusitis. Arch Intern Med. 2012;172:1513. doi: 10.1001/archinternmed.2012.4089.Google Scholar
Smith, SR. Treatment of mild to moderate sinusitis. Arch Intern Med. 2012;172:510. doi: 10.1001/archinternmed.2012.253.Google Scholar
Sinus and Allergy Health Partnership. Antimicrobial treatment guidelines for acute bacterial rhinosinusitis. Otolaryngol--Head Neck Surg. 2004;130:145. doi: 10.1016/j.otohns.2003.12.003.Google Scholar
Pew Charitable Trusts. Antibiotic use in outpatient settings. 2016.Google Scholar
Goossens, H, Ferech, M, Vander Stichele, R, Elseviers, M, ESAC Project Group. Outpatient antibiotic use in Europe and association with resistance: A cross-national database study. Lancet. 2005;365:579587. doi: 10.1016/S0140-6736(05)17907-0.Google Scholar
Merenstein, D, Gonzalez, J, Young, AG, Roberts, RF, Sanders, ME, Petterson, S. Study to investigate the potential of probiotics in children attending school. Eur J Clin Nutr. 2011;65:447453. doi: 10.1038/ejcn.2010.290.Google Scholar
Avorn, J, Barrett, J, Davey, P, McEwn, S, O’Brien, T, Levy, S. Antibiotic Resistance: Synthesis of Recommendations by Expert Policy Groups. Alliance Prudent Use Antibiot World Health Organ, 2001.Google Scholar
Merenstein, D, Fraser, CM, Roberts, RF, et al. Bifidobacterium animalis subsp. Lactis BB-12 protects against antibiotic-induced functional and compositional changes in human fecal microbiome. Nutrients. 2021;13:2814. doi: 10.3390/nu13082814.Google Scholar
Zhang, X, Borbet, TC, Fallegger, A, Wipperman, MF, Blaser, MJ, Müller, A. An antibiotic-impacted microbiota compromises the development of colonic regulatory T cells and predisposes to dysregulated immune responses. Ravel, J, ed. mBio. 2021;12:e03335e03320. doi: 10.1128/mBio.03335-20.Google Scholar
Roubaud-Baudron, C, Ruiz, VE, Swan, AM, et al. Long-term effects of early-life antibiotic exposure on resistance to subsequent bacterial infection. Cossart, PF, ed. mBio. 2019;10:e02820e02819. doi: 10.1128/mBio.02820-19,Google Scholar
Jielong, Guo, Han, X, Huang, W, You, Y, Zhan, J. Gut dysbiosis during early life: Causes, health outcomes, and amelioration via dietary intervention. Crit Rev Food Sci. 2022;62:71997221. doi: 10.1080/10408398.2021.1912706.Google Scholar
Guirro, M, Costa, A, Gual-Grau, A, et al. Effects from diet-induced gut microbiota dysbiosis and obesity can be ameliorated by fecal microbiota transplantation: A multiomics approach. Nerurkar, PV, ed. Plos One. 2019;14:e0218143. doi: 10.1371/journal.pone.0218143.Google Scholar
Centers for Disease Control and Prevention. Adverse drug events from specific medicines. (https://www.cdc.gov/medicationsafety/adverse-drug-events-specific-medicines.html) Accessed October 21, 2024.Google Scholar
Lemiengre, MB, Van Driel, ML, Merenstein, D, Young, J, De Sutter, AI. Antibiotics for clinically diagnosed acute rhinosinusitis in adults. Cochrane Acute Respiratory Infections Group, ed. Cochrane Database of Syst Rev. 2012. doi: 10.1002/14651858.CD006089.pub4.Google Scholar
Young, J, De Sutter, A, Merenstein, D, et al. Antibiotics for adults with clinically diagnosed acute rhinosinusitis: a meta-analysis of individual patient data. Lancet. 2008;371:908914. doi: 10.1016/S0140-6736(08)60416-X.Google Scholar
Hauer, AJ, Luiten, EL, Van Erp, NF, et al. No evidence for distinguishing bacterial from viral acute rhinosinusitis using fever and facial/Dental pain: A systematic review of the evidence base. Otolaryngol--Head Neck Surg. 2014;150:2833. doi: 10.1177/0194599813510891.Google Scholar
Van Den Broek, MFM, Gudden, C, Kluijfhout, WP, et al. No evidence for distinguishing bacterial from viral acute rhinosinusitis using symptom duration and purulent rhinorrhea: A systematic review of the evidence base. Otolaryngol – Head Neck Surg. 2014;150:533537. doi: 10.1177/0194599814522595.Google Scholar
Cameron, BJ, Bazemore, AW, Morley, CP. Lost in translation: NIH funding for family medicine research remains limited. J Am Board Fam Med. 2016;29:528530. doi: 10.3122/jabfm.2016.05.160063.Google Scholar
Hickner, JM, Bartlett, JG, Besser, RE, et al. Principles of appropriate antibiotic use for acute rhinosinusitis in adults: Background. Ann Intern Med. 2001;134:498505. doi: 10.7326/0003-4819-134-6-200103200-00017.Google Scholar
Lindbaek, M, Hjortdahl, P, Johnsen, UL. Use of symptoms, signs, and blood tests to diagnose acute sinus infections in primary care: Comparison with computed tomography. Fam Med. 1996;28:183188.Google Scholar
Ebell, MH, McKay, B, Guilbault, R, Ermias, Y. Diagnosis of acute rhinosinusitis in primary care: A systematic review of test accuracy. Br J Gen Pract. 2016;66:e612e632. doi: 10.3399/bjgp16X686581.Google Scholar
Ebell, MH, McKay, B, Dale, A, Guilbault, R, Ermias, Y. Accuracy of signs and symptoms for the diagnosis of acute rhinosinusitis and acute bacterial rhinosinusitis. Ann Fam Med. 2019;17:164172. doi: 10.1370/afm.2354.Google Scholar
Ebell, MH, Hansen, JG. Proposed clinical decision rules to diagnose acute rhinosinusitis among adults in primary care. Ann Fam Med. 2017;15:347354. doi: 10.1370/afm.2060.Google Scholar
Dale, AP, Marchello, C, Ebell, MH. Clinical gestalt to diagnose pneumonia, sinusitis, and pharyngitis: A meta-analysis. Br J Gen Pract. 2019;69:e444e453. doi: 10.3399/bjgp19X704297.Google Scholar
Chow, AW, Benninger, MS, Brook, I, et al. IDSA clinical practice guideline for acute bacterial rhinosinusitis in children and adults. Clin Infect Dis. 2012;54:e72e112. doi: 10.1093/cid/cir1043.Google Scholar
Liu, RY, Fencil, C, Whitfield, T, et al. Informing a sinusitis clinical trial protocol: A focus group study with clinicians and staff. J Clin Transl Sci. 2024;8:e225. doi: 10.1017/cts.2024.663.Google Scholar
Figure 0

Figure 1. Committees.

Figure 1

Figure 2. Participant flow diagram for pilot study.

Figure 2

Figure 3. CONSORT flow diagram.

Figure 3

Table 1. Demographic characteristics of the participants who enrolled vs. Those who screened out or declined to participate (Not enrolled)

Figure 4

Table 2. Overall and by enrollment phase outcome: improved vs not improved (N = 140)

Figure 5

Table 3. Overall and by randomization groups (N = 87)

Figure 6

Figure 4. MSNOT over time.

Figure 7

Table 4. Associations between the global rating scale and mSNOT-16 scale for days E9 and R3, continuous mSNOT-16 scores by the ordered categories of the global rating scale

Supplementary material: File

Merenstein et al. supplementary material

Merenstein et al. supplementary material
Download Merenstein et al. supplementary material(File)
File 142 KB