Skip to main content Accessibility help
×
Hostname: page-component-69cd664f8f-fq6ln Total loading time: 0 Render date: 2025-03-13T06:59:02.875Z Has data issue: false hasContentIssue false

7 - Achieving Transparency

from Part II - Rethinking Research

Published online by Cambridge University Press:  aN Invalid Date NaN

Karen B. Schmaling
Affiliation:
Washington State University
Robert M. Kaplan
Affiliation:
Stanford University
Get access

Summary

Some of the practices that are believed to enhance the quality of science may produce bias. Studies with unexciting results may never be published, or results are selectively reported to highlight positive outcomes. Investigators often measure multiple outcomes while only reporting those with statistically significant findings. The best remedy for this problem is to require prospective declaration of study plans through study registration, such as the primary and secondary outcome variables and data analysis plans. Failure to report results of completed studies remains a serious problem. Further, results from many studies remain unpublished and the probability of publication is higher for positive results, leading to overestimates of treatment benefit. It is possible that some encouraging clinical trial findings are actually false positive results. For US Food and Drug Administration evaluations, data from a significant portion of relevant completed trials remain undisclosed at the time the pharmaceutical products are under evaluation.

Type
Chapter
Information
Rethinking Clinical Research
Methodology and Ethics
, pp. 137 - 159
Publisher: Cambridge University Press
Print publication year: 2025

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Jamieson, KH, McNutt, M, Kiermer, V, Sever, R. Signaling the trustworthiness of science. Proc Natl Acad Sci U S A. 2019; 116(39):19231–19236. doi:10.1073/pnas.1913039116CrossRefGoogle ScholarPubMed
Nosek, BA, Alter., G, Banks, GC, et al. SCIENTIFIC STANDARDS. Promoting an open research culture. Science. 2015; 348(6242):14221425. doi:10.1126/science.aab2374.CrossRefGoogle ScholarPubMed
Zarin, DA, Califf, RM. Trial reporting and the clinical trials enterprise. JAMA Intern Med. 2021; 181(8):11311132. doi:10.1001/jamainternmed.2021.2041.CrossRefGoogle ScholarPubMed
Trinquart, L, Dunn, AG, Bourgeois, FT. Registration of published randomized trials: A systematic review and meta-analysis. BMC Med. 2018; 16(1):173. doi:10.1186/s12916-018-1168-6.CrossRefGoogle ScholarPubMed
Viergever, RF, Karam, G, Reis, A, Ghersi, D. The quality of registration of clinical trials: Still a problem. PLoS One. 2014; 9(1):e84727. doi:10.1371/journal.pone.0084727.CrossRefGoogle ScholarPubMed
DeVito, NJ, Goldacre, B. Evaluation of compliance with legal requirements under the FDA amendments act of 2007 for timely registration of clinical trials, data verification, delayed reporting, and trial document submission. JAMA Intern Med. 2021; 181(8):11281130. doi:10.1001/jamainternmed.2021.2036.CrossRefGoogle ScholarPubMed
Zarin, DA, Tse, T, Williams, RJ, Rajakannan, T. Update on trial registration 11 years after the ICMJE policy was established. N Engl J Med. 2017; 376(4):383391. doi:10.1056/NEJMsr1601330.CrossRefGoogle ScholarPubMed
Kapp, P, Esmail, L, Ghosn, L, Ravaud, P, Boutron, I. Transparency and reporting characteristics of COVID-19 randomized controlled trials. BMC Med. 2022; 20(1):363. doi:10.1186/s12916-022-02567-y.CrossRefGoogle ScholarPubMed
DeVito, NJ, Bacon, S, Goldacre, B. Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: A cohort study. Lancet. 2020; 395(10221):361369. doi:10.1016/S0140-6736(19)33220-9.CrossRefGoogle ScholarPubMed
Williams, RJ, Tse, T, DiPiazza, K, Zarin, DA. Terminated trials in the ClinicalTrials.gov results database: Evaluation of availability of primary outcome data and reasons for termination. PLoS One. 2015; 10(5):e0127242. doi:10.1371/journal.pone.0127242.Google ScholarPubMed
Maruani, A, Boutron, I, Baron, G, Ravaud, P. Impact of sending email reminders of the legal requirement for posting results on ClinicalTrials.gov: Cohort embedded pragmatic randomized controlled trial. BMJ. 2014; 349:g5579. doi:10.1136/bmj.g5579.CrossRefGoogle ScholarPubMed
Schmaling, KB, Landon, HS, Nguyen, TB, Kaplan, RM. Transparency of results reporting for depression treatment studies in ClinicalTrials.gov: A cross-sectional study. BMJ Evid Based Med. 2022; 27(1):2732. doi:10.1136/bmjebm-2020-111641.CrossRefGoogle ScholarPubMed
Schmaling, KB, Kaplan, RM. Depression trial results: A cross-sectional study of ClinicalTrials.gov. J Psychiatr Res. 2023; 161:461466. doi:10.1016/j.jpsychires.2023.04.004.CrossRefGoogle ScholarPubMed
Food and Drug Administration. ClinicalTrials.gov – notices of noncompliance and civil money penalty actions. Accessed July 23, 2023. www.fda.gov/science-research/fdas-role-clinicaltrialsgov-information/clinicaltrialsgov-notices-noncompliance-and-civil-money-penalty-actions.Google Scholar
Johnson, AL, Fladie, I, Anderson, JM, Lewis, DM, Mons, BR, Vassar, M. Rates of discontinuation and nonpublication of head and neck cancer randomized clinical trials. JAMA Otolaryngol Head Neck Surg. 2020; 146(2):176182. doi:10.1001/jamaoto.2019.3967.CrossRefGoogle ScholarPubMed
Adam, GP, Springs, S, Trikalinos, T, et al. Does information from ClinicalTrials.gov increase transparency and reduce bias? Results from a five-report case series. Syst Rev. 2018; 7(1):59. doi:10.1186/s13643-018-0726-5.CrossRefGoogle ScholarPubMed
Dufka, FL, Dworkin, RH, Rowbotham, MC. How transparent are migraine clinical trials? Repository of Registered Migraine Trials (RReMiT). Neurology. 2014; 83(15):13721381. doi:10.1212/WNL.0000000000000866.CrossRefGoogle ScholarPubMed
Jones, CW, Handler, L, Crowell, KE, Keil, LG, Weaver, MA, Platts-Mills, TF. Non-publication of large randomized clinical trials: Cross sectional analysis. BMJ. 2013; 347:f6104. doi:10.1136/bmj.f6104.CrossRefGoogle ScholarPubMed
Ross, JS, Mulvey, GK, Hines, EM, Nissen, SE, Krumholz, HM. Trial publication after registration in ClinicalTrials.gov: A cross-sectional analysis. PLoS Med. 2009; 6(9):e1000144. doi:10.1371/journal.pmed.1000144.CrossRefGoogle ScholarPubMed
Committee on Publication Ethics. Directory of Open Access Journals, Open Access Scholarly Publishing Association. Principles of Transparency and Best Practice in Scholarly Publishing. Version 4. Accessed July 23, 2023. doi:10.24318/cope.2019.1.12.CrossRefGoogle Scholar
Fanelli, D. Negative results are disappearing from most disciplines and countries. Scientometrics. 2012; 90(3):891904. doi:10.1007/s11192-011-0494-7.CrossRefGoogle Scholar
Dwan, K, Gamble, C, Williamson, PR, Kirkham, JJ, Group, RB. Systematic review of the empirical evidence of study publication bias and outcome reporting bias – an updated review. PLoS One. 2013; 8(7):e66844. doi:10.1371/journal.pone.0066844.CrossRefGoogle ScholarPubMed
Hartung, DM, Zarin, DA, Guise, JM, McDonagh, M, Paynter, R, Helfand, M. Reporting discrepancies between the ClinicalTrials.gov results database and peer-reviewed publications. Ann Intern Med. 2014; 160(7):477483. doi:10.7326/M13-0480.CrossRefGoogle ScholarPubMed
Riveros, C, Dechartres, A, Perrodeau, E, Haneef, R, Boutron, I, Ravaud, P. Timing and completeness of trial results posted at ClinicalTrials.gov and published in journals. PLoS Med. 2013; 10(12):e1001566; discussion e1001566. doi:10.1371/journal.pmed.1001566.CrossRefGoogle ScholarPubMed
Tang, E, Ravaud, P, Riveros, C, Perrodeau, E, Dechartres, A. Comparison of serious adverse events posted at ClinicalTrials.gov and published in corresponding journal articles. BMC Med. 2015; 13:189. doi:10.1186/s12916-015-0430-4.CrossRefGoogle ScholarPubMed
Malicki, M, Jeroncic, A, Ter Riet, G, et al. Preprint servers’ policies, submission requirements, and transparency in reporting and research integrity recommendations. JAMA. 2020; 324(18):19011903. doi:10.1001/jama.2020.17195.CrossRefGoogle ScholarPubMed
Abdill, RJ, Blekhman, R. Tracking the popularity and outcomes of all bioRxiv preprints. Elife. 2019; 8. doi:10.7554/eLife.45133.CrossRefGoogle ScholarPubMed
Teunis, T, Nota, SP, Schwab, JH. Do corresponding authors take responsibility for their work? A covert survey. Clin Orthop Relat Res. 2015; 473(2):729735. doi:10.1007/s11999-014-3868-3.CrossRefGoogle Scholar
Wang, SV, Sreedhara, SK, Schneeweiss, S, Initiative, R. Reproducibility of real-world evidence studies using clinical practice data to inform regulatory and coverage decisions. Nat Commun. 2022; 13(1):5126. doi:10.1038/s41467-022-32310-3.CrossRefGoogle ScholarPubMed
Savage, CJ, Vickers, AJ. Empirical study of data sharing by authors publishing in PLoS journals. PLoS One. 2009; 4(9):e7078. doi:10.1371/journal.pone.0007078.CrossRefGoogle ScholarPubMed
Bello, S, Moustgaard, H, Hróbjartsson, A. Unreported formal assessment of unblinding occurred in 4 of 10 randomized clinical trials, unreported loss of blinding in 1 of 10 trials. J Clin Epidemiol. 2017; 81:4250. doi:10.1016/j.jclinepi.2016.08.002.CrossRefGoogle ScholarPubMed
Avorn, J, Kesselheim, AS. The 21st Century Cures Act – Will it take us back in time? N Engl J Med. 2015; 372(26):24732475.CrossRefGoogle ScholarPubMed
Kaplan, RM, Koong, AJ, Irvin, V. Food and Drug Administration novel drug decisions in 2017: Transparency and disclosure prior to and 5 years following approval. Health Affairs Scholar. 2023; 1(2):qxad028.CrossRefGoogle ScholarPubMed
Kaplan, RM, Koong, AJ, Irvin, V. Review of evidence supporting 2022 US food and drug administration drug approvals. JAMA Network Open. 2023; 6(8):e2327650.CrossRefGoogle ScholarPubMed
Kaplan, RM, Koong, AJ, Irvin, V. Public comment on proposed FDA policy, “Demonstrating Substantial Evidence of Effectiveness with One Adequate and Well-Controlled Clinical Investigation and Confirmatory Evidence: Guidance to Industry.” 2019.Google Scholar
Nutu, D, Gentili, C, Naudet, F, Cristea, IA. Open science practices in clinical psychology journals: An audit study. J Abnorm Psychol. 2019; 128(6):510516. doi:10.1037/abn0000414.CrossRefGoogle ScholarPubMed
Ioannidis, JP. Why most published research findings are false. PLoS Med. 2005; 2(8):e124.CrossRefGoogle ScholarPubMed
Mansmann, U, Locher, C, Prasser, F, et al. Implementing clinical trial data sharing requires training a new generation of biomedical researchers. Nat Med. 2023. doi:10.1038/s41591-022-02080-y.CrossRefGoogle ScholarPubMed
Wilkinson, MD, Dumontier, M, Aalbersberg, IJ, et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci Data. 2016; 3:160018. doi:10.1038/sdata.2016.18.CrossRefGoogle ScholarPubMed
International Committee of Medical Journal Editors. Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals. www.icmje.org/icmje-recommendations.pdf.Google Scholar
Naudet, F, Siebert, M, Pellen, C, et al. Medical journal requirements for clinical trial data sharing: Ripe for improvement. PLoS Med. 2021; 18(10):e1003844. doi:10.1371/journal.pmed.1003844.CrossRefGoogle ScholarPubMed
EQUATOR: Enhancing the QUAlity and Transparency of Health Research. Accessed July 23, 2023. www.equator-network.org/reporting-guidelines/.Google Scholar
Butcher, NJ, Monsour, A, Mew, EJ, et al. Guidelines for reporting outcomes in trial reports: The CONSORT-Outcomes 2022 extension. JAMA. 2022; 328(22):22522264.CrossRefGoogle ScholarPubMed
44. Tobin, K, Davey-Rothwell, MA, Nonyane, BAS, et al. RCT of an integrated CBT-HIV intervention on depressive symptoms and HIV risk. PLoS One 2017; 12:e0187180. doi:10.1371/journal.pome.0187180.CrossRefGoogle ScholarPubMed
Blanco, D, Biggane, AM, Cobo, E, network M. Are CONSORT checklists submitted by authors adequately reflecting what information is actually reported in published papers? Trials. 2018; 19(1):80. doi:10.1186/s13063-018-2475-0.CrossRefGoogle ScholarPubMed
McKeown, A, Gewandter, JS, McDermott, MP, et al. Reporting of sample size calculations in analgesic clinical trials: ACTTION systematic review. J Pain. 2015; 16(3):199206.e1–7. doi:10.1016/j.jpain.2014.11.010.CrossRefGoogle ScholarPubMed
Nunan, D, Watts, I, Kaji, FA, Hansjee, S, Heneghan, C. Adherence in leading medical journals to the CONSORT 2010 statement for reporting of binary outcomes in randomised controlled trials: Cross-sectional analysis. BMJ Evid Based Med. 2022; 27(2):120124. doi:10.1136/bmjebm-2020-111489.CrossRefGoogle Scholar
Chan, AW, Tetzlaff, JM, Gøtzsche, PC, et al. SPIRIT 2013 explanation and elaboration: Guidance for protocols of clinical trials. BMJ. 2013; 346:e7586. doi:10.1136/bmj.e7586.CrossRefGoogle ScholarPubMed
Husereau, D, Drummond, M, Augustovski, F, et al. Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) statement: Updated reporting guidance for health economic evaluations. BMJ. 2022; 376:e067975. doi:10.1136/bmj-2021-067975.Google ScholarPubMed
Bossuyt, PM, Reitsma, JB, Bruns, DE, et al. STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies. BMJ. 2015; 351:h5527. doi:10.1136/bmj.h5527.Google ScholarPubMed
von Elm, E, Altman, DG, Egger, M, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. BMJ. 2007; 335(7624):806808. doi:10.1136/bmj.39335.541782.AD.CrossRefGoogle ScholarPubMed
Brouwers, MC, Kerkvliet, K, Spithoff, K, Consortium, ANS. The AGREE reporting checklist: A tool to improve reporting of clinical practice guidelines. BMJ. 2016; 352:i1152. doi:10.1136/bmj.i1152.Google ScholarPubMed
Chen, Y, Yang, K, Marušic, A, et al. A reporting tool for practice guidelines in health care: The RIGHT Statement. Ann Intern Med. 2017; 166(2):128132. doi:10.7326/M16-1565.CrossRefGoogle ScholarPubMed
Tong, A, Sainsbury, P, Craig, J. Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007; 19(6):349357. doi:10.1093/intqhc/mzm042.CrossRefGoogle ScholarPubMed
Ogrinc, G, Davies, L, Goodman, D, Batalden, P, Davidoff, F, Stevens, D. Squire 2.0 (Standards for Quality Improvement Reporting Excellence): Revised publication guidelines from a detailed consensus process. Am J Crit Care. 2015; 24(6):466473. doi:10.4037/ajcc2015455.CrossRefGoogle ScholarPubMed
Benchimol, EI, Smeeth, L, Guttmann, A, et al. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS Med. 2015; 12(10):e1001885. doi:10.1371/journal.pmed.1001885.CrossRefGoogle ScholarPubMed
Howick, J, Webster, RK, Rees, JL, et al. TIDieR-Placebo: A guide and checklist for reporting placebo and sham controls. PLoS Med. 2020; 17(9):e1003294. doi:10.1371/journal.pmed.1003294.CrossRefGoogle ScholarPubMed
Campbell, M, Katikireddi, SV, Hoffmann, T, Armstrong, R, Waters, E, Craig, P. TIDieR-PHP: A reporting guideline for population health and policy interventions. BMJ. 2018; 361:k1079. doi:10.1136/bmj.k1079.Google ScholarPubMed
Butcher, NJ, Monsour, A, Mew, EJ, et al. Guidelines for reporting outcomes in trial reports: The CONSORT-Outcomes 2022 extension. JAMA. 2022; 328(22):22522264. doi:10.1001/jama.2022.21022.CrossRefGoogle ScholarPubMed
Butcher, NJ, Monsour, A, Mew, EJ, et al. Guidelines for reporting outcomes in trial protocols: The SPIRIT-Outcomes 2022 extension. JAMA. 2022; 328(23):23452356. doi:10.1001/jama.2022.21243.CrossRefGoogle ScholarPubMed
Moynihan, R, Albarqouni, L, Nangla, C, Dunn, AG, Lexchin, J, Bero, L. Financial ties between leaders of influential US professional medical associations and industry: Cross sectional study. BMJ. 2020; 369:m1505. doi:10.1136/bmj.m1505.Google ScholarPubMed
Friedman, LS, Richter, ED. Relationship between conflicts of interest and research results. J Gen Intern Med. 2004; 19(1):5156. doi:10.1111/j.1525-1497.2004.30617.x.CrossRefGoogle ScholarPubMed
Dunn, AG, Coiera, E, Mandl, KD, Bourgeois, FT. Conflict of interest disclosure in biomedical research: A review of current practices, biases, and the role of public registries in improving transparency. Res Integr Peer Rev. 2016; 1. doi:10.1186/s41073-016-0006-7.CrossRefGoogle ScholarPubMed
Wang, AT, McCoy, CP, Murad, MH, Montori, VM. Association between industry affiliation and position on cardiovascular risk with rosiglitazone: Cross sectional systematic review. BMJ. 2010; 340:c1344. doi:10.1136/bmj.c1344.CrossRefGoogle ScholarPubMed
Mandrioli, D, Kearns, CE, Bero, LA. Relationship between research outcomes and risk of bias, study sponsorship, and author financial conflicts of interest in reviews of the effects of artificially sweetened beverages on weight outcomes: A systematic review of reviews. PLoS One. 2016; 11(9):e0162198. doi:10.1371/journal.pone.0162198.CrossRefGoogle ScholarPubMed
Bes-Rastrollo, M, Schulze, MB, Ruiz-Canela, M, Martinez-Gonzalez, MA. Financial conflicts of interest and reporting bias regarding the association between sugar-sweetened beverages and weight gain: A systematic review of systematic reviews. PLoS Med. 2013; 10(12):e1001578; discussion e1001578. doi:10.1371/journal.pmed.1001578.CrossRefGoogle ScholarPubMed
Norris, SL, Holmer, HK, Ogden, LA, Burda, BU. Conflict of interest in clinical practice guideline development: A systematic review. PLoS One. 2011; 6(10):e25153. doi:10.1371/journal.pone.0025153.CrossRefGoogle ScholarPubMed
Shnier, A, Lexchin, J, Romero, M, Brown, K. Reporting of financial conflicts of interest in clinical practice guidelines: A case study analysis of guidelines from the Canadian Medical Association Infobase. BMC Health Serv Res. 2016; 16(a):383. doi:10.1186/s12913-016-1646-5.CrossRefGoogle ScholarPubMed
American Psychiatric Association. Practice Guideline for the Treatment of Patients with Major Depressive Disorder, 3rd ed. 2010.Google Scholar
Cosgrove, L, Bursztajn, HJ, Erlich, DR, Wheeler, EE, Shaughnessy, AF. Conflicts of interest and the quality of recommendations in clinical guidelines. J Eval Clin Pract. 2013; 19(4):674681. doi:10.1111/jep.12016.CrossRefGoogle ScholarPubMed
DuBroff, R. Confirmation bias, conflicts of interest and cholesterol guidance: Can we trust expert opinions? QJM. 2018; 111(10):687689. doi:10.1093/qjmed/hcx213.CrossRefGoogle ScholarPubMed
Guan, ML, Pillinger, MH, Abeles, AM. Accuracy of financial disclosures in US‐based Rheumatology Journals. Arthritis Care & Research. 2024; 76(2):304309.CrossRefGoogle ScholarPubMed
Cristea, IA, Ioannidis, JPA. Improving disclosure of financial conflicts of interest for research on psychosocial interventions. JAMA Psychiatry. 2018; 75(6):541542. doi:10.1001/jamapsychiatry.2018.0382.CrossRefGoogle ScholarPubMed
Linehan, M. Cognitive-behavioral Treatment of Borderline Personality Disorder. Diagnosis and Treatment of Mental Disorders. Guilford Press; 1993:xvii, p. 558.Google Scholar
Linehan, MM, Comtois, KA, Murray, AM, et al. Two-year randomized controlled trial and follow-up of dialectical behavior therapy vs therapy by experts for suicidal behaviors and borderline personality disorder. Arch Gen Psychiatry. 2006; 63(7):757766. doi:10.1001/archpsyc.63.7.757.CrossRefGoogle ScholarPubMed
Carey, B. I Answer the Phone at a Mental Health Hotline. Here’s What I’ve Learned. The New York Times. www.nytimes.com/2023/02/12/opinion/health/mental-health-outreach.html.Google Scholar
Navarro-Haro, MV, Harned, MS, Korslund, KE, et al. Predictors of adoption and reach following dialectical behavior therapy intensive Training™. Community Ment Health J. 2019; 55(1):100111. doi:10.1007/s10597-018-0254-8.CrossRefGoogle ScholarPubMed
Cristea, IA, Gentili, C, Pietrini, P, Cuijpers, P. Sponsorship bias in the comparative efficacy of psychotherapy and pharmacotherapy for adult depression: Meta-analysis. Br J Psychiatry. 2017; 210(1):1623. doi:10.1192/bjp.bp.115.179275.CrossRefGoogle ScholarPubMed
Roseman, M, Milette, K, Bero, LA, et al. Reporting of conflicts of interest in meta-analyses of trials of pharmacological treatments. JAMA. 2011; 305(10):10081017. doi:10.1001/jama.2011.257.CrossRefGoogle ScholarPubMed
Dirnagl, U, Lauritzen, M. Fighting publication bias: Introducing the Negative Results section. J Cereb Blood Flow Metab. 2010; 30(7):12631264. doi:10.1038/jcbfm.2010.51.CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×