Accessibility of trial reports for drugs stalling in development: a systematic assessment of registered trials

by

Non-publication of clinical trial results has been recognized as a serious scientific and ethical problem. Underreporting frustrates evaluation of a drug’s utility and safety, and fails to redeem the sacrifice of trial participants.

Thus far, policy measures to counteract non-publication have focused on trials of interventions used in practice. However, 9/10 interventions entering clinical testing never achieve marketing licensure. What happens to the results of those trials?

Figure depicting the rates of publication of trials of licensed drugs compared with trials of stalled drugs--overall and by major subgroup.

Figure depicting the rates of publication of trials of licensed drugs compared with trials of stalled drugs–overall and by major subgroup.

In our most recent publication, my colleagues and I systematically quantified the proportion of trials of unlicensed interventions that are not published.

We used clinicaltrials.gov trial registration records to create a sample of clinical trials of drugs that achieved licensure between 2005 and 2009 (“licensed drugs” or “translated drugs”) and drugs that stalled in clinical development (“stalled drugs”) in the same time period. Our sample included registered phase II, III or IV trials that closed between January 1st, 2006 and December 31st, 2008 and tested a drug in the treatment of cancer, cardiovascular disease or neurological disorders. We felt this sample provided a relevant and contemporary look into a wide swathe of drug development activity. We then searched Google Scholar, PubMed and Embase, and contacted investigators to determine the publication status of each trial in our sample at least 5 years after reported primary endpoint collection.

Whereas 75% (72/96) of registered trials of licensed drugs were published, only 37% (30/81) trials of stalled drugs were published. The adjusted hazard ratio for publication was 2.7 (95% confidence interval 1.7 to 4.3) in favour of licensed drug trials–that is, clinical trials of licensed drugs were almost three times as likely to publish findings as trials of stalled drugs. Higher publication rates for licensed drug trials were observed regardless of disease type, sponsorship (industry involvement versus not), trial phase, and location across the globe.

Figure depicting the proportion of trials of licensed and unlicensed interventions that are published as a function of time from reported primary endpoint collection. The publication of stalled drug trials plateaus over time around 37%, whereas the publication of translated drug trials attains 75% in the same time period.

Figure depicting the proportion of trials of licensed and unlicensed interventions that are published as a function of time from reported primary endpoint collection. The publication of stalled drug trials plateaus over time around 37%, whereas the publication of translated drug trials attains 75% in the same time period.

Moreover, a total of 20,135 patients participated in trials of stalled drugs that were never published. In addition to the alarming implications for these patients, trials in unsuccessful translation trajectories contain a wealth of scientific information for research planning, such as validation of pathophysiological theories driving drug development, as well as data about drug safety and pharmacology. All of this information vanishes when trials of unsuccessful interventions are not published.

Our key finding is that much of the information collected in unsuccessful drug trials is inaccessible to the broader research and practice communities. Our results provide an evidence base and rationale for policy reforms aimed at promoting transparency, ethics, and accountability in clinical research. One such potential reform is the Notice of Proposed Rulemaking entitled “Clinical Trials Registration and Results Submission” issued by the US Department of Health and Human Services in November 2014. The proposal, which moves to implement the FDAAA summary results reporting requirements for trials of licensed drugs and to extend them to trials of unlicensed drugs, was closed to public comments on March 23rd, 2015. The rule is now undergoing revision.

BibTeX

@Manual{stream2015-781,
    title = {Accessibility of trial reports for drugs stalling in development: a systematic assessment of registered trials},
    journal = {STREAM research},
    author = {Amanda Hakala},
    address = {Montreal, Canada},
    date = 2015,
    month = may,
    day = 26,
    url = {http://www.translationalethics.com/2015/05/26/accessibility-of-trial-reports-for-drugs-stalling-in-development-a-systematic-assessment-of-registered-trials/}
}

MLA

Amanda Hakala. "Accessibility of trial reports for drugs stalling in development: a systematic assessment of registered trials" Web blog post. STREAM research. 26 May 2015. Web. 20 Nov 2017. <http://www.translationalethics.com/2015/05/26/accessibility-of-trial-reports-for-drugs-stalling-in-development-a-systematic-assessment-of-registered-trials/>

APA

Amanda Hakala. (2015, May 26). Accessibility of trial reports for drugs stalling in development: a systematic assessment of registered trials [Web log post]. Retrieved from http://www.translationalethics.com/2015/05/26/accessibility-of-trial-reports-for-drugs-stalling-in-development-a-systematic-assessment-of-registered-trials/


Filing Cabinet Syndrome: The Effect of Nonpublication of Preclinical Research

by

Much has already been said about Filing Cabinet syndrome in medical research: the tendency of researchers to publish exciting results from clinical trials, and to stash null or negative findings safely away from public view in a filing cabinet. Nonpublication distorts the medical literature, because it prevents medical practitioners from accessing negative information about drugs. Recall that, back in 2004, attorney-general Eliot Spitzer sued Glaxo Smithkline for suppressing trial results that showed elevated risk of suicide for adolescents taking the antidepressant drug Paxil; this and several similar episodes led FDA, major medical journals, World Health Organization, World Medical Association, and others to require researchers to register clinical trials before they enroll any patients.


Yet important gaps remain. In the March 2010 issue of PLoS Biology, Emily S. Sena and coauthors provide the most detailed analysis yet of one of these gaps: nonpublication of preclinical (animal) studies. They aggregated results of 16 systematic reviews of preclinical studies involving acute ischaemic stroke, and used statistical methods to estimate the degree of publication bias, and the likely effect of publication bias on measured disease responses. Among other things, they found that 16% of animal experiments were not published, leading to a 31% overstatement of efficacy. The authors note: “we estimate that for the interventions described here, experiments involving some 3,600 animals have remained unpublished. We consider this practice to be unethical.”

The authors urge that central registries of preclinical studies be established and maintained– a call that is not likely to go heeded anytime soon by companies that have much at stake in the secrecy in preclinical research. But their proposal ought to be taken seriously by anyone committed not only to respecting animals used in medical research, but also protecting the welfare of human beings who might enroll in possibly unwarranted clinical research. (photo credit: amy allcock 2009)

BibTeX

@Manual{stream2010-66,
    title = {Filing Cabinet Syndrome: The Effect of Nonpublication of Preclinical Research},
    journal = {STREAM research},
    author = {Jonathan Kimmelman},
    address = {Montreal, Canada},
    date = 2010,
    month = may,
    day = 11,
    url = {http://www.translationalethics.com/2010/05/11/filing-cabinet-syndrome-the-effect-of-nonpublication-of-preclinical-research/}
}

MLA

Jonathan Kimmelman. "Filing Cabinet Syndrome: The Effect of Nonpublication of Preclinical Research" Web blog post. STREAM research. 11 May 2010. Web. 20 Nov 2017. <http://www.translationalethics.com/2010/05/11/filing-cabinet-syndrome-the-effect-of-nonpublication-of-preclinical-research/>

APA

Jonathan Kimmelman. (2010, May 11). Filing Cabinet Syndrome: The Effect of Nonpublication of Preclinical Research [Web log post]. Retrieved from http://www.translationalethics.com/2010/05/11/filing-cabinet-syndrome-the-effect-of-nonpublication-of-preclinical-research/


Search STREAM

Old blog posts


All content © STREAM research

admin@translationalethics.com
Twitter: @stream_research
3647 rue Peel
Montreal QC H3A 1X1