Article Text

Download PDFPDF

Challenges and opportunities in accessing trial data: an example from statin primary prevention trials
Free
  1. Genevieve Umeh,
  2. Mark D Huffman
  1. Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
  1. Correspondence to Dr Mark D Huffman, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, 680 N. Lake Shore Drive, Suite 1400, Chicago, IL 60611, USA; m-huffman{at}northwestern.edu

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

In 2013, the Cochrane Heart Group published an update to the systematic review of statins for primary prevention of cardiovascular disease (CVD). The objectives were to assess the effects, both harms and benefits, of statins in people with no history of CVD. Our results showed that statins reduced all-cause mortality (OR=0.86, 95% CI 0.79 to 0.94) and fatal and non-fatal cardiovascular events (RR=0.75, 95% CI 0.70 to 0.81) with no increased risk of adverse events (RR=1.00, 95% CI 0.97 to 1.03).1

Despite consistent findings of the benefits of statins for primary prevention of CVD, the validity of these results has been challenged by some authors.2 Observational studies have demonstrated associations between statin exposure and adverse outcomes,such as impaired cognition and dementia,3 but it is uncertain whether or not such relationships are causal given the non-randomised nature of these study designs. It is also uncertain whether these types of adverse events or other outcomes such as health-related quality of life, which was reported in only 2 of the 19 statin primary prevention trials as of 2013, were even collected in statin primary prevention clinical trials.

Since 2012, models have been developed to respond to calls for greater sharing of clinical trial data sharing from organisations such as the AllTrials campaign (alltrials.net) as well as the National Academy of Medicine4 and International Consortium of Medical Journal Editors.5 These principles for broader data sharing have garnered support from the Pharmaceutical Research and Manufacturers of America, the European Federation of Pharmaceutical Industries and Associations, the Biotechnology Industry Organization and even the United Nations.6 Data-sharing models include academic organisations serving as data hosts and intermediaries for requests, governmental institutions responding to information requests and pharmaceutical industry-sponsored sites where users can access trial data through secure platforms. New data-sharing models have been recently proposed by trialist groups.7 ,8

While the published experience in accessing open data is limited and not without reported challenges,9 ,10 we sought to access unpublished statin trial clinical study reports and case report forms through available data-sharing mechanisms to update the 2013 Cochrane systematic review. We sought to understand if there were data collected but not yet reported on adverse events and health-related quality of life. Our hypothesis was that no new adverse event data were collected but that health-related quality of life data were collected given their ease and frequency of collection among other trials, including HOPE-3,11 yet had not been yet fully reported. In this Viewpoint, we describe the challenges in accessing trial data.

We identified the pharmaceutical sponsors for statin primary prevention trials included in the 2013 review (n=6). Two of these sponsors (Novartis, Daiichi Sankyo) are cosponsors of the data-sharing website, http://www.clinicalstudydatarequest.com, which facilitates data requests for 13 companies. As of September 2016, data from statin primary prevention trials were not available through this site. Nevertheless, in April 2015, February 2016, and September 2016, we completed online inquiries for deidentified case report forms and clinical study reports from Novartis and Daiichi Sankyo, respectively. We submitted proposals to other sponsors (Bristol-Myers-Squibb (April 2015), Merck (June 2015), AstraZeneca (June 2015) and Pfizer (July 2015)) according to the guidelines on data sharing published on the companies' websites.

In August 2015, we also submitted inquiries to the Food and Drug Administration, European Medicines Agency, Medicines and Healthcare Products Regulatory of the UK and Health Products Regulatory Authority of Ireland for any copies of case report forms submitted as part of statin trials. Within the Cochrane Collaboration, we sought and received guidance from Drs Tom Jefferson and Peter Doshi who have published extensively on their efforts to obtain unpublished data.12

Of 10 requests, we received 8 responses, all of which were a decline of our request or a referral to publicly accessible documents; we are still awaiting responses from two companies. Of the companies that did respond, the response time varied from 1 to 11 months. Reasons for declining requests were related to company policies regarding sharing of case report forms (AstraZeneca), timing of trials that preceded the company's disclosure period that began in 2008 (Bristol-Myers-Squibb) or exclusion of statin-related trials in data-sharing agreements (Daiichi Sankyo, via clinicalstudydatarequest.com). Moreover, the retention period for the statin trials had expired, and the documents were unavailable. Quality-of-life data were also unavailable for another company (Pfizer).

The European Medicines Agency reported that the agency did not hold any clinical study reports related to any of the statin drugs because these drugs were not centrally approved medicinal products. Based on the European Medicines Agency's response, we proceeded to contact regulatory authorities in the UK and Ireland but learned that it was contrary to their policy to release information to third party individuals. The Food and Drug Administration directed us to publicly available information regarding approval documents for approved drugs. Approved statins (n=7) can be found through online searching (http://www.accessdata.fda.gov/scripts/cder/drugsatfda/) and contain original submissions, including summary safety data. However, data are pooled across diverse studies in these reports (ie, short-term and long-term trials, randomised and open-label trials, approved and unapproved doses, placebo and active comparator groups, (including other statins) coadministration with other lipid-lowering drugs, parallel group and **crossover trial designs), which made comparison of adverse event rates in intervention and placebo groups with published reports of long-term primary prevention trials infeasible (table 1). Some applications also included redactions of safety data. We found neither clinical study reports nor case report forms through searching these documents.

Table 1

Reported adverse events in intervention and comparator groups among participants in statin primary prevention randomised controlled trials, updated to include HOPE-3 trial data published in 201611

Through other Cochrane reviewers, we received one clinical study report, including its corresponding case report form, from a small (n=335 participants) trial evaluating the effects of atorvastatin in patients with familial hyperlipidaemia. No data on health-related quality of life were collected. These documents are available on the Drug Industry Documents website (http://www.industrydocuments.library.ucsf.edu).

To update the 2013 Cochrane review on statins for the primary prevention of CVD, we have sought new data on adverse events and health-related quality of life from unpublished clinical study reports and case report forms. However, we received limited responses and were largely unable to find new sources of information to support or refute our hypothesis or to address concerns from individuals and groups who have challenged the validity of our previous results. Despite broad support for greater trial sharing, our experience suggests that the operational infrastructure for data sharing outside of trialist collaborations remains under development.

Data sharing of statin primary prevention trials may be particularly difficult since most, but not all, primary prevention trials were performed prior to the widespread use of electronic case report forms. The lack of infrastructure, costs, or heavy workload for data sharing from older trials may be potential reasons why companies have focused on more recent (and subsequent) trials for data sharing. On the other hand, data sharing for commonly used drugs such as statins may be even more important than newer drugs with lower market penetration.

We note recent examples where data sharing appears to be functioning. For example, since its inception in 2013, clinicalstudydatarequest.com has received 234 research proposals as of July 2016, and of these, 149 (64%) proposals were approved, although an unknown proportion of which are conditional approvals. The reasons for refusal are also published (n=12, 5%) including those that did not meet requirement checks, usually because the request did not include anonymised individual participant-level data such as ours. Only 4 (2%) of the requests have led to publications, but an additional 18 (8%) publications are in process. Yale's Open Data Access project hosts data from 123 Johnson & Johnson trials and approved 100% (29 of 29) requests for data access in its first year.13 The largest potential change could be through the European Medicines Agency, which aims to implement its policy for clinical report data sharing for all marketing approval applications by the end of 2017.

We summarise data-sharing mechanisms, examples, strengths and limitations in table 2. The potential for investigators to access data is greater than it has ever been; yet, these opportunities are not being fully leveraged. On the other hand, challenges remain, particularly the long lag time from request to data access9 and in accessing older trial data, clinical study reports and case report forms, the latter which would be useful to evaluate the potential for reporting bias.

Table 2

Potential strengths and limitations of clinical trial data-sharing models

Data sharing is in its infancy, and our experience exposes some limitations of the current process. Individual participant data sharing represents an important component of potentially available data, but other data sources may also help provide a more complete picture of the trial performance. Researchers who have synthesised data from unpublished sources such as clinical study reports have called for updating of the 1995 guidelines from International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use to improve the format for accessing and analysing data from these and other sources.12 Substantial investment will be needed to develop capacity and infrastructure among researchers, sponsors, companies, and patient and professional groups for data sharing that meets the needs of these diverse stakeholders, all while minimising unnecessary duplicative efforts.14 While some trialists have expressed concerns about research opportunism associated with data sharing, we argue that greater transparency will lead to greater trust and ultimately greater confidence in the beneficial and harmful effect estimates of medical interventions, including statins for the primary prevention of CVD. The optimal system for data sharing to achieve that goal remains in evolution.

Acknowledgments

The authors acknowledge Drs Shah Ebrahim and Donald Lloyd-Jones for their editorial comments and input.

References

Footnotes

  • Contributors GU wrote the first draft of the manuscript, and MDH provided critical edits and revisions. Both authors approved the final manuscript.

  • Competing interests MDH receives grant support from the World Heart Federation to serve as its senior programme advisor for the Emerging Leaders programme, which is sponsored by Boehringer Ingelheim, Novartis, Bupa and AstraZeneca. MDH has received grant support from the Cochrane Collaboration, European Society of Cardiology and Center for Medicare and Medicaid Innovation for the production of other systematic reviews.

  • Provenance and peer review Not commissioned; internally peer reviewed.

  • Data sharing statement We are willing to share data from our paper.