By Lisa Larrimore Ouellette, Nicholson Price, Rachel Sachs, and Jacob Sherkow
One of the dizzying stream of innovation and health law stories to emerge last week is Oracle’s partnership with the White House to study unproven pharmaceuticals for treating COVID-19. We decided to unpack this story for ourselves and then to collectively share our thoughts in a short explainer.
What are the drugs being studied?
The initial stories about Oracle’s platform mention its use for two older drugs approved to treat malaria—chloroquine and hydroxychloroquine—that are now being tested to treat COVID-19. Both drugs are quite old: chloroquine was first approved by the FDA in 1949 and sold, until recently, under the brand name Aralen. Hydroxychloroquine, which is also used to treat lupus and rheumatoid arthritis, is sold under the brand Plaquenil and was first approved in 1955.
The impetus behind studying these two drugs stems from in vitro studies following the 2005 SARS-CoV-1 outbreak. Those studies suggested the drugs could inhibit some types of coronaviruses from both entering cells and replicating after infection—potentially serving as a preventative and a treatment. But the studies were small, in cell culture rather than living animals, and not conducted against the virus that causes COVID-19, SARS-CoV-2. Some early work with the drugs against SARS-CoV-2 may be promising but it, too, has been done in a test tube rather than an animal model.
Importantly, though, chloroquine and hydroxychloroquine are not risk free. To the contrary, both have some significant side effects that may be especially concerning for COVID-19 patients. These include an increased risk of blindness and heart failure, the latter of which seems to be exacerbated by and is the primary cause of death in some COVID-19 patients. NPR recently reported that one COVID-19 patient on experimental chloroquine has died, seemingly as a result. It’s possible that chloroquine and hydroxychloroquine could make COVID-19 worse, not better.
More drugs besides chloroquine and hydroxychloroquine are being tested for COVID-19 treatment, and it is unclear which of these the Oracle platform might track. Drugs that have already received FDA approval for other indications include antiviral HIV drugs, interferons that activate the body’s immune response, and anti-arthritis drugs to treat lung inflammation. Researchers are also testing new drugs that have not yet received FDA approval; for example, the antiviral remdesivir, which is being scrutinized in numerous clinical trials, made headlines last week after Gilead asked for and received (and then withdrew) FDA designation of the medicament as an “orphan drug.”
When can doctors prescribe unproven treatments?
The FDA approves drugs for a certain set of uses (known as indications), but once a drug is approved, the FDA doesn’t limit how doctors use those drugs to treat patients. Instead, doctors can use drugs for purposes outside what the FDA has approved—so-called “off-label” uses. Many drugs are used off-label, and for some drugs, the drug is used more frequently off-label than on-label. Some of the easiest off-label uses to understand are for different populations; clinical studies in children are relatively rare, for instance, so many drugs aren’t approved for use in children. But doctors want to treat children, and so often use drugs off-label in children for the same condition. Other times, off-label use is for a different condition; a drug that treats one cancer might be used off-label to treat another. While some off-label use is supported by substantial scientific evidence, a disturbingly large fraction is supported by no or little good evidence.
There are some potential limits on off-label use. Insurers might not pay for an unapproved use, for example. Off-label use might also incur a higher risk of tort liability, and state medical or pharmacy boards may disapprove of a particular off-label use, making doctors wary of prescribing the drug off-label. For COVID-19, some state pharmacy boards have begun limiting the off-label use of hydroxychloroquine to prevent shortages for patients who need the product for its approved uses for lupus and rheumatoid arthritis. (In fact, to address shortages like this, FDA has now approved compounding of hydroxychloroquine, an alternate pathway to standard drug manufacturing where the final formulation steps are done by pharmacies or others rather than drug manufacturers.)
In some cases, drugs still under investigation can be used to treat patients under programs known as “compassionate use” or “expanded access.” The FDA’s expanded access program has eligibility requirements that include the lack of other available treatments, a serious disease, and an inability to get the same drug from another clinical trial or program. Remdesivir has, in fact. been used to treat some patients under this pathway, even though it is not yet approved by the FDA for any use.
In 2018 the federal government also passed Right to Try legislation, which lets drug manufacturers provide drugs to patients if the drug has passed the earliest phase of clinical testing and is in active development, without first asking for FDA permission. This pathway has been roundly criticized, but may not make much difference for COVID-19 given that it has been used quite rarely so far.
What kind of data might Oracle’s platform collect?
According to last week’s reports, Oracle’s new website and mobile app—which it plans to donate to the government—will be used to collect information about COVID-19 treatments outside the context of clinical trials. It is unclear whether this platform will in fact be developed; on Friday, Politico reported that “[t]he White House is having second thoughts about working with Oracle on the project after a New York Times article this week raised questions about the partnership.” But if the project (or another one like it) goes forward, how could this kind of data be used to help address the pandemic?
Our understanding is that Oracle’s platform would help facilitate observational studies, or investigations of data that are not gathered in a controlled experiment. Researchers could examine, for example, whether COVID-19 patients treated, off-label, with hydroxychloroquine have better outcomes than patients who do not receive it. Of course, as we explain below, interpreting these results is difficult—perhaps patients who receive hydroxychloroquine happen to be healthier (or sicker) than those who don’t—which is why drugs are typically tested in controlled clinical trials. But an observational study can be more informative than no study at all.
Observational studies are one kind of “real-world evidence” that FDA uses to inform regulatory decisions. In the 21st Century Cures Act, passed in December 2016, Congress directed the FDA to “evaluate and issue guidance on the use of evidence from sources other than clinical trials to support approval of a drug for a new indication”—i.e., a drug like hydroxychloroquine that could already be legally used off-label. In December 2018, the FDA published a framework for making these decisions, which notes that “observational studies may provide credible evidence” but cautions that there are “examples when effects identified in observational studies could not be reproduced in randomized trials.”
On Thursday, New York state was reported to be moving to distribute tens of thousands of doses of hydroxychloroquine and chloroquine (combined with the antibiotic azithromycin) to COVID-19 patients. Outcomes will be collected electronically, though it is unclear whether Oracle is involved in this collection. This work could inform other doctors who are debating whether to use these off-label treatments, and it could potentially support FDA approval for the COVID-19 indication under the 21st Century Cures Act framework.
How will reimbursement for this trial work?
The Washington Post reports that the administration is “exploring whether it will offer bonus payments to doctors who use the technology.” It is hard to determine exactly what the administration means by this, but in its most innocuous form, it might simply amount to committing to provide physicians reimbursement for prescribing these products for COVID-19. There are at least two pathways the federal government might use to do this, although both have limitations.
First, the New Technology Add-On Payment (NTAP) program administered by the Centers for Medicare & Medicaid Services (CMS) permits the agency to provide additional reimbursement for the purpose of encouraging the adoption and dissemination of new technologies in medical practice. However, the NTAP system is limited not only to the Medicare program but also even further to inpatient care, meaning that these payments would not be available to doctors prescribing these products to patients who are not eligible for Medicare or who are being treated on an outpatient basis.
Second, CMS’s Coverage with Evidence Development (CED) program permits the agency to provide reimbursement for a particular technology or service even if a clinical benefit thereof has not yet been established. In some ways, CED is much broader than NTAP, as it is not limited to the inpatient context. However, it is limited not only to Medicare, but also to situations in which clinical data are being collected to determine whether such a clinical benefit does exist—which may be the case under the Oracle program.
In either case, it is not clear how the administration would seek to offer bonus payments to physicians treating patients who are not Medicare beneficiaries. Private insurers could choose to cover these products (and indeed, some already have), but would not clearly be required to. Further, to the extent that the administration intends to do something other than provide reimbursement for these products, it is difficult to determine where true bonus payments might come from, as a statutory matter.
Shouldn’t these drugs be tested in randomized controlled trials?
Yes! Randomized controlled trials (RCTs) are the best way to find out whether a drug actually works in patients. It’s notoriously hard to know if drugs work; patients are different in many different ways, including the presence of other underlying medical conditions, and understanding whether a drug is, in fact, effective turns on who chooses to take a drug, who has access to it, what other medical treatments they might receive, and how well they adhere to the treatment regimen (among other things). RCTs are the gold standard for ironing out those sources of variation. They’re especially important when drugs have potentially significant side effects, as hydroxychloroquine and chloroquine do.
To be sure, RCTs of hydroxychloroquine and chloroquine are currently being conducted, though the results have been ambiguous so far. One study in France showed some promising results but has been criticized for its design. Another in China didn’t show statistically significant results. Both studies published so far have also been small (42 and 30 patients, respectively). Much larger studies coordinated by the WHO are underway for multiple potential treatments.
Is Oracle’s online platform a valuable complement to these trials or a waste of time?
As explained above, observational studies can be valuable complements to RCTs. With COVID-19 fatalities growing exponentially, doctors have to make treatment decisions before controlled studies are completed—and many may rationally decide that a treatment with weak evidentiary support is the best available option. Aggregating data from these individual decisions may provide some real-time evidence of which experimental drugs currently appear most effective.
But observational studies are not a substitute for rigorous RCTs, and we think there is a real risk that policymakers and the public will misinterpret their significance. Hype about hydroxychloroquine already far outpaces evidence of its effectiveness. For example, President Trump’s personal lawyer Rudy Giuliani tweeted that hydroxychloroquine “has been shown to have a 100% effective rate treating COVID-19,” and a conservative group took out Facebook ads and sent text messages asking supporters to join a petition to “CUT RED TAPE” around use of the drug. On Sunday, the FDA issued an “emergency use authorization” for hydroxychloroquine and chloroquine, permitting physicians to make them available for COVID-19 when a clinical trial is not an option for patients—a decision which was publicly criticized by a former FDA Chief Scientist, who decried the “total lack of scientific evidence” in support of the drugs’ efficacy.
In addition to creating a risk of policymaking based on misinformation, observational studies may decrease the urgency for RCTs. In a cautionary plea last week for enrolling far more COVID-19 patients in RCTs with adaptive designs, Andre Kalil worried that off-label and compassionate use of drugs “could discourage patients and clinicians from participating in RCTs, hampering any knowledge that could be gained about the effects of the drug being tested.” We think that this is a serious concern, and one that journalists covering stories about the Oracle platform and other efforts to administer observational studies should be asking about. In theory, tech companies like Oracle might even be able to help with administering and collecting data for RCTs. There is a place for big tech in this picture, and it may be a crucial one. But we shouldn’t let the excitement of collecting lots of observational data distract us from the reality that we still need a core of high-quality RCT data to know what works and what doesn’t.
