Abstract
Substantial COVID-19 research investment has been allocated to randomized clinical trials (RCTs) on hydroxychloroquine/chloroquine, which currently face recruitment challenges or early discontinuation. We aim to estimate the effects of hydroxychloroquine and chloroquine on survival in COVID-19 from all currently available RCT evidence, published and unpublished. We present a rapid meta-analysis of ongoing, completed, or discontinued RCTs on hydroxychloroquine or chloroquine treatment for any COVID-19 patients (protocol: https://osf.io/QESV4/). We systematically identified unpublished RCTs (ClinicalTrials.gov, WHO International Clinical Trials Registry Platform, Cochrane COVID-registry up to June 11, 2020), and published RCTs (PubMed, medRxiv and bioRxiv up to October 16, 2020). All-cause mortality has been extracted (publications/preprints) or requested from investigators and combined in random-effects meta-analyses, calculating odds ratios (ORs) with 95% confidence intervals (CIs), separately for hydroxychloroquine and chloroquine. Prespecified subgroup analyses include patient setting, diagnostic confirmation, control type, and publication status. Sixty-three trials were potentially eligible. We included 14 unpublished trials (1308 patients) and 14 publications/preprints (9011 patients). Results for hydroxychloroquine are dominated by RECOVERY and WHO SOLIDARITY, two highly pragmatic trials, which employed relatively high doses and included 4716 and 1853 patients, respectively (67% of the total sample size). The combined OR on all-cause mortality for hydroxychloroquine is 1.11 (95% CI: 1.02, 1.20; I² = 0%; 26 trials; 10,012 patients) and for chloroquine 1.77 (95%CI: 0.15, 21.13, I² = 0%; 4 trials; 307 patients). We identified no subgroup effects. We found that treatment with hydroxychloroquine is associated with increased mortality in COVID-19 patients, and there is no benefit of chloroquine. Findings have unclear generalizability to outpatients, children, pregnant women, and people with comorbidities.
Similar content being viewed by others
Introduction
Coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has the potential of progression into respiratory failure and death1. More than 1,500,000 persons with COVID-19 globally have died by December 20202, and treatment options are limited3. The COVID-19 pandemic has caused a hitherto unprecedented search for possible therapies, with almost 700 clinical trials initiated in the first quarter of 2020—and one in five of these trials target hydroxychloroquine (HCQ) or chloroquine (CQ)4. This remarkable attention was primarily due to in vitro data5, immunomodulatory capacities6, and the oral formulation and well-documented safety profiles.
In March 2020, the US Food and Drug Administration (FDA) issued an Emergency Use Authorization of HCQ7 and the number of prescriptions and usage outside clinical studies skyrocketed8. In many countries, HCQ or CQ were listed in treatment guidelines for COVID-19 (including, e.g., China, Ireland, and the United States)9. In a New York City cohort of 1376 COVID-19 inpatients during March–April 2020, 59% received HCQ10. However, the FDA revoked the Emergency Use Authorization on June 15, 202011. At that point, two large randomized clinical trials (RCTs), RECOVERY and the WHO Solidarity trial, had stopped enrollment to their HCQ treatment arms12,13. An interim analysis of the RECOVERY trial showed no mortality benefit of HCQ13. Established as treatments of malaria and rheumatic disorders, HCQ and CQ may carry potentially severe adverse effects, especially related to cardiac arrhythmia6. Public uncertainty still remains, as illustrated by recent reports of planned use in pandemic epicenters in Central and South America14.
While many trials are ongoing, additional published evidence of potential benefits or harms may be several months away, if they even reach completion. Given the lack of favorable results in the large RECOVERY trial and the revoked Emergency Use Authorization, recruitment into HCQ and CQ trials has become increasingly difficult and many trials may run the risk of ending in futility. A rapid examination of data on all-cause mortality from as many trials as possible may offer the best evidence on potential survival benefits and to ensure that patients are not exposed to unnecessary risks if benefit is lacking. We used the infrastructure established with COVID-evidence15, a comprehensive database of COVID-19 trials funded by the Swiss National Science Foundation, to invite all investigators of HCQ or CQ trials to participate in an international collaborative meta-analysis. We aimed to identify and combine all RCTs investigating the effects of HCQ or CQ on all-cause mortality in patients with COVID-19 compared to any control arm similar to the experimental arm in all aspects except the administration of HCQ or CQ.
In this work, we find that treatment with HCQ is associated with increased mortality in COVID-19 patients, and there is no benefit of CQ. Findings have unclear generalizability to outpatients, children, pregnant women, and people with comorbidities.
Results
Our search identified 146 randomized trials investigating HCQ or CQ as treatment for COVID-19, of which 83 were deemed potentially eligible after scrutinizing the randomized comparisons. The investigators of these 83 trials were contacted and 57% (47 of 83) responded (Fig. 1). Of the responders, 19 trials were eligible and available (14 unpublished, one preprint, and four publications); 21 trials were ineligible according to information provided; five responding investigator teams were not ready to share their results yet; and two declined participation. For the 36 trials without response, six were confirmed eligible and available (four publications and two preprints); two were confirmed ineligible; and for the remaining 28, results were not available, nor could they be confirmed eligible.
Sources searched up to June 11, 2020 (PubMed, ClinicalTrials.gov, WHO ICTRP, Cochrane COVID Register) or April 9 (WHO Literature database, bioRxiv, medRxiv, SwissEthics). 1Trials for which we received no answer were presumed to be eligible unless withdrawn. 2One publication and two preprints were identified in a later search update. 3Published peer-reviewed articles or posted preprints. CQ chloroquine, HCQ hydroxychloroquine, ICTRP International Clinical Trials Registry Platform, WHO World Health Organization.
We included 28 trials (14 unpublished trials, nine publications, and five preprints; of these, one publication and two preprints were identified for the first time in our search update)13,16,17,18,19,20,21,22,23,24,25,26,27,28. Individual trial characteristics are presented in Table 1 (28 included trials) and Supplement Table S1 (34 potentially eligible but unavailable). Overall, trial characteristics were not different between included and unavailable trials (Table 2).
HCQ was evaluated in 26 trials (10,012 patients) and CQ was evaluated in four trials (307 patients). Two trials investigated both HCQ versus control and CQ versus control (63 patients). The median sample size was 95 (interquartile range (IQR) 28–282) for HCQ trials and 42 (IQR 29–95) for CQ trials. The two largest trials (RECOVERY and WHO SOLIDARITY) included 47% and 19% of all patients in the HCQ trials, respectively. Most trials investigated HCQ or CQ in hospitalized patients (22 trials; 79%), and only five trials (18%) had an outpatient setting. The average mortality was 10.3% (standard deviation 13.5%) in inpatient trials and 0.08% (standard deviation 0.18%) in outpatient trials. The comparator was in 11 trials placebo (39%) and in 17 (61%) no other treatment than standard of care. In most trials, patients and clinicians were aware of the treatment (15 trials; 54%), while in one trial (4%) the patients were blinded and in 11 trials (39%) patients and clinicians were blinded (Table 2). We identified no relevant risk of bias across all trials, with only one trial including seven patients having an overall high risk of bias (Table S2). We found no evidence of small-study effects (Figure S1).
Regarding HCQ, in the 26 included trials, 606 of 4316 (14.0%) patients treated with HCQ died and 960 of 5696 patients (16.9%) in the control groups died (within 19 trials with a 1:1 randomization ratio, 7.7% of patients in the HCQ arm died [181 of 2346] and 7.1% of patients in the control arm died [168 of 2352]). In the meta-analysis, the combined odds ratio (OR) was 1.11 (95% confidence interval (CI), 1.02–1.20, p = 0.02), with low heterogeneity (I2 = 0%) (Fig. 2A). In 12 trials including a total of 1282 patients (representing 12.8% of the total sample size for HCQ), there were zero deaths in both arms.
A Random-effects meta-analysis for mortality for treatment of COVID-19 with Hydroxychloroquine, trials are stratified by publication status. The dashed vertical line denotes an odds ratio of 1.0, which represents no difference in risk between hydroxychloroquine and the control. The black horizontal bars represent 95% confidence intervals (CIs). Random-effects model of the Hartung–Knapp–Sidik–Jonkman approach was performed to obtain a pooled estimate of the odds ratio. The estimate of heterogeneity (τ2) was obtained using the Paule and Mandel (PM) estimator. We describe the between-trial heterogeneity using the I2 statistic. The results of the statistical tests for the overall effect and corresponding p values are presented. All tests were two-tailed. *Published as peer-reviewed articles or posted preprints. B Random-effects meta-analysis for mortality for treatment of COVID-19 with chloroquine. The dashed vertical line denotes an odds ratio of 1.0, which represents no difference in risk between chloroquine and the control. The black horizontal bars represent 95% confidence intervals (CIs). Random-effects model of the Hartung–Knapp–Sidik–Jonkman approach was performed to obtain a pooled estimate of the odds ratio. The estimate of heterogeneity (τ2) was obtained using the Paule and Mandel (PM) estimator. We describe the between-trial heterogeneity using the I2 statistic. The results of the statistical tests for the overall effect and corresponding p values are presented. All tests were two-tailed. The x-axis scales differ for reasons of readability. Source data are provided as a Source Data file.
Regarding CQ, in the four included trials, 18 of 160 (11%) patients treated with CQ died and 12 of 147 patients (8%) in the control groups died. The combined OR was 1.77 (95% CI 0.15–21.13, p = 0.21), with low heterogeneity (I2 = 0%) (Fig. 2B). In two of four trials including a total of 217 patients, there were zero deaths in both arms.
The available evidence in this study is the result of publications, preprints, or unpublished trial results accrued from April 10, 2020 to October 16, 2020 as shown in the cumulative meta-analyses (Fig. 3A–C).
A Cumulative meta-analysis for mortality for treatment of COVID-19 with hydroxychloroquine. HCQ was evaluated in 26 trials with 10,012 patients. Four thousand three hundred and sixteen patients were treated with hydroxychloroquine, of whom 606 died. Five thousand six hundred and ninety-six patients were allocated to the control group, of whom 960 died. The dashed vertical line denotes an odds ratio of 1.0, which represents no difference in risk between hydroxychloroquine and the control. The black horizontal bars represent 95% confidence intervals (CIs). Random-effects model of the Hartung–Knapp–Sidik–Jonkman approach was performed to obtain a pooled estimate of the odds ratio. The estimate of heterogeneity (τ2) was obtained using the Paule and Mandel (PM) estimator. We describe the between-trial heterogeneity using the I2 statistic. The results of the statistical tests for the overall effect and corresponding p values are presented. All tests were two-tailed. B Cumulative meta-analysis for mortality for treatment of COVID-19 with hydroxychloroquine (publications and preprints only). HCQ was evaluated in 14 published trials with 8981 patients. Three thousand eight hundred and nine patients were treated with hydroxychloroquine, of whom 547 died. Five thousand one hundred and seventy-two patients were allocated to the control group, of whom 893 died.The dashed vertical line denotes an odds ratio of 1.0, which represents no difference in risk between hydroxychloroquine and the control. The black horizontal bars represent 95% confidence intervals (CI). Random-effects model of the Hartung–Knapp–Sidik–Jonkman approach was performed to obtain a pooled estimate of the odds ratio. The estimate of heterogeneity (τ2) was obtained using the Paule and Mandel (PM) estimator. We describe the between-trial heterogeneity using the I2 statistic. The results of the statistical tests for the overall effect and corresponding p values are presented. All tests were two-tailed. C Cumulative meta-analysis for mortality for treatment of COVID-19 with hydroxychloroquine (unpublished data only). HCQ was evaluated in 12 unpublished trials with 1031 patients. Five hundred and seven patients were treated with hydroxychloroquine, of whom 59 died. Five hundred and twenty-four patients were allocated to the control group, of whom 67 died. The dashed vertical line denotes an odds ratio of 1.0, which represents no difference in risk between hydroxychloroquine and the control. The black horizontal bars represent 95% confidence intervals (CIs). Random-effects model of the Hartung–Knapp–Sidik–Jonkman approach was performed to obtain a pooled estimate of the odds ratio. The estimate of heterogeneity (τ2) was obtained using the Paule and Mandel (PM) estimator. We describe the between-trial heterogeneity using the I2 statistic. The results of the statistical tests for the overall effect and corresponding p values are presented. All tests were two-tailed. The x-axis scales differ for reasons of readability. Source data are provided as a Source Data file.
For HCQ, none of the exploratory subgroup analyses showed an effect modification (Supplement Table S3 and Figure S1A, B). When only including published information (publications and preprints, excluding unpublished trials), there was an increase in mortality among patients treated with HCQ (OR 1.12, 95% CI 1.08–1.16), while among the unpublished trials there was no such sign of increased mortality (OR 0.92, 95% CI 0.63–1.34, p for interaction = 0.23). We conducted no subgroup analyses for CQ, as there were only two trials with events. In the sensitivity analyses employing different meta-analytical approaches (Supplement Table S4 and Figures S2A–C), results were compatible with the main analysis.
Discussion
This collaborative meta-analysis of 28 published or unpublished RCTs, including 10,319 patients, shows that treatment with HCQ was associated with increased mortality in COVID-19 patients, and there was no benefit from treatment with CQ. No differences were seen across subgroup analyses on patient setting, diagnosis confirmation, control type, publication status, or dose and the between-study heterogeneity was low. For CQ, the number of studies was too small to draw clear conclusions.
This meta-analysis offers useful insights for a challenging health situation. Hundreds of thousands of patients have received HCQ and CQ outside of clinical trials without evidence of their beneficial effects. Public interest is unprecedented, with weak early evidence supporting HCQ’s merits being widely discussed in some media and social networks—despite the unfavorable results by a very large RCT. Numerous clinical studies have been investigating HCQ and CQ almost simultaneously. Although several systematic reviews and meta-analyses are already available, they only consider the small handful of RCTs being already published (which were all included here)29,30,31,32,33. While data sharing has been rather limited to date in biomedical research, such openness can be transformative in generating knowledge. This pandemic has brought together a collaboration of clinical trialists agreeing to share their data, which allows this study to not only summarize the existing evidence but also illustrate the accumulation of evidence that would otherwise not be available.
For HCQ, evidence is dominated by the RECOVERY trial13, which indicated no mortality benefit for treated COVID-19 patients, together with longer hospitalization and higher risk of progression to invasive mechanical ventilation and/or death. Similarly, the WHO SOLIDARITY trial indicated no mortality benefit26. The RECOVERY and WHO SOLIDARITY trials used HCQ in comparatively higher doses than all other trials except REMAP-CAP. There was no evidence for an effect modification by dose (p for interaction = 0.29), and the combined effect of all the trials with lower dose did not indicate a benefit of HCQ but tended to a null effect (OR 0.97; 0.73–1.30) with wide CIs, compatible with the main effect estimate.
This meta-analysis does not address prophylactic use nor other outcomes besides mortality. All but three trials excluded children and the majority excluded pregnant or breastfeeding women; generalizability remains unclear for those populations. Among the five studies on outpatients, there were three deaths, two occurring in the one trial of 491 relatively young patients with few comorbidities17 and one occurring in a small trial with 27 patients. For outpatients who are elderly or have comorbidities, evidence is sparse. Most of the 28 trials excluded persons with comorbid conditions carrying higher risk of adverse events from HCQ or CQ16,17,27. No evidence is in the pipeline for these groups, which echoes clinical reasoning being reluctant to expose them to risk.
Although the published trials resulted in a conclusive treatment estimate, the unpublished trials tend towards a null effect. The tendency of published trials to report larger effect sizes than unpublished trials is well-documented and constitute one of the reporting biases that are discernable only when a body of studies are considered together34. Null results are less expected to be rapidly disseminated, especially if the trial is small. Of note, RECOVERY results showing dexamethasone benefits have been published more rapidly3 than the unfavorable HCQ results13. We have found no evidence for small-study effects and we consider that the results are unlikely to have been materially affected by publication or reporting bias. This paper offers the most comprehensive summary on HCQ and mortality in COVID-19 to date.
Twenty-three percent of the potentially eligible trials were listed as discontinued, mostly because of fewer patients than expected. Among 28 included RCTs, only two had reached their target sample size at the time of censoring for this meta-analysis. As previously discussed4, most trials on HCQ and CQ in COVID-19 are small, reflecting both the strong motivation for individual efforts and underscoring the need for readily available research infrastructure to merge small-scale initiatives. Especially in the context of recruitment challenges, we encourage other researchers to form collaborations and combine trial results35.
Our analysis has some limitations. First, although we adopted a comprehensive, systematic search strategy, our real-time initiative differs from traditional systematic reviews. We focused on collecting unpublished information, aiming to rapidly secure as much trial evidence as possible. We did not review individual trials, nor did we stratify results according to patient characteristics, and we have not collected information on other outcomes than mortality. Such analyses are planned in future publications using in-depth details disclosed in individual trial publications to come36,37,38. The exploratory subgroup analyses did not support the hypothesis that blinding/use of placebo is associated with the observed effect (the test for an interaction gives p = 0.15 and the OR is 0.88 with wide CIs 0.55–1.41, compatible with the overall effect); moreover, attrition was negligible (median 0%, IQR 0–0%; range 0–19.5%). A meta-epidemiological study shows little evidence that mortality results would be affected by lack of blinding, or problems in randomization and allocation concealment, in contrast to less objective outcomes39. Accordingly, we identified no relevant risk of bias across trials. Second, a majority of the potentially eligible trials were not available. Despite going far beyond the standard review of published evidence, we expect additional results from future trials on CQ to narrow the uncertainty of the treatment effect and possibly reveal benefits or harms not discernible based on the current evidence. We plan to perform an update when substantial additional evidence becomes available. Third, although this analysis intended to combine results from both inpatients and outpatients regardless of disease severity, trials enrolling patients with mild to moderate disease comprised a minority of the final sample size; many of which had zero or few events. Finally, although sensitivity analyses addressing model specifications were compatible with the main analysis, one combination (HKSJ model with SJ τ2 estimator) yielded substantially wider CIs. This combination gave disproportionately low weight to RECOVERY (15%) and we consider the main model (HKSJ with PM τ2 estimator) to be more valid in this situation.
Treatment with HCQ for COVID-19 was associated with increased mortality, and there was no benefit from CQ based on currently available randomized trial data. Medical professionals around the globe are encouraged to inform patients about this evidence.
Methods
This collaborative meta-analysis focused solely on all-cause mortality in order to provide rapid evidence on the most critical clinical outcome. Investigators of ongoing, discontinued, or completed trials were contacted via email to provide group-level (aggregated) mortality data per trial arm at any time point available. The protocol was published online before data collection40. This review has been reported in accordance with the Preferred Reporting Items for Systematic Review and Meta-analysis41. The PRISMA checklist can be found in the supplement (Supplement 1).
Eligibility criteria
We considered all clinical trials that reported randomly allocating patients with confirmed or suspected SARS-CoV-2 infection to a treatment protocol containing HCQ or CQ (for any duration or dose) or the same treatment protocol not containing HCQ or CQ. In other words, the control group had to receive placebo or no treatment other than standard of care (we excluded comparisons of HCQ or CQ against an active treatment, e.g., HCQ versus azithromycin, since active controls were too heterogeneous to pool together and reveal the pure benefits and harms of HCQ or CQ). Eligible ongoing trials had to provide data on all-cause mortality and randomize the first patient before June 1, 2020 (time point selected arbitrarily as we did not expect trials launched later to recruit enough patients to provide relevant additional information). Trials that were published or posted as preprint were not restricted by date. Prevention trials were not included. We included trials regardless of follow-up time and whether mortality was a primary outcome or not; moreover, we put no restrictions on trial status, language, geographical region, or healthcare setting.
Search strategy
We searched for eligible trials registered at ClinicalTrials.gov and the WHO International Clinical Trials Registry Platform (ICTRP) by June 11, 2020 (COVID-evidence database; see Supplement 2)42. We additionally searched PubMed and the Cochrane COVID-19 trial registry (covering preprints, trial registries, and literature databases) by June 11, 2020, using terms related to HCQ and CQ combined with terms for COVID-19 and a standard RCT filter (Supplement 2)43. We updated the literature search on October 16, 2020. Two authors (C.A. and A.M.S.) independently verified the eligibility criteria (Fig. 1) and solved any discrepancies by discussion.
Principal investigators of 83 potentially eligible trials were asked to confirm the eligibility criteria, as well as: “For each of your study arms: (a) What intervention did this group receive? (b) How many patients were randomized to this group? (c) Of these patients, how many have died? (d) Of these patients, for how many it is unknown if they are dead or alive?” (Supplement 3, email template). Investigators who were not responsive received two email reminders in English or Chinese, depending on trial origin.
Data extraction
The following information was extracted from all included RCTs by two reviewers (C.A. and A.M.S.) and verified by the trial investigators: experimental and control arms, number of randomized participants, treatment schedule, patient setting, eligibility criteria, study location, blinding, target sample size, and trial status. In all trials that used hydroxychloroquine, we extracted dosages referring to hydroxychloroquine sulfate. In trials that used chloroquine, the dosages for ARCHAIC, ChiCTR2000030054 and ChiCTR2000031204 refer to chloroquine phosphate, while those for CloroCOVID19II and CloroCOVID19III refer to chloroquine base. We also classified trials as published in a peer-reviewed journal, posted on a preprint server, or unpublished (the latter category not including preprints). For reasons of feasibility within this rapid assessment, we generally did not request descriptive information beyond items included in trial registrations.
Risk of bias assessment
Two reviewers (C.A. and A.M.S.) independently assessed the risk of bias of included RCTs using the Cochrane risk of bias tool 2.044. Disagreements were resolved through discussion. We used the information reported in preprints and journal publications, and for unpublished trials, we retrieved information from trial registrations, which was confirmed by trial investigators. We also assessed small-study effects with an inverted funnel plot and Egger’s test43. The presence of small-study effects may be suggestive, but not definitive, of publication bias45.
Data synthesis and analyses
The main analysis evaluated separately the effect on all-cause mortality of HCQ versus control and CQ versus control. We report absolute numbers and proportions, as well as the treatment effect estimate as an odds ratio (OR; odds of death in the HCQ or CQ intervention group divided by the odds of death in the control group) with 95% CIs. For multi-arm studies, we requested data for all arms and calculated treatment effect estimates for each eligible comparison. We combined mortality effects from all RCTs based on binary outcome data (2 × 2 contingency tables) in meta-analyses and describe the statistical heterogeneity using the I2 statistic46. In our protocol, we prespecified a random-effects model of the Hartung–Knapp–Sidik–Jonkman (HKSJ) approach47, in order to provide more equality of weights between trials with moderate to large size (than, e.g., the DerSimonian–Laird approach). We did not prespecify the between-study variance estimator, τ2, but chose the Paule and Mandel (PM) estimator based on provided guidance on choosing among 16 variants48. Cases of zero events in one arm were corrected by adding the reciprocal of the size of the contrasting study arm43. However, considering the range of sample sizes and the number of zero events across trials, we assessed the effects of alternative approaches with sensitivity analyses, as detailed below. To explore and illustrate evidence generation over time, we also performed a cumulative meta-analysis of all trials as well as stratified by dissemination status (publications/preprints versus unpublished), using the HKSJ approach with PM τ2. We used the date of email response or publication/posting of preprint. The meta-analyses were completed using R version 3.5.1 and the “meta” package version 4.13-0.
Subgroup analyses
In exploratory subgroup analyses, we stratified trials by patient setting (as proxy to COVID-19 severity: outpatients, inpatients but not intensive care unit (ICU), and ICU), diagnostic confirmation (confirmed SARS-CoV-2 versus suspected cases), control type (placebo control versus other), and publications/preprints versus unpublished trials. We did not stratify for missing data since the amount was extremely low. A post hoc stratification by HCQ dose was added (trials with ≥1600 mg on day 1 and ≥800 mg from day 2 versus lower-dose trials) to isolate trials predicted to achieve blood levels of HCQ above the in vitro half-maximal inhibitory concentration value for SARS-CoV-2 (1.13 μM)49.
Sensitivity analyses
We added exploratory sensitivity analyses to assess robustness across meta-analytic approaches: DerSimonian–Laird and Sidik–Jonkman τ2 estimators, Mantel–Haenszel random-effects method, and Peto method. DerSimonian–Laird is a standard random-effects meta-analysis approach, but may underestimate uncertainty. The Sidik–Jonkman τ2 estimator, on the other hand, may yield inflated estimates if heterogeneity is low48. The Mantel–Haenszel method performs reasonably well with small and zero event counts, much like Peto and arcsine transformation. The Peto method is suboptimal in the presence of substantial imbalances in the allocation ratio of patients randomized in the compared arms (e.g., RECOVERY trial). We also modeled variants to handling zero events (arcsine difference, and excluding trials with zero events) as well as excluding trials with <50 participants.
Unpublished trial details
All unpublished trials were performed according to the principles of the Declaration of Helsinki and written informed consent was obtained from the study participants. The release of mortality outcome data was authorized by the respective data and safety monitoring boards and principal investigators. Ethical approval was granted by institutional review boards as follows: University of Pennsylvania, ref. #842838 (PATCH, NCT04329923); National Bioethics Committee (NBC) Pakistan, ref. 4–87/NBC-471-COVID-19-05/20/ (PROTECT, NCT04338698); Ethics Committee of the Capital Region of Denmark, ref. H-20025317 (CCAP-1, NCT04345289); Comité de Protection des Personnes du Sud-Ouest et Outre-Mer 4, ref. CPP2020-03-036/2020-001271-33/20.03.24.72431, and the Agence Nationale de Sécurité du Médicament et des produits de santé (ANSM), ref. MEDAECNAT-2020-03-00045 (HYCOVID, NCT04325893); Ethik-Kommission an der Medizinischen Fakultät der Eberhard-Karls-Universität und am Universitätsklinikum Tübingen, ref. 190/2020AMG1 and ref. 225/2020AMG1 (COV-HCQ, NCT04342221; and COMIHY, NCT04340544, respectively); London-Surrey Borders Research Ethics Committee in the UK, Medisch Ethische Toetsingscommissie Utrecht (METC Utrecht) in the Netherlands, Sydney Local District ethics Review Committee (Royal Prince Alfred Hospital) in Australia, Northern A Health and Disability Ethics Committee in New Zealand, St. Vincent’s Healthcare Group Ethics and Medical Research Committee in Ireland, King Abdullah International Medical Research Center Institutional Review Board in Saudi Arabia, University of Pittsburgh Institutional Review Board in the United States, Unity Health Research Ethics Board in Canada, National Ethics Committee for Clinical Research (CEIC) in Portugal, and the Romania Academy of Medical Sciences National Bioethics Committee for Medicines and Medical Devices (REMAP-CAP, NCT02735707); Comissão Nacional de Ética em Pesquisa (CONEP), ref. 3.961.681 (CloroCOVID19II A, NCT04323527, and CloroCOVID19II B, NCT04342650); a Single Ethics Committee from the Coordination of the National Institutes of Health and High Specialty Hospitals, ref. C13-20 (HYDRA, NCT04315896); the Ethics Committee of Beijing Youan Hospital, Capital Medical University, ref. JINYOUKELUN[2020]013 (ChiCTR2000031204); Partners Human Research Committee at the Brigham and Women’s Hospital, Boston, Ethisch Comite in Belgium, and Stichting Beoordeling Ethiek Biomedisch in the Netherlands (NCT04333654); The Queen’s Medical Center, ref. RA-2020-018 (OAHU-COVID19, NCT04345692); Duke University Medical Center Institutional Review Board, ref. Pro00105339, and UnityPoint Health Institutional Review Board (NCT04335552); and Medical Ethics Committee Utrecht (METC Utrecht), part of the Dutch Central Committee on Research Involving Human Subjects (ARCHAIC, NL8490).
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Data availability
All trial-level data generated or analyzed during this study are included in this published article and its Supplementary information files. The data file is provided in the Open Science Framework [https://osf.io/qesv4/]40. Source data are provided with this paper.
Code availability
The code file is provided in the Open Science Framework [https://osf.io/qesv4/]40.
Change history
05 February 2024
A Correction to this paper has been published: https://doi.org/10.1038/s41467-024-45360-6
14 May 2021
A Correction to this paper has been published: https://doi.org/10.1038/s41467-021-23559-1
References
Berlin, D. A., Gulick, R. M. & Martinez, F. J. Severe Covid-19. N. Engl. J. Med. https://doi.org/10.1056/NEJMcp2009575 (2020).
Johns Hopkins Coronavirus Resource Center. COVID-19 Map. https://coronavirus.jhu.edu/map.html (2020).
RECOVERY Collaborative Group et al. Dexamethasone in hospitalized Patients with Covid-19 - preliminary report. N. Engl. J. Med. https://doi.org/10.1056/NEJMoa2021436 (2020).
Janiaud, P. et al. The worldwide clinical trial research response to the COVID-19 pandemic - the first 100 days. F1000Res. 9, 1193 (2020).
Fantini, J., Di Scala, C., Chahinian, H. & Yahi, N. Structural and molecular modelling studies reveal a new mechanism of action of chloroquine and hydroxychloroquine against SARS-CoV-2 infection. Int. J. Antimicrob. Agents 55, 105960 (2020).
dos Reis Neto, E. T. et al. Revisiting hydroxychloroquine and chloroquine for patients with chronic immunity-mediated inflammatory rheumatic diseases. Adv. Rheumatol. 60, 32 (2020).
Office of the Commissioner. Emergency Use Authorization. U.S. Food and Drug Administration. https://www.fda.gov/emergency-preparedness-and-response/mcm-legal-regulatory-and-policy-framework/emergency-use-authorization (2020).
Vaduganathan, M. et al. Prescription fill patterns for commonly used drugs during the COVID-19 pandemic in the United States. JAMA https://doi.org/10.1001/jama.2020.9184 (2020).
Dagens, A. et al. Scope, quality, and inclusivity of clinical guidelines produced early in the covid-19 pandemic: rapid review. BMJ 369, m1936 (2020).
Geleris, J. et al. Observational study of hydroxychloroquine in hospitalized patients with Covid-19. N. Engl. J. Med. https://doi.org/10.1056/NEJMoa2012410 (2020).
Office of the Commissioner. Coronavirus (COVID-19) update: FDA revokes emergency use authorization for chloroquine and hydroxychloroquine. U.S. Food and Drug Administration. https://www.fda.gov/news-events/press-announcements/coronavirus-covid-19-update-fda-revokes-emergency-use-authorization-chloroquine-and (2020).
WHO. WHO discontinues hydroxychloroquine and lopinavir/ritonavir treatment arms for COVID-19. https://www.who.int/news-room/detail/04-07-2020-who-discontinues-hydroxychloroquine-and-lopinavir-ritonavir-treatment-arms-for-covid-19 (2020).
RECOVERY Collaborative Group et al. Effect of hydroxychloroquine in hospitalized patients with Covid-19. N. Engl. J. Med. https://doi.org/10.1056/NEJMoa2022926 (2020).
Trigo, M. S., Kurmanaev, A. & Cabrera, J. M. L. With officials’ backing, dubious virus remedies surge in Latin America. The New York Times (23 July 2020).
Janiaud, P., Axfors, C., Saccilotto, R., Hemkens, L. & Schmitt, A. COVID-evidence: a living database of trials on interventions for COVID-19. https://doi.org/10.17605/OSF.IO/GEHFX (2020).
Chen, L. et al. Efficacy and safety of chloroquine or hydroxychloroquine in moderate type of COVID-19: a prospective open-label randomized controlled study. Preprint at medRxiv https://doi.org/10.1101/2020.06.19.20136093 (2020).
Skipper, C. P. et al. Hydroxychloroquine in nonhospitalized adults with early COVID-19: a randomized trial. Ann. Intern. Med. https://doi.org/10.7326/M20-4207 (2020).
Jun, C. et al. A pilot study of hydroxychloroquine in treatment of patients with moderate COVID-19. J. Zhejiang Univ. 49, 215–219 (2020).
Cavalcanti, A. B. et al. Hydroxychloroquine with or without azithromycin in mild-to-moderate Covid-19. N. Engl. J. Med. https://doi.org/10.1056/NEJMoa2019014 (2020).
Mitjà, O. et al. Hydroxychloroquine for early treatment of adults with mild Covid-19: a randomized-controlled trial. Clin. Infect. Dis. https://doi.org/10.1093/cid/ciaa1009 (2020).
Chen, Z. et al. Efficacy of hydroxychloroquine in patients with COVID-19: results of a randomized clinical trial. Preprint at medRxiv https://doi.org/10.1101/2020.03.22.20040758 (2020).
Chen, C.-P. et al. A Multicenter, randomized, open-label, controlled trial to evaluate the efficacy and tolerability of hydroxychloroquine and a retrospective study in adult patients with mild to moderate Coronavirus disease 2019 (COVID-19). Preprint at medRxiv 2020.07.08.20148841 (2020).
Kamran, S. M. et al. Clearing the fog: is HCQ effective in reducing COVID-19 progression: a randomized controlled trial. Preprint at medRxiv https://doi.org/10.1101/2020.07.30.20165365 (2020).
Ulrich, R. J. et al. Treating Covid-19 With Hydroxychloroquine (TEACH): a multicenter, double-blind, randomized controlled trial in hospitalized patients. Open Forum Infect. Dis. https://doi.org/10.1093/ofid/ofaa446 (2020).
Abd-Elsalam, S. et al. Hydroxychloroquine in the treatment of COVID-19: a multicenter randomized controlled study. Am. J. Trop. Med. Hyg. https://doi.org/10.4269/ajtmh.20-0873 (2020).
W. H. O. Solidarity Trial Consortium et al. Repurposed antiviral drugs for COVID-19; interim WHO SOLIDARITY trial results. Preprint at medRxiv https://doi.org/10.1101/2020.10.15.20209817 (2020).
Tang, W. et al. Hydroxychloroquine in patients with mainly mild to moderate coronavirus disease 2019: open label, randomised controlled trial. BMJ 369, m1849 (2020).
Lyngbakken, M. N. et al. A pragmatic randomized controlled trial reports lack of efficacy of hydroxychloroquine on coronavirus disease 2019 viral kinetics. Nat. Commun. 11, 5284 (2020).
Siemieniuk, R. A. et al. Drug treatments for covid-19: living systematic review and network meta-analysis. BMJ 370, m2980 (2020).
Thoguluva Chandrasekar, V. et al. Systematic review and meta-analysis of effectiveness of treatment options against SARS-CoV-2 infection. J. Med. Virol. https://doi.org/10.1002/jmv.26302 (2020).
Liu, W. et al. Efficacy and safety of antiviral treatment for COVID-19 from evidence in studies of SARS-CoV-2 and other acute viral infections: a systematic review and meta-analysis. CMAJ 192, E734–E744 (2020).
Hernandez, A. V., Roman, Y. M., Pasupuleti, V., Barboza, J. J. & Michael White, C. Hydroxychloroquine or chloroquine for treatment or prophylaxis of COVID-19: a living systematic review. Ann. Intern. Med. 173, 287–296 (2020).
Sarma, P. et al. Virological and clinical cure in COVID-19 patients treated with hydroxychloroquine: a systematic review and meta-analysis. J. Med. Virol. 92, 776–785 (2020).
Dechartres, A., Atal, I., Riveros, C., Meerpohl, J. & Ravaud, P. Association between publication characteristics and treatment effect estimates: a meta-epidemiologic study. Ann. Intern. Med. 169, 385–393 (2018).
Petkova, E., Antman, E. M. & Troxel, A. B. Pooling data from individual clinical trials in the COVID-19 era. JAMA https://doi.org/10.1001/jama.2020.13042 (2020).
Bravo-Jeria, R. et al. Chloroquine and hydroxychloroquine for the treatment of COVID-19: a living systematic review. PROSPERO 2020 CRD42020178195. https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=178195 (2020).
Scott, D. A. et al. A systematic review and meta-analysis of the efficacy and safety of chloroquine for the treatment of patients with COVID-19. PROSPERO 2020 CRD42020178266. https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=178266 (2020).
Fontes, L. E. et al. Chloroquine/hydroxychloroquine for coronavirus disease 2019 (COVID-19) – a systematic review of individual participant data. PROSPERO 2020 CRD42020178667. https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020178667 (2020).
Savović, J. et al. Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials. Ann. Intern. Med. 157, 429–438 (2012).
Axfors, C. et al. Hydroxychloroquine and chloroquine for survival in COVID-19: an international collaborative meta-analysis of randomized trials. Open Science Framework. https://doi.org/10.17605/OSF.IO/QESV4 (2020).
Page, M. J. et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Preprint at MetaArXiv https://doi.org/10.31222/osf.io/v7gm2 (2020).
The COVID-evidence team. COVID-evidence. https://covid-evidence.org/ (2020).
Higgins, J. P. T. et al. Cochrane Handbook for Systematic Reviews of Interventions (Wiley, 2019).
Sterne, J. A. C. et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 366, l4898 (2019).
Sterne, J. A. C. et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 343, d4002 (2011).
Higgins, J. P. T., Thompson, S. G., Deeks, J. J. & Altman, D. G. Measuring inconsistency in meta-analyses. BMJ 327, 557–560 (2003).
IntHout, J., Ioannidis, J. P. A. & Borm, G. F. The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method. BMC Med. Res. Methodol. 14, 25 (2014).
Veroniki, A. A. et al. Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res. Synth. Methods 7, 55–79 (2016).
White, N. J. et al. COVID-19 prevention and treatment: a critical analysis of chloroquine and hydroxychloroquine clinical pharmacology. PLoS Med. 17, e1003252 (2020).
Acknowledgements
We wish to express our heartfelt gratitude to all patients volunteering for the trials involved. We furthermore thank Wenyan Ma and Benjamin Kasenda (University Hospital Basel, University of Basel) for kindly translating the emails to Chinese investigators. For valuable contributions to individual trials in this collaborative group, we sincerely thank: Hannah Jin, Monica Feeley, Bruce Bausk, Jessica Cauley, Jane Kleinjan, Jon Gothing, Naeema Bangash, Heather Wroe, Claire Bigogne, Christelle Castell, Annelies Mottart, Lisette Cortenraad, Judith Medema-Muller, Katia Handelberg, Khalid Benhammou, Shaheen Kumar, Sophie Gribomont, Kim Kuehne, Cathia Markina, Julien Labeirie, Julie Pencole, Eva Crispyn, Cecile Le Breton, Kelli Horn, Tina Patel, Benjamin Harrois, Isabelle Collin, Vetheeswar Manivannan, Irma Slomp, Frederick Becue, Isabelle Godefroy, Lynne Guo, Lene Kollmorgen, Toluwalope Cole, Catherine Chene, Praveena Deenumsetti, Anne Doisy, Ariane Vialfont, Melissa Charbit, Christine Shu, Stephane Kirkesseli, Howard Surks, Magalie De Meyer, Edel Hendrickx, and Paul Deutsch (Sanofi trial); Ellie Carmody, Märtin Backer, Jaishvi Eapen, Jack A. DeHovitz, Prithiv J. Prasad, Yi Li, Camila Delgado, Morris Jrada, Gabriel A. Robbins, Brooklyn Henderson, Alexander Hrycko, Dinuli Delpachitra, Vanessa Raabe, Jonathan S. Austrian, and Yanina Dubrovskaya (TEACH trial); Farah Al-Beidh, Djillali Annane, Kenneth Baillie, Abigail Beane, Richard Beasley, Zahra Bhimani, Marc Bonten, Charlotte Bradbury, Frank Brunkhorst, Meredith Buxton, Allen Cheng, Menno de Jong, Eamon Duffy, Lise Estcourt, Rob Fowler, Timothy Girard, Herman Goossens, Cameron Green, Rashan Haniffa, Christopher Horvat, David Huang, Francois Lamontagne, Patrick Lawler, Kelsey Linstrum, Edward Litton, John Marshall, Daniel McAuley, Shay McGuinness, Stephanie Montgomery, Paul Mouncey, Katrina Orr, Rachael Parke, Jane Parker, Asad Patanwala, Kathryn Rowan, Marlene Santos, Christopher Seymour, Steven Tong, Anne Turner, Timothy Uyeki, Wilma van Bentum-Puijk, Frank van de Veerdonk, and Ryan Zarychanski (REMAP-CAP trial); Jan-Erik Berdal, Arne Eskesen, Dag Kvale, Inge Christoffer Olsen, Corina Silvia Rueegg, Anbjørg Rangberg, Christine Monceyron Jonassen, and Torbjørn Omland (NO COVID-19 trial). Support for title page creation and format was provided by AuthorArranger, a tool developed at the National Cancer Institute.
This collaborative meta-analysis was supported by the Swiss National Science Foundation and Laura and John Arnold Foundation (grant supporting the postdoctoral fellowship at the Meta-Research Innovation Center at Stanford (METRICS), Stanford University). Funding also includes postdoctoral grants from Uppsala University, the Swedish Society of Medicine, the Blanceflor Foundation, and the Sweden-America Foundation (C.A.). The funders had no role in the design of this collaborative meta-analysis; in the collection, analysis, and interpretation of data; or in the report writing. The corresponding author had full access to all study data and final responsibility for the decision to submit for publication.
Author information
Authors and Affiliations
Contributions
L.G.H., C.A., and A.M.S. had full access to all data in this study and take responsibility for the integrity of the data and the accuracy of the data analysis. Concept and design: L.G.H., J.P.A.I., C.A., A.M.S., S.N.G., and D.M. Acquisition, analysis, or interpretation of data: all authors. Drafting of the manuscript: C.A., A.M.S., and L.G.H. Critical revision of the manuscript for important intellectual content: all authors. Statistical analysis: A.M.S., L.G.H., J.P.A.I., S.N.G., and P.J. Approval of the final manuscript: all authors. Obtained funding: L.G.H., C.A., and J.P.A.I. Administrative, technical, or material support: C.A., A.M.S., L.G.H., P.J., and J.v.H. Supervision: L.G.H.
Corresponding author
Ethics declarations
Competing interests
B.S.A. and R.K.A. are the primary investigators of the Prevention and Treatment of COVID19 with Hydroxychloroquine (PATCH) trial, funded by a philanthropic gift. R.K.A reports being founder with equity of Pinpoint Therapeutics and Immunacell, and personal fees from Sprint Biosciences and Deciphera, outside the submitted work. D.C.A. reports personal fees from Ferring Pharmaceuticals, Inc., Bristol-Myers Squibb, and Bayer AG, other from Alung Technologies, Inc., outside the submitted work; in addition, D.C.A. has pending patents for Selepressin—compounds, compositions, and methods for treating sepsis to Ferring, B.V., and Proteomic biomarkers of sepsis in elderly patients pending to University of Pittsburgh. Y.M.A. reports that he is the principal investigator on a clinical trial of lopinavir–ritonavir and interferon for Middle East respiratory syndrome (MERS) and that he was a nonpaid consultant on therapeutics for MERS-coronavirus (CoV) for Gilead Sciences and SAB Biotherapeutics. He is a coinvestigator on the Randomized, Embedded, Multi-factorial Adaptive Platform Trial for Community-Acquired Pneumonia (REMAP-CAP), a board member of the International Severe Acute Respiratory and Emerging Infection Consortium (ISARIC), and the Lead-Co Chair of the Think20 (T20) Taskforce for COVID-19. Brigham and Women’s Hospital, PRA Health Science, and Cliniques universitaires Saint-Luc received funds from Sanofi. T.B. reports grants from Pfizer, Novo Nordisk Foundation, Simonsen Foundation, Lundbeck Foundation, and Kai Hansen Foundation; grants and personal fees from GSK, Pfizer, Boehringer Ingelheim, and Gilead; and personal fees from MSD, all outside the submitted work. Y.Z.C., L.N.C., B.I., and L.P. are employees of Sanofi. The COV-HCQ and COMIHY trials were supported by the German Federal Ministry of Education and Research (EudraCT number 2020-001224-33) and the German Federal Ministry of Health (EudraCT number 2020-001512-26). L.D. reports grants from EU FP7-HEALTH-2013-INNOVATION-1, grant number 602525, grants from H2020 RECOVER, grant agreement no. 101003589, during the conduct of the study; and is a member of the COVID-19 guideline committee SCCM/ESICM/SSC, member of the ESICM COVID-19 taskforce, and chair of the Dutch intensivists (NVIC) taskforce infectious threats. V.D. reports nonfinancial support from MSD France and from Sanofi Aventis France, outside the submitted work. A.E. is an employee of Ividata Life Sciences and works as an external contractor for Sanofi. A.C.G. received grant funding from an NIHR Research Professorship (RP-2015-06-18), support from the NIHR Imperial Biomedical Research Centre, and consulting fees paid to his institution from GlaxoSmithKline and Bristol-Myers Squibb. T.H. reports grants from the Health Research Council of New Zealand, during the conduct of the study. A.I.M.H. reports grants from ZonMw, Netherlands organisation for Health Research and Development, during the conduct of the study. HYDRA trial was an investigator-initiated study supported by Sanofi, CONACYT (National Council of Science and Technology of Mexico) and by the participating centers. Thuy Le reports grants from Gilead Sciences, outside the submitted work. B.J.M. reports grants from NIH/NHLBI, and from Bayer Pharmaceuticals, Inc., outside the submitted work. S.M. receives funding as the Innovative Medicines Canada Chair in Pandemic Preparedness. C.M. reports grants from the Health Research Council of New Zealand. M.J.M. reports having received the HCQ drug from the New York State government, during the conduct of the study; grants from Lilly, Pfizer, Sanofi, and personal fees from Meissa, outside the submitted work; in addition, M.J.M. has a patent anti-Zika monoclonal ab/ Emory Univ pending. A.N. is supported by a Health Research Board of Ireland Clinical Trial Network Award (HRB-CTH-2014-012). L.P. is an employee of Excelya and works as an external contractor for Sanofi. F.W.R. reports personal fees from Merck Research Labs, Novartis, Lilly, Sanofi, NovoNordisk, KLSMC, Tolerion, Rhythm, UCB, AstraZeneca, Janssen, Merck KGaA, Sarepta, Eidos, Amgen, Phathom, outside the submitted work; and having equity interest in GlaxoSmithkline, Athira Pharma, DataVant, Spencer Healthcare. S.R.W. reports receiving a grant from Sanofi during the conduct of the study and grants from NIH-NIAID outside the submitted work, and having conducted vaccine (HIV, Zika) clinical trials funded by Janssen. S.A.W. reports grants from National Health and Medical Research Council (Australia), grants from Minderoo Foundation, from Health Research Council (New Zealand), and from Medical Research Future Fund (Australia), during the conduct of the study. J.M.W. reports grants from ZonMw, Netherlands organisation for Health Research and Development, during the conduct of the study. F.G.Z. was part of the Coalition 1 trial partially supported by EMS Pharmaceuticals, has received previous grants from Bactiguard, Sweden, outside the submitted work, and support from Baxter LA for another clinical trial in critically ill patients. None of the other authors have any competing interests to declare.
Additional information
Peer review information Nature Communications thanks the anonymous reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Source data
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Axfors, C., Schmitt, A.M., Janiaud, P. et al. Mortality outcomes with hydroxychloroquine and chloroquine in COVID-19 from an international collaborative meta-analysis of randomized trials. Nat Commun 12, 2349 (2021). https://doi.org/10.1038/s41467-021-22446-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-021-22446-z