Pharmacoepidemiology, Machine Learning and COVID-19: An intent-to-treat analysis of hydroxychloroquine, with or without azithromycin, and COVID-19 outcomes amongst hospitalized US Veterans

DOI record: { "DOI": "10.1093/aje/kwab183", "ISSN": [ "0002-9262", "1476-6256" ], "URL": "http://dx.doi.org/10.1093/aje/kwab183", "abstract": "<jats:title>Abstract</jats:title>\n <jats:p>Hydroxychloroquine (HCQ) was proposed as an early therapy for coronavirus disease 2019 (COVID-19) after in vitro studies indicated possible benefit. Previous in vivo observational studies have presented conflicting results, though recent randomized clinical trials have reported no benefit from HCQ among patients hospitalized with COVID-19. We examined the effects of HCQ alone and in combination with azithromycin in a hospitalized population of US veterans with COVID-19, using a propensity score–adjusted survival analysis with imputation of missing data. According to electronic health record data from the US Department of Veterans Affairs health care system, 64,055 US Veterans were tested for the virus that causes COVID-19 between March 1, 2020 and April 30, 2020. Of the 7,193 veterans who tested positive, 2,809 were hospitalized, and 657 individuals were prescribed HCQ within the first 48-hours of hospitalization for the treatment of COVID-19. There was no apparent benefit associated with HCQ receipt, alone or in combination with azithromycin, and there was an increased risk of intubation when HCQ was used in combination with azithromycin (hazard ratio = 1.55; 95% confidence interval: 1.07, 2.24). In conclusion, we assessed the effectiveness of HCQ with or without azithromycin in treatment of patients hospitalized with COVID-19, using a national sample of the US veteran population. Using rigorous study design and analytic methods to reduce confounding and bias, we found no evidence of a survival benefit from the administration of HCQ.</jats:p>", "author": [ { "affiliation": [], "family": "Gerlovin", "given": "Hanna", "sequence": "first" }, { "affiliation": [], "family": "Posner", "given": "Daniel C", "sequence": "additional" }, { "affiliation": [], "family": "Ho", "given": "Yuk-Lam", "sequence": "additional" }, { "affiliation": [], "family": "Rentsch", "given": "Christopher T", "sequence": "additional" }, { "affiliation": [], "family": "Tate", "given": "Janet P", "sequence": "additional" }, { "affiliation": [], "family": "King", "given": "Joseph T", "sequence": "additional", "suffix": "Jr." }, { "affiliation": [], "family": "Kurgansky", "given": "Katherine E", "sequence": "additional" }, { "affiliation": [], "family": "Danciu", "given": "Ioana", "sequence": "additional" }, { "affiliation": [], "family": "Costa", "given": "Lauren", "sequence": "additional" }, { "affiliation": [], "family": "Linares", "given": "Franciel A", "sequence": "additional" }, { "affiliation": [], "family": "Goethert", "given": "Ian D", "sequence": "additional" }, { "affiliation": [], "family": "Jacobson", "given": "Daniel A", "sequence": "additional" }, { "affiliation": [], "family": "Freiberg", "given": "Matthew S", "sequence": "additional" }, { "affiliation": [], "family": "Begoli", "given": "Edmon", "sequence": "additional" }, { "affiliation": [], "family": "Muralidhar", "given": "Sumitra", "sequence": "additional" }, { "affiliation": [], "family": "Ramoni", "given": "Rachel B", "sequence": "additional" }, { "affiliation": [], "family": "Tourassi", "given": "Georgia", "sequence": "additional" }, { "affiliation": [], "family": "Gaziano", "given": "J Michael", "sequence": "additional" }, { "affiliation": [], "family": "Justice", "given": "Amy C", "sequence": "additional" }, { "affiliation": [], "family": "Gagnon", "given": "David R", "sequence": "additional" }, { "affiliation": [], "family": "Cho", "given": "Kelly", "sequence": "additional" } ], "container-title": "American Journal of Epidemiology", "content-domain": { "crossmark-restriction": false, "domain": [] }, "created": { "date-parts": [ [ 2021, 6, 21 ] ], "date-time": "2021-06-21T19:13:37Z", "timestamp": 1624302817000 }, "deposited": { "date-parts": [ [ 2021, 11, 2 ] ], "date-time": "2021-11-02T06:56:36Z", "timestamp": 1635836196000 }, "indexed": { "date-parts": [ [ 2023, 12, 9 ] ], "date-time": "2023-12-09T06:23:04Z", "timestamp": 1702102984905 }, "is-referenced-by-count": 5, "issue": "11", "issued": { "date-parts": [ [ 2021, 6, 24 ] ] }, "journal-issue": { "issue": "11", "published-online": { "date-parts": [ [ 2021, 6, 24 ] ] }, "published-print": { "date-parts": [ [ 2021, 11, 2 ] ] } }, "language": "en", "link": [ { "URL": "http://academic.oup.com/aje/advance-article-pdf/doi/10.1093/aje/kwab183/40436006/kwab183.pdf", "content-type": "application/pdf", "content-version": "am", "intended-application": "syndication" }, { "URL": "http://academic.oup.com/aje/article-pdf/190/11/2405/41025403/kwab183.pdf", "content-type": "application/pdf", "content-version": "vor", "intended-application": "syndication" }, { "URL": "http://academic.oup.com/aje/article-pdf/190/11/2405/41025403/kwab183.pdf", "content-type": "unspecified", "content-version": "vor", "intended-application": "similarity-checking" } ], "member": "286", "original-title": [], "page": "2405-2419", "prefix": "10.1093", "published": { "date-parts": [ [ 2021, 6, 24 ] ] }, "published-online": { "date-parts": [ [ 2021, 6, 24 ] ] }, "published-other": { "date-parts": [ [ 2021, 11 ] ] }, "published-print": { "date-parts": [ [ 2021, 11, 2 ] ] }, "publisher": "Oxford University Press (OUP)", "reference": [ { "DOI": "10.1016/j.micpath.2020.104228", "article-title": "In vitro testing of combined hydroxychloroquine and azithromycin on SARS-CoV-2 shows synergistic effect", "author": "Andreani", "doi-asserted-by": "crossref", "journal-title": "Microb Pathog", "key": "2021110206552741700_ref1", "volume": "145", "year": "2020" }, { "DOI": "10.1126/science.367.6485.1412", "article-title": "Race to find COVID-19 treatments accelerates", "author": "Kupferschmidt", "doi-asserted-by": "crossref", "first-page": "1412", "issue": "6485", "journal-title": "Science", "key": "2021110206552741700_ref2", "volume": "367", "year": "2020" }, { "DOI": "10.1016/j.ijantimicag.2020.106078", "article-title": "A pharmacological perspective of chloroquine in SARS-CoV-2 infection: an old drug for the fight against a new coronavirus?", "author": "Oscanoa", "doi-asserted-by": "crossref", "issue": "3", "journal-title": "Int J Antimicrob Agents", "key": "2021110206552741700_ref3", "volume": "56", "year": "2020" }, { "DOI": "10.1007/s13318-020-00640-6", "article-title": "Pharmacokinetic basis of the hydroxychloroquine response in COVID-19: implications for therapy and prevention", "author": "Tarek", "doi-asserted-by": "crossref", "first-page": "715", "issue": "6", "journal-title": "Eur J Drug Metab Pharmacokinet", "key": "2021110206552741700_ref4", "volume": "45", "year": "2020" }, { "author": "Bright", "key": "2021110206552741700_ref5" }, { "author": "Disbrow", "key": "2021110206552741700_ref6" }, { "article-title": "FDA drug safety communication: FDA cautions against use of hydroxychloroquine or chloroquine for COVID-19 outside of the hospital setting or a clinical trial due to risk of heart rhythm problems", "author": "US Food Drug Administration", "key": "2021110206552741700_ref7", "year": "24, 2020" }, { "author": "Kiley", "key": "2021110206552741700_ref8", "year": "20, 2020" }, { "author": "Recovery Collaborative Group", "key": "2021110206552741700_ref9" }, { "author": "World Health Organization", "key": "2021110206552741700_ref10", "year": "4, 2020" }, { "article-title": "Repurposed antiviral drugs for COVID-19—interim WHO SOLIDARITY trial results", "author": "Pan", "key": "2021110206552741700_ref11", "year": "2020" }, { "DOI": "10.1056/NEJMoa2022926", "article-title": "Effect of hydroxychloroquine in hospitalized patients with Covid-19", "author": "Recovery Collaborative Group", "doi-asserted-by": "crossref", "first-page": "2030", "issue": "21", "journal-title": "N Engl J Med", "key": "2021110206552741700_ref12", "volume": "383", "year": "2020" }, { "DOI": "10.1001/jama.2020.22240", "article-title": "Effect of hydroxychloroquine on clinical status at 14 days in hospitalized patients with COVID-19: a randomized clinical trial", "author": "Self", "doi-asserted-by": "crossref", "first-page": "2165", "issue": "21", "journal-title": "JAMA", "key": "2021110206552741700_ref13", "volume": "324", "year": "2020" }, { "DOI": "10.1056/NEJM200006223422506", "article-title": "A comparison of observational studies and randomized, controlled trials", "author": "Benson", "doi-asserted-by": "crossref", "first-page": "1878", "issue": "25", "journal-title": "N Engl J Med", "key": "2021110206552741700_ref14", "volume": "342", "year": "2000" }, { "DOI": "10.1016/j.jclinepi.2020.04.016", "article-title": "COVID-19 coronavirus research has overall low methodological quality thus far: case in point for chloroquine/hydroxychloroquine", "author": "Alexander", "doi-asserted-by": "crossref", "first-page": "120", "journal-title": "J Clin Epidemiol", "key": "2021110206552741700_ref15", "volume": "123", "year": "2020" }, { "DOI": "10.1016/j.cmi.2020.08.022", "article-title": "Effect of hydroxychloroquine with or without azithromycin on the mortality of coronavirus disease 2019 (COVID-19) patients: a systematic review and meta-analysis", "author": "Fiolet", "doi-asserted-by": "crossref", "first-page": "19", "issue": "1", "journal-title": "Clin Microbiol Infect", "key": "2021110206552741700_ref16", "volume": "27", "year": "2021" }, { "DOI": "10.1016/j.dsx.2020.05.017", "article-title": "Hydroxychloroquine in patients with COVID-19: a systematic review and meta-analysis", "author": "Singh", "doi-asserted-by": "crossref", "first-page": "589", "issue": "4", "journal-title": "Diabetes Metab Syndr", "key": "2021110206552741700_ref17", "volume": "14", "year": "2020" }, { "DOI": "10.7326/M20-2496", "article-title": "Hydroxychloroquine or chloroquine for treatment or prophylaxis of COVID-19: a living systematic review", "author": "Hernandez", "doi-asserted-by": "crossref", "first-page": "287", "issue": "4", "journal-title": "Ann Intern Med", "key": "2021110206552741700_ref18", "volume": "173", "year": "2020" }, { "DOI": "10.1016/j.lfs.2020.117775", "article-title": "Masand N. A systematic review on use of aminoquinolines for the therapeutic management of COVID-19: efficacy, safety and clinical trials", "author": "Patil", "doi-asserted-by": "crossref", "journal-title": "Life Sci", "key": "2021110206552741700_ref19", "volume": "254", "year": "2020" }, { "author": "Magagnoli", "first-page": "114", "key": "2021110206552741700_ref20", "volume-title": "Med (N Y)", "year": "2020" }, { "DOI": "10.7326/M20-1223", "article-title": "A rush to judgment? Rapid reporting and dissemination of results and its consequences regarding the use of hydroxychloroquine for COVID-19", "author": "Kim", "doi-asserted-by": "crossref", "first-page": "819", "issue": "12", "journal-title": "Ann Intern Med", "key": "2021110206552741700_ref21", "volume": "172", "year": "2020" }, { "DOI": "10.1002/pds.5029", "article-title": "Considerations for pharmacoepidemiological analyses in the SARS-CoV-2 pandemic", "author": "Pottegård", "doi-asserted-by": "crossref", "first-page": "825", "issue": "8", "journal-title": "Pharmacoepidemiol Drug Saf", "key": "2021110206552741700_ref22", "volume": "29", "year": "2020" }, { "DOI": "10.1001/jamainternmed.2020.2402", "article-title": "Need for transparency and reliable evidence in emergency use authorizations for coronavirus disease 2019 (COVID-19) therapies", "author": "Zhai", "doi-asserted-by": "crossref", "first-page": "1145", "issue": "9", "journal-title": "JAMA Intern Med", "key": "2021110206552741700_ref23", "volume": "180", "year": "2020" }, { "DOI": "10.1080/00273171.2011.568786", "article-title": "An introduction to propensity score methods for reducing the effects of confounding in observational studies", "author": "Austin", "doi-asserted-by": "crossref", "first-page": "399", "issue": "3", "journal-title": "Multivariate Behav Res", "key": "2021110206552741700_ref24", "volume": "46", "year": "2011" }, { "DOI": "10.1002/sim.3782", "article-title": "Improving propensity score weighting using machine learning", "author": "Lee", "doi-asserted-by": "crossref", "first-page": "337", "issue": "3", "journal-title": "Stat Med", "key": "2021110206552741700_ref25", "volume": "29", "year": "2010" }, { "DOI": "10.1037/1082-989X.9.4.403", "article-title": "Propensity score estimation with boosted regression for evaluating causal effects in observational studies", "author": "McCaffrey", "doi-asserted-by": "crossref", "first-page": "403", "issue": "4", "journal-title": "Psychol Methods", "key": "2021110206552741700_ref26", "volume": "9", "year": "2004" }, { "DOI": "10.1097/EDE.0000000000000734", "article-title": "The right tool for the job: choosing between covariate-balancing and generalized boosted model propensity scores", "author": "Setodji", "doi-asserted-by": "crossref", "first-page": "802", "issue": "6", "journal-title": "Epidemiology", "key": "2021110206552741700_ref27", "volume": "28", "year": "2017" }, { "DOI": "10.1016/j.gie.2019.04.236", "article-title": "Propensity score methods to control for confounding in observational cohort studies: a statistical primer and application to endoscopy research", "author": "Yang", "doi-asserted-by": "crossref", "first-page": "360", "issue": "3", "journal-title": "Gastrointest Endosc", "key": "2021110206552741700_ref28", "volume": "90", "year": "2019" }, { "DOI": "10.1016/j.jclinepi.2009.11.020", "article-title": "Propensity score estimation: machine learning and classification methods as alternatives to logistic regression", "author": "Westreich", "doi-asserted-by": "crossref", "first-page": "826", "issue": "8", "journal-title": "J Clin Epidemiol", "key": "2021110206552741700_ref29", "volume": "63", "year": "2011" }, { "DOI": "10.7326/M18-3079", "article-title": "Graphical depiction of longitudinal study designs in health care databases", "author": "Schneeweiss", "doi-asserted-by": "crossref", "first-page": "398", "issue": "6", "journal-title": "Ann Intern Med", "key": "2021110206552741700_ref30", "volume": "170", "year": "2019" }, { "article-title": "A natural language processing system for national COVID-19 surveillance in the US Department of Veterans Affairs", "author": "Chapman", "key": "2021110206552741700_ref31", "year": "2020" }, { "DOI": "10.1186/1478-7954-4-2", "article-title": "Accuracy and completeness of mortality data in the Department of Veterans Affairs", "author": "Sohn", "doi-asserted-by": "crossref", "first-page": "2", "issue": "1", "journal-title": "Popul Health Metr", "key": "2021110206552741700_ref32", "volume": "4", "year": "2006" }, { "DOI": "10.1093/gerona/gly232", "article-title": "The burden of frailty among U.S. veterans and its association with mortality, 2002–2012", "author": "Orkaby", "doi-asserted-by": "crossref", "first-page": "1257", "issue": "8", "journal-title": "J Gerontol A Biol Sci Med Sci", "key": "2021110206552741700_ref33", "volume": "74", "year": "2019" }, { "author": "R Core Team", "key": "2021110206552741700_ref34", "volume-title": "R: A Language and Environment for Statistical Computing, release 3.6.1", "year": "2019" }, { "DOI": "10.1016/j.csda.2013.10.025", "article-title": "Recursive partitioning for missing data imputation in the presence of interaction effects", "author": "Doove", "doi-asserted-by": "crossref", "first-page": "92", "journal-title": "Comput Stat Data Anal", "key": "2021110206552741700_ref35", "volume": "72", "year": "2014" }, { "DOI": "10.18637/jss.v045.i03", "article-title": "Mice: multivariate imputation by chained equations", "author": "Buuren", "doi-asserted-by": "crossref", "key": "2021110206552741700_ref36" }, { "DOI": "10.1002/sim.4780100410", "article-title": "Multiple imputation in health-care databases: an overview and some applications", "author": "Rubin", "doi-asserted-by": "crossref", "first-page": "585", "issue": "4", "journal-title": "Stat Med", "key": "2021110206552741700_ref37", "volume": "10", "year": "1991" }, { "author": "Hastie", "first-page": "1", "key": "2021110206552741700_ref38", "volume-title": "In: The Elements of Statistical Learning. Springer Series in Statistics", "year": "2009" }, { "article-title": "Gbm: generalized boosted regression models", "author": "Greenwell", "key": "2021110206552741700_ref39" }, { "article-title": "WeightIt: weighting for covariate balance in observational studies", "author": "Greifer", "key": "2021110206552741700_ref40" }, { "article-title": "Cobalt: covariate balance tables and plots", "author": "Greifer", "key": "2021110206552741700_ref41" }, { "article-title": "Gradient boosting machines, a tutorial", "author": "Natekin", "first-page": "21", "issue": "Dec", "journal-title": "Front Neurorobot", "key": "2021110206552741700_ref42", "volume": "7", "year": "2013" }, { "article-title": "Survival: a package for survival analysis in S", "author": "Therneau", "key": "2021110206552741700_ref43" }, { "DOI": "10.1002/sim.5753", "article-title": "A tutorial on propensity score estimation for multiple treatments using generalized boosted models", "author": "McCaffrey", "doi-asserted-by": "crossref", "first-page": "3388", "issue": "19", "journal-title": "Stat Med", "key": "2021110206552741700_ref44", "volume": "32", "year": "2013" }, { "DOI": "10.1002/pds.4325", "article-title": "Comparison of the ability of double-robust estimators to correct bias in propensity score matching analysis. A Monte Carlo simulation study", "author": "Nguyen", "doi-asserted-by": "crossref", "first-page": "1513", "issue": "12", "journal-title": "Pharmacoepidemiol Drug Saf.", "key": "2021110206552741700_ref45", "volume": "26", "year": "2017" }, { "key": "2021110206552741700_ref46" }, { "DOI": "10.1002/sim.6607", "article-title": "Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies", "author": "Austin", "doi-asserted-by": "crossref", "first-page": "3661", "issue": "28", "journal-title": "Stat Med", "key": "2021110206552741700_ref47", "volume": "34", "year": "2015" }, { "DOI": "10.1001/jama.2020.8630", "article-title": "Association of treatment with hydroxychloroquine or azithromycin with in-hospital mortality in patients with COVID-19 in New York state", "author": "Rosenberg", "doi-asserted-by": "crossref", "first-page": "2493", "issue": "24", "journal-title": "JAMA", "key": "2021110206552741700_ref48", "volume": "323", "year": "2020" }, { "DOI": "10.1158/2159-8290.CD-20-0941", "article-title": "Utilization of COVID-19 treatments and clinical outcomes among patients with cancer: a COVID-19 and Cancer Consortium (CCC19) cohort study", "author": "Rivera", "doi-asserted-by": "crossref", "first-page": "1514", "issue": "10", "journal-title": "Cancer Discov", "key": "2021110206552741700_ref49", "volume": "10", "year": "2020" }, { "DOI": "10.1101/2020.06.16.20132597", "article-title": "Hydroxychloroquine with or without azithromycin and in-hospital mortality or discharge in patients hospitalized for COVID-19 infection: a cohort study of 4,642 in-patients in France", "author": "Sbidian", "doi-asserted-by": "crossref", "key": "2021110206552741700_ref50", "year": "2020" }, { "DOI": "10.1016/j.ijid.2020.06.099", "article-title": "Treatment with hydroxychloroquine, azithromycin, and combination in patients hospitalized with COVID-19", "author": "Arshad", "doi-asserted-by": "crossref", "first-page": "396", "issue": "0", "journal-title": "Int J Infect Dis", "key": "2021110206552741700_ref51", "volume": "97", "year": "2020" }, { "DOI": "10.1016/j.ijid.2020.06.095", "article-title": "An observational cohort study of hydroxychloroquine and azithromycin for COVID-19: (can't get no) satisfaction", "author": "Lee", "doi-asserted-by": "crossref", "first-page": "216", "journal-title": "Int J Infect Dis", "key": "2021110206552741700_ref52", "volume": "98", "year": "2020" }, { "author": "", "key": "2021110206552741700_ref53", "volume-title": "Catalogue of Bias 2017" }, { "DOI": "10.15585/mmwr.mm6935a4", "article-title": "Hydroxychloroquine and chloroquine prescribing patterns by provider specialty following initial reports of potential benefit for COVID-19 treatment - United States, January-June 2020", "author": "Bull-Otterson", "doi-asserted-by": "crossref", "first-page": "1210", "issue": "35", "journal-title": "MMWR Morb Mortal Wkly Rep", "key": "2021110206552741700_ref54", "volume": "69", "year": "2020" }, { "DOI": "10.1371/journal.pmed.1003379", "article-title": "Patterns of COVID-19 testing and mortality by race and ethnicity among United States veterans: a nationwide cohort study", "author": "Rentsch", "doi-asserted-by": "crossref", "issue": "9", "journal-title": "PLoS Med", "key": "2021110206552741700_ref55", "volume": "17", "year": "2020" }, { "DOI": "10.1056/NEJMoa2012410", "article-title": "Observational study of hydroxychloroquine in hospitalized patients with Covid-19", "author": "Geleris", "doi-asserted-by": "crossref", "first-page": "2411", "issue": "25", "journal-title": "N Engl J Med", "key": "2021110206552741700_ref56", "volume": "382", "year": "2020" }, { "DOI": "10.1177/1740774507087703", "article-title": "Estimating effects from randomized trials with discontinuations: the need for intent-to-treat design and G-estimation", "author": "Greenland", "doi-asserted-by": "crossref", "first-page": "5", "issue": "1", "journal-title": "Clin Trials", "key": "2021110206552741700_ref57", "volume": "5", "year": "2008" } ], "reference-count": 57, "references-count": 57, "relation": {}, "resource": { "primary": { "URL": "https://academic.oup.com/aje/article/190/11/2405/6308675" } }, "score": 1, "short-title": [], "source": "Crossref", "subject": [ "Epidemiology" ], "subtitle": [], "title": "Pharmacoepidemiology, Machine Learning, and COVID-19: An Intent-to-Treat Analysis of Hydroxychloroquine, With or Without Azithromycin, and COVID-19 Outcomes Among Hospitalized US Veterans", "type": "journal-article", "volume": "190" }