Frequentist and Bayesian analysis methods for case series data and application to early outpatient COVID-19 treatment case series of high risk patients
Ph.D Eleftherios Gkioulekas, MD, MPH Peter A Mccullough, MD Vladimir Zelenko
When confronted with a public health emergency, significant innovative treatment protocols can sometimes be discovered by medical doctors at the front lines based on repurposed medications. We propose a very simple hybrid statistical framework for analyzing the case series of patients treated with such new protocols, that enables a comparison with our prior knowledge of expected outcomes, in the absence of treatment. The goal of the proposed methodology is not to provide a precise measurement of treatment efficacy, but to establish the existence of treatment efficacy, in order to facilitate the binary decision of whether the treatment protocol should be adopted on an emergency basis. The methodology consists of a frequentist component that compares a treatment group against the probability of an adverse outcome in the absence of treatment, and calculates an efficacy threshold that has to be exceeded by this probability, in order to control the corresponding p-value, and reject the null hypothesis. The efficacy threshold is further adjusted with a Bayesian technique, in order to also control the false positive rate. A selection bias threshold is then calculated from the efficacy threshold to control for random selection bias. Exceeding the efficacy threshold establishes efficacy by the preponderance of evidence, and exceeding the more demanding selection bias threshold establishes efficacy by the clear and convincing evidentiary standard. The combined techniques are applied to case series of high-risk COVID-19 outpatients, that were treated using the early Zelenko protocol and the more enhanced McCullough protocol. The resulting efficacy thresholds are then compared against our prior knowledge of mortality and hospitalization rates of untreated high-risk COVID-19 patients, as reported in the research literature.
Author contributions EG conceptualized the mathematical framework, analyzed the case series data, and wrote the first draft of the paper. PAC and VZ contributed to the literature review, as well as writing and editorial changes to the manuscript. VZ contributed copies of his three public letters [16, 17, 24] , attached to our supplementary material document [25] , containing some of the consecutive case series data analyzed in the manuscript. VZ also contributed data on how his treatment protocol evolved over time during 2020. All authors read and approved the final version of the manuscript.
Ethics approval and consent to participate Not applicable.
Conflict of interest The authors declare no conflicts of interest. Peter A. Mc-Cullough is serving as the editor-in-chief of this journal. Appendix A: Exact Fisher test in the limit of an infinite control group Let N be the total number of patients in the treatment group, let a be the number of patients with an adverse outcome (hospitalization or death) in the treatment group, let M be the total number of patients in the control group, and let b be the number of patients in the control group with an adverse outcome. In this appendix we will show that in the limit of an infinite control group (M, b) with x = b/M, the p-value p(N, a, M, b) obtained from the two-tail exact Fisher test converges to p(N, a, x). In the exact Fisher test, we assume that N, M, and a + b, are fixed numbers, and under the null hypothesis, we also..
References
Balakrishnan, Price, Luu, Biochemical Characterization of Respiratory Syncytial Virus RNA-Dependent RNA Polymerase Complex ACS, Infectious Diseases
Barda, Riesel, Akriv, Developing a COVID-19 mortality risk prediction model when individual-level data are not available, Nature Communications
Battineni, Sagaro, Chintalapudi, Amenta, Tomassoni et al., Impact of Obesity-Induced Inflammation on Cardiovascular Diseases (CVD), International Journal of Molecular Sciences
Benjamin, Berger, Three Recommendations for Improving the Use of p-Values The American Statistician
Berger, Could Fisher, Jeffreys, and Neyman have agreed on testing, Statistical Science
Biancatelli, Berrill, Marik, The antiviral properties of vitamin C Expert Review of Anti-infective Therapy
Biancatelli1, Berrill, Catravas, Marik, Quercetin and Vitamin C: An Experimental, Synergistic Therapy for the Prevention and Treatment of SARS-CoV-2 Related Disease (COVID-19), Frontiers in Immunology
Bryant, Lawrie, Dowswell, Ivermectin for Prevention and Treatment of COVID-19 Infection: A Systematic Review, Meta-analysis, and Trial Sequential Analysis to Inform Clinical Guidelines American, Journal of Therapeutics
Burrows, The abortive treatment of influenza with quinine dihydrochloride Medical Record
Caly, Druce, Catton, Jans, Wagstaff, The FDA-approved drug ivermectin inhibits the replication of SARS-CoV-2 in vitro Antiviral Research
Chetty, Elucidating the pathogenesis and Rx of COVID reveals a missing element Modern, Medicine
Clopper, Pearson, The use of confidence or fiducial limits illustrated in the case of the binomial, Biometrika
Collins, Bowman, Landray, Peto, The Magic of Randomization versus the Myth of Real-World Evidence New England, Journal of Medicine
Colquhoun, The False Positive Risk: A Proposal Concerning What to Do About p-Values The American Statistician
Dabbagh-Bazarbachi, Clergeaud, Quesada, Ortiz, O'sullivan et al., Zinc Ionophore Activity of Quercetin and Epigallocatechin-gallate: From Hepa 1-6 Cells to a Liposome Model, Journal of Agricultural and Food Chemistry
Dashti, Roche, Bates, Mora, Demler, SARS-2 simplified scores to estimate risk of hospitalization and death among patients with COVID-19 Nature Scientific Reports
Deaton, Cartwright, Understanding and misunderstanding randomized controlled trials Social Science and, Medicine
Derwand, Scholz, Does zinc supplementation enhance the clinical efficacy of chloroquine/hydroxychloroquine to win today's battle against COVID-19?, Medical Hypotheses
Dubee, Roy, Vielle, Hydroxychloroquine in mild-to-moderate coronavirus disease 2019: a placebocontrolled double blind trial Clinical Microbiology and Infection
Fonseca, Sousa, Wolkoff, Risk of hospitalization for COVID-19 outpatients treated with various drug regimens in Brazil: Comparative analysis Travel Medicine and, Infectious Disease
Frieden, Evidence for Health Decision Making -Beyond Randomized, Controlled Trials New England Journal of Medicine
Galvez, Zanni, Galvez-Llompart, Benlloch, Macrolides May Prevent Severe Acute Respiratory Syndrome Coronavirus 2 Entry into Cells: A Quantitative Structure Activity Relationship Study and Experimental Validation Journal of Chemical Information and Modeling
Gautret, Lagier, Parola, Hydroxychloroquine and azithromycin as a treatment of COVID-19: Results of an openlabel non-randomized clinical trial International Journal of Antimicrobial Agents
Gavriilaki, Anyfanti, Gavriilaki, Lazaridis, Douma et al., Endothelial Dysfunction in COVID-19: Lessons Learned from Coronaviruses Current Hypertension Reports
Gkioulekas, Supplementary material: Frequentist and Bayesian analysis methods for case series data and application to early outpatient COVID-19 treatment case series of high risk patients,
doi:10.6084/m9.figshare.19364699.v3Goodman, Toward evidence-based medical statistics. 1: The P value fallacy Annals of Internal Medicine
Goodman, Toward evidence-based medical statistics. 2: The Bayes factor Annals of Internal Medicine
Grant, Lahore, Mcdonnell, Evidence that Vitamin D Supplementation Could Reduce Risk of Influenza and COVID-19 Infections and Deaths Nutrients
Harbi, Al, Al, Al, Clinical and laboratory characteristics of patients hospitalized with COVID-19: Clinical outcomes in Abu Dhabi, United Arab Emirates BMC Infectious Diseases
Hatfill, The Intentional Destruction of the National Pandemic Plan Journal of the American Physicians and Surgeons
Hazan, Dave, Gunaratne, Effectiveness of ivermectin-based multidrug therapy in severely hypoxic, ambulatory COVID-19 patients Frontiers in Medicine,
doi:10.2217/fmb-2022-0014Heras, Garibaldi, Boix, COVID-19 mortality risk factors in older people in a long-term care center European, Geriatric Medicine
Hill, The Environment and Disease: Association or Causation?, Proceedings of the Royal Society of Medicine
Hong, On computing the distribution function for the Poisson binomial distribution Computational Statistics and Data Analysis
Iuliano, Chang, Patel, Estimating underrecognized COVID-19 deaths, United States, March 2020-May 2021 using an excess mortality modelling approach Lancet Region, Health -Americas
Jeffreys, The Theory of Probability
Jehi, Ji, Milinovich, Development and validation of a model for individualized prediction of hospitalization risk in 4,536 patients with COVID-19, PLoS ONE
Kass, Raftery, Bayes Factors Journal of the American Statistical Association
Kompaniyets, Goodman, Belay, Body Mass Index and Risk for COVID-19-Related Hospitalization, Intensive Care Unit Admission, Invasive Mechanical Ventilation, and Death -United States, Morbidity and Mortality Weekly Report
Kory, Meduri, Gianfranco, Varon, Iglesias et al., Review of the Emerging Evidence Demonstrating the Efficacy of Ivermectin in the Prophylaxis and Treatment of COVID-19 American, Journal of Therapeutics
Kory, Meduri, Iglesias, Varon, Cadegiani et al., MATH+ Multi-Modal Hospital Treatment Protocol for COVID-19 Infection: Clinical and Scientific Rationale, Journal of Clinical Medicine Research
Lawrence, Cai, Tony, Anirban, Interval Estimation for a Binomial Proportion Statistical, Science
Leemis, Luckett, Powell, Vermeer, Univariate Probability Distributions Journal of Statistical Education
Leemis, Mcqueston, Univariate Distribution Relationships The American Statistician
Lei, Zhang, Schiavon, SARS-CoV-2 Spike Protein Impairs Endothelial Function via Downregulation of ACE 2, Circulation Research
Lopez-Blazquez, Mino, Salamanca, Binomial approximation to hypergeometric probabilities Journal of Statistical Planning and Inference
Marik, Kory, Ivermectin, A Reanalysis of the Data American Journal of Therapeutics
Marik, Kory, Varon, Iglesias, Meduri, MATH+ protocol for the treatment of SARS-CoV-2 infection: the scientific rationale Expert Review of Anti-infective Therapy
Maxima, Maxima, None, a Computer Algebra System
Mccullough, Alexander, Armstrong, Multifaceted highly targeted sequential multidrug treatment of early ambulatory high-risk SARS-CoV-2 infection (COVID-19) Reviews in Cardiovascular Medicine
Mccullough, Innovative Early Sequenced Multidrug Therapy for SARS-CoV-2 (COVID-19) Infection to Reduce Hospitalization and Death International Journal of Medical Science and Clinical invention
Mccullough, Kelly, Ruocco, Pathophysiological Basis and Rationale for Early Outpatient Treatment of SARS-CoV-2 (COVID-19) Infection, The American Journal of Medicine
Mercola, Grant, Wagner, Evidence Regarding Vitamin D and Risk of COVID-19 and Its Severity Nutrients
Merritt, The Treatment of Viral Diseases: Has the Truth Been Suppressed For Decades? Journal of the American Physicians and Surgeons
Million, Lagier, Tissot-Dupont, Early Treatment with Hydroxychloroquine and Azithromycin in 10,429 COVID-19 Outpatients: A Monocentric Retrospective Cohort Study Reviews in, Cardiovascular Medicine
Morey, Romeijn, Rouder, The philosophy of Bayes factors and the quantification of statistical evidence Journal of Mathematical Psychology
Mucchielli, Behind the French controversy over the medical treatment of Covid-19: The role of the drug industry, Journal of Sociology
Muhlberger, Filovirus replication and transcription Future, Virology
Onder, Rezza, Brusaferro, Case-Fatality Rate and Characteristics of Patients Dying in Relation to COVID-19 in Italy Journal of the American, Medical Association
Palazzuoli, Ruberto, Ferrari, De, Inpatient mortality according to level of respiratory support received for severe acute respiratory syndrome coronavirus 2 (coronavirus disease 2019) infection: A prospective multicenter study Critical Care Explorations
Park, Leemis, Ensemble Confidence Intervals for Binomial Proportions Statistics in, Medicine
Poly, Islam, Yang, Obesity and Mortality Among Patients Diagnosed With COVID-19: A Systematic Review and Meta-Analysis Frontiers in, Medicine
Procter, Ross, Pickard, Smith, Hanson et al., Clinical outcomes after early ambulatory multidrug therapy for high-risk SARS-CoV-2 (COVID-19) infection Reviews in Cardiovascular Medicine
Procter, Ross, Pickard, Smith, Hanson et al., Early Ambulatory Multidrug Therapy Reduces Hospitalization and Death in High-Risk Patients with SARS-CoV-2 (COVID-19), International Journal of Innovative Research in Medical Science
Reese, Iuliano, Patel, Estimated Incidence of Coronavirus Disease 2019 (COVID-19) Illness and Hospitalization-United States, Clinical Infectious Diseases
Reiczigel, Confidence intervals for the binomial parameter: some new considerations Statistics in, Medicine
Risch, Early Outpatient Treatment of Symptomatic, High-Risk COVID-19 Patients that Should be Ramped-Up Immediately as Key to the Pandemic Crisis, American Journal of Epidemiology
Risch, Hydroxychloroquine in Early Treatment of High Risk COVID-19 Outpatients: Efficacy and Safety Evidence Sixth version
Risch, None
Risch, The author replies American Journal of, Epidemiology
Rudrapal, Khairnar, Jadhav, Drug Repurposing (DR): An Emerging Approach in Drug Discovery in Drug Repurposing
Santi, Scheim, Mccullough, Yagisawa, Borody, Ivermectin: a multifaceted drug of Nobel prizehonoured distinction with indicated efficacy against a new global scourge, COVID-19 New Microbes and New Infections
Scholz, Derwand, Zelenko, COVID-19 outpatients -Early risk-stratified treatment with zinc plus low dose hydroxychloroquine and azithromycin: A retrospective case series study, International Journal of Antimicrobial Agents,
doi:10.1016/j.ijantimicag.2020.106214Sherman, Anderson, Pan, Real-World Evidence -What Is It and What Can It Tell Us?, New England Journal of Medicine
Siddiqi, Libby, Ridker, COVID-19 -A vascular disease Trends in, Cardiovascular Medicine
Smith, COVID-19: Up close and personal Journal of the American Physicians and Surgeons
Sterne, Some remarks on confidence or fiducial limits, Biometrika
Stricker, Fesler, A novel plan to deal with SARS-CoV-2 and COVID-19 disease, Journal of Medical Virology
Tyson, Fareed, Overcoming the Covid darkness
Ulhaq, Soraya, Interleukin-6 as a potential biomarker of COVID-19 progression Medecine et Maladies Infectieuses
Vahidy, Drews, Masud, Characteristics and outcomes of COVID-19 patients during initial peak and resurgence in the Houston metropolitan area Journal of the American Medical Association
Velthuis, Te, Fodor, Influenza virus RNA polymerase: insights into the mechanisms of viral RNA synthesis Nature Reviews, Microbiology
Verity, Okell, Dorigatti, Estimates of the severity of coronavirus disease 2019: A model-based analysis, The Lancet Infectious Diseases
Vidgen, Yasseri, P-Values: Misunderstood and Misused Frontiers in Physics
Vincent, Bergeron, Benjannet, Chloroquine is a potent inhibitor of SARS coronavirus infection and spread, Virology Journal
Vollset, Confidence intervals for a binomial proportion Statistics in, Medicine
Wasserstein, Lazar, The ASA's statement on pvalues: context, process, and purpose The American Statistician
Wessels, Rolles, Rink, The Potential Impact of Zinc Supplementation on COVID-19 Pathogenesis Frontiers in Immunology
Westbrock, COVID-19: Reflections on the disease and the response Journal of the American Physicians and Surgeons
Yu, Weng, Wu, The lifecycle of the Ebola virus in host cells Oncotarget
Zaidi, Dehgani-Mobaraki, The mechanisms of action of ivermectin against SARS-CoV-2. An extensive review The Journal of Antibiotics
Zelenko, Correspondence from Dr Vladimir Zelenko on Treatment of COVID-19
Zelenko, To Dr, Bar, Tov, None
Zelenko, To all medical professionals around the world
{ 'institution': [{'name': 'Authorea, Inc.'}],
'indexed': {'date-parts': [[2022, 5, 16]], 'date-time': '2022-05-16T14:41:51Z', 'timestamp': 1652712111911},
'posted': {'date-parts': [[2022, 5, 16]]},
'group-title': 'Preprints',
'reference-count': 0,
'publisher': 'Authorea, Inc.',
'content-domain': {'domain': [], 'crossmark-restriction': False},
'accepted': {'date-parts': [[2022, 5, 16]]},
'abstract': '<jats:p id="p1">When confronted with a public health emergency, significant innovative\n'
'treatment protocols can sometimes be discovered by medical doctors at\n'
'the front lines based on repurposed medications. We propose a very\n'
'simple hybrid statistical framework for analyzing the case series of\n'
'patients treated with such new protocols, that enables a comparison with\n'
'our prior knowledge of expected outcomes, in the absence of treatment.\n'
'The goal of the proposed methodology is not to provide a precise\n'
'measurement of treatment efficacy, but to establish the existence of\n'
'treatment efficacy,\xa0 in order to facilitate the binary decision of\n'
'whether the treatment protocol should be adopted\xa0 on an emergency basis.\n'
'The methodology consists of a frequentist component that compares a\n'
'treatment group against the\xa0 probability of an adverse outcome in the\n'
'absence of treatment, and calculates an efficacy threshold that has to\n'
'be exceeded by this\xa0 probability, in order to control the corresponding\n'
'$p$-value, and reject the null hypothesis. The\xa0 efficacy threshold is\n'
'further adjusted with a Bayesian technique, in order to also control the\n'
'false positive rate. A selection bias threshold is then calculated from\n'
'the efficacy threshold to control for random selection bias. Exceeding\n'
'the efficacy threshold establishes efficacy by the preponderance of\n'
'evidence, and exceeding the more demanding selection bias threshold\n'
'establishes efficacy by the clear and convincing evidentiary standard.\n'
'The combined techniques are applied to case series of high-risk COVID-19\n'
'outpatients, that were treated using the early Zelenko protocol and the\n'
'more enhanced McCullough protocol. The resulting efficacy thresholds are\n'
'then compared against our prior knowledge of mortality and\n'
'hospitalization rates of untreated high-risk COVID-19 patients, as\n'
'reported in the research literature.</jats:p>',
'DOI': '10.22541/au.164745391.17821933/v2',
'type': 'posted-content',
'created': {'date-parts': [[2022, 5, 16]], 'date-time': '2022-05-16T14:17:12Z', 'timestamp': 1652710632000},
'source': 'Crossref',
'is-referenced-by-count': 0,
'title': 'Frequentist and Bayesian analysis methods for case series data and application to early '
'outpatient COVID-19 treatment case series\xa0 of high risk patients',
'prefix': '10.22541',
'author': [ { 'ORCID': 'http://orcid.org/0000-0002-5437-2534',
'authenticated-orcid': True,
'given': 'Eleftherios',
'family': 'Gkioulekas',
'sequence': 'first',
'affiliation': [ { 'name': 'Professor, School of Mathematical and Statistical Sciences, '
'University of Texas Rio Grande Valley, Edinburg, TX, United '
'States'}]},
{ 'given': 'Peter A',
'family': 'McCullough',
'sequence': 'additional',
'affiliation': [ { 'name': 'Chief Medical Advisor, Truth for Health Foundation, Tucson AZ, '
'United States'}]},
{ 'given': 'Vladimir',
'family': 'Zelenko',
'sequence': 'additional',
'affiliation': [ { 'name': 'Affiliate Physician, Columbia University Irving Medical Center, '
'New York City, NY, United States'}]}],
'member': '9829',
'container-title': [],
'original-title': [],
'deposited': { 'date-parts': [[2022, 5, 16]],
'date-time': '2022-05-16T14:17:12Z',
'timestamp': 1652710632000},
'score': 1,
'resource': { 'primary': { 'URL': 'https://www.authorea.com/users/465688/articles/560189-frequentist-and-bayesian-analysis-methods-for-case-series-data-and-application-to-early-outpatient-covid-19-treatment-case-series-of-high-risk-patients?commit=63377a66728af3877844b8264256725632480a41'}},
'subtitle': [],
'short-title': [],
'issued': {'date-parts': [[2022, 5, 16]]},
'references-count': 0,
'URL': 'http://dx.doi.org/10.22541/au.164745391.17821933/v2',
'relation': { 'is-version-of': [ { 'id-type': 'doi',
'id': '10.22541/au.164745391.17821933/v1',
'asserted-by': 'subject'}]},
'published': {'date-parts': [[2022, 5, 16]]},
'subtype': 'preprint'}
