ASA Connect

 View Only
  • 1.  Preparing Statistically for the Next Severe Epidemic

    Posted 20 days ago
    The next severe epidemic will demand more than clinical and public-health capacity. It will also need rapid, credible statistical work - surveillance design, modeling under uncertainty, data quality assessment, study design under time pressure, and clear communication of risk to decision-makers and the public.
    I want to start a practical discussion among ASA members about what our profession should be doing now, before the next crisis. This is not about personal health precautions. It's about what we bring as statisticians, biostatisticians, data scientists, survey researchers, and methodologists.
    Some questions worth asking:
    What can we do now to prepare - in methods, infrastructure, training, or standing relationships with agencies and health systems?
    What do we need from others to do our part well?
    What should we be ready to supply when the time comes: rapid peer review, volunteer analytic capacity, data-quality standards, modeling support, plain-language uncertainty communication for decision-makers?
    What role would ASA, its sections, committees, and chapters play at the federal, state, and local level?
    How do we keep data collection and public communication scientifically sound, transparent, and privacy-protective under crisis pressure?
    Are there existing efforts within ASA or elsewhere that we should connect with rather than duplicate?
    What other questions should we be asking now?
    We need concrete thinking: what should ASA members, chapters, sections, and committees actually do over the next 6–12 months so our profession is genuinely ready when the next severe epidemic hits?


    ------------------------------
    Alan Forsythe, PHD
    Fellow ASA
    ------------------------------


  • 2.  RE: Preparing Statistically for the Next Severe Epidemic

    Posted 19 days ago

    Please add me to the discussions. I was involved in the COVID response, and I have thoughts about what needs to be done.



    ------------------------------
    David Harris
    Program Analyst
    State of Montana
    ------------------------------



  • 3.  RE: Preparing Statistically for the Next Severe Epidemic

    Posted 19 days ago

    What an intruiging and insightful question!  I look forward to a fascinating discussion.

    I'll offer my two cents. For background, I'm a family physician with an MS in statistics from Texas A&M.  Throughout the first 4 years of the pandemic, I was serving as medical director of our county health department, population about 200K. About 100 employees; that was augmented dramatically--practically doubled--as part of the emergency response, with "just in time training" for case investigation, etc. No one in the department had much formal quantitative training, and pre-pandemic, no one had any definite, assigned responsibilities for large-scale data management, statistical analyses or quantitative epidemiology. And most times, that seemed to work out OK. Until it didn't.  The medical director did not traditionally have those responsibilities either; just not part of the portfolio. But since I had the training and the interest, I took this on.

    Since retiring from the above full-time duties, I work as a solo consultant, trying to support public service agencies, like health departments, with their quantitative needs.

    So my perspective is from local (and somewhat from state) public health. The view might be different from the federal level (though perhaps not much---see below.) 

    Please forgive me for painting with a very broad brush here. Clearly there are nuances and all manner of variations. I'm hoping my opinions and generalizations might be informative for those with little experience in public health. 

    Last time I conducted an informal poll, there was not a single statistician in any county health department in my state, outside of NYC. (I can't speak to who/what the NYC health department has.)

    I like to make a distinction between "retail" and "wholesale."  Treating one patient in your exam room is retail. So is treating one family. So is tracking down 8-12 people who were exposed to invasive meningococcal disease and now need some antibiotic prophylaxis. "Wholesale" is getting 600 reports of new COVID-19 cases *every day*.  In their day-to-day work, local health departments (LHDs) mostly do retail. They are very good at it. But doing "wholesale" requires a different mindset, different processes/procedures, and different tools, which LHD staff and leadership may not be familiar with.  Trying to do retail at extremely high volumes and extremely high speed is not the same as wholesale. And it usually fails.

    Despite all the buzz in public health about "data modernization", most LHDs will be using spreadsheets (usually with unstructured free-text columns, sadly), telephones, fax machines, and human staff. REDCap is gaining some ground with state health departments and some counties, but slowly. Even the CDC Division of Global Migration and Quarantine, to inform LHDs of returning travelers who need to be monitored for a while (Ebola, Andes hantavirus, and other things you see in the news) are in the habit of emailing messy spreadsheets, each with a couple lines, on a daily basis.

    Sometimes outbreaks develop and evolve very rapidly. LHD staff and their data collection processes must keep up with the pace of change. There is often more attention paid to getting data into whatever system they are using, than to how/whether those data will be usable for analysis at the output end. This is very different from a prospective RCT, which you may spend months/years planning for before launching it.

    Given all the above, skills for handing messy data are essential for statisticians working with LHDs. Also skills to help them make little changes to make the data less messy right at input, if this can be done in an extremely dynamic situation.

    For some reason, LHD folks like to dichotomize. It may relate to the fundamental question of epidemiology: case or non-case. At any rate, they gravitate toward recording nominal or ordinal variables (often with arbitrary cutoffs), even when interval/ratio variables are just as easily acquired and recorded. This is something statisticians could advise on and help with.



    ------------------------------
    Christopher Ryan
    Agency Statistical Consulting, LLC
    ------------------------------



  • 4.  RE: Preparing Statistically for the Next Severe Epidemic

    Posted 18 days ago

    During the COVID-19 pandemic, counts of cases and deaths were the primary surveillance data, aka "metrics," used to inform policymakers and the public about the current situation.  Case counts depend on individuals' concerns about exposure and symptoms, their decisions to be tested, test availability and requirements, and other factors.  These factors cause drop-offs in diagnosis and reporting at every step in the reporting process, so the numbers of actual cases, as well as deaths and hospitalizations are far higher than reported, varying over time and among population subgroups.

    At the beginning of the pandemic, it was necessary to make use of the available data, but for too long we relied on outdated surveillance systems.  Their widely recognized flaws no doubt contributed to the sense that public health didn't know what it was doing.  To build back trust, we need to develop new data systems that complement case counts.  Population sampling, excess mortality estimation, syndromic and wastewater surveillance, can provide a more comprehensive and accurate assessment of the pandemic's impact on different populations and as it changes over time. 

    Expanding surveillance data types beyond case reports will require the Centers for Disease Control and Prevention (CDC) to work with state health departments, hospitals, and other data providers to standardize definitions, presentation methods, and so on.  CDC has traditionally played an important leadership role by developing standard surveillance case definitions, and since the pandemic has worked to develop systems to share data with healthcare providers.  Sadly, these efforts were set aside when Robert F. Kennedy, Jr. came into office.  So an ASA effort would be very welcome!

    Population sampling

    During the COVID-19 pandemic, for instance, British health authorities implemented the REal-time Assessment of Community Transmission-1 (REACT-1) study to monitor the prevalence of SARS-CoV-2 infection.  REACT-1 obtains self-administered throat and nose swabs from a random sample of the 100,000 or more participants at ages 5 years and over every month.  Swabs are tested for SARS-CoV-2 infection and samples testing positive sent for viral genome sequencing.  This survey identified the rapid spread of the Omicron variant in areas of London and southern England in November and December 2021.  In the U.S. blood samples obtained for other clinical assessments were analyzed to track infections.

    Questionnaire-based survey's Census Bureau's Pulse Survey can help us understand the psychological, social, educational, and economic consequences of COVID-19, both in general and in different socio-demographic groups.

    Surveys of "sentinel" populations can also be helpful.  For example, testing representative samples of dairy and poultry farm workers would more effectively monitor the Avian influenza that emerged in American farms in 2024 than relying on voluntary case reports.  This is especially important where immigrant workers are concerned about coming forward and farmers fear the costs of control measures.

    Syndromic and wastewater surveillance

    Syndromic surveillance methods include tracking patients seeking care at physicians' offices and emergency department.  For instance, CDC and Force of Infection track outpatient influenza-like illness cases and emergency department visits for influenza, COVID-19 and Respiratory Syncytial Virus (RSV).  The key point is that these data are not influenced by decisions about whether to send samples for lab testing, and not subject to delays associated with testing. 

     Regular testing of wastewater samples can be very effective in tracking COVID-19 and many other pathogens because there is no bias in who uses the toilet.  Wastewater surveillance can detect the emergence of new pathogens, but does not identify specific individuals.  Similarly, bulk testing of milk at the farm level can identify the presence of Avian influenza without the expense or bias of testing individual cattle.

    Excess mortality estimation

    Excess mortality estimates are based on comparing the observed number of deaths in the pandemic period to an earlier time, include both direct (caused by a documented COVID-19 infection) and indirect deaths (for example, a heart attack victim unable to get care due to overcrowded emergency rooms).  They provided the most complete estimates of COVID-19's impact, showing that through April 2022, there were 37% more deaths associated with COVID-19 than reported as such, especially in COVID-19 deaths were less likely to be classified as such, with greater differences in rural areas, the South, and in counties that supported Trump.

    System approach needed

    Public health emergencies are complex phenomenon that cannot be summarized in a single indicator, so CDC should develop a balanced portfolio of metrics that together describe the epidemiologic situation and provide information to guide decision-making.  Metrics are intended to inform – not decide –policy decisions that balance epidemiologic benefits and social and economic costs, taking into account the current state of the pandemic. 

    The need for different types of data means that surveillance data are the product of a complex data enterprise with diverse stakeholders.  Healthcare providers, test centers, labs, hospital administrators, funeral directors send reports to health departments where data are compiled, processed, analyzed and published by local, state, federal agencies, the media, and others.  Each has its own procedures and interests.  In addition, the many formats in which health departments, data publishers, and the media presented data during the pandemic created confusion.  The different definitions and formats create opportunities for manipulation.  Recognizing this reality, the World Health Organization working to develop "collaborative surveillance" in countries around the globe.

    Surveillance systems are familiar for early detection of outbreaks, but the pandemic reminds us that policymakers need for metrics that track both health outcomes as well as social and economic factors over time.  These metrics compare among population groups and over time, so consistency in data systems is more important than complete counts.  This requires careful coordination among the many entities in generating public health data. 



    ------------------------------
    Michael A. Stoto, PhD
    Professor Emeritus, Department of Health Management and Policy, Georgetown University
    Adjunct Professor of Biostatistics, Harvard T.H. Chan School of Public Health
    e-mail: mike.stoto@gmail.com
    mike.stoto@gmail.com
    ------------------------------



  • 5.  RE: Preparing Statistically for the Next Severe Epidemic

    Posted 17 days ago

    I agree totally with you Michael.  Another way to track deaths is through timely autopsy reporting.  Florida fired their excellent statistician, Ms. Rebeka Jones, and restricted autopsy reports where deaths by covid (counted) and deaths were with covid (not counted).  If a covid patient died with another possible cause, e.g. heart disease, it was not counted. The integrity of the Florida surveillance system became corrupted when she was let go.   Of interested, despite Florida's cheating, the elderly death rate at 65 and older attributed to covid was 3-fold higher per capita in Florida than in Canada.  Canada came very close to what Fauci wanted in the US.  We should stop harassing him.

    Best wishes,

    Jon



    ------------------------------
    Jonathan Shuster
    ------------------------------



  • 6.  RE: Preparing Statistically for the Next Severe Epidemic

    Posted 16 days ago

    Thanks to Prof. Stoto for raising this issue.

    I was enormously frustrated during 2020-2022 as it seems that our scientific leadership had forgotten 100 years of probability and population sampling, along with more recent advances in data integration ((MR Elliott American Journal of Public Health 113 (7), 721-723).  In particular, combining data from probability surveys, wastewater, and traditional epidemiological surveillance would seem promising.  And it doesn't require a once-in-a-century pandemic to be valuable -- the current cyclosporiasis outbreak would be an example where this could be put into practice.



    ------------------------------
    Michael Elliott
    University of Michigan
    ------------------------------



  • 7.  RE: Preparing Statistically for the Next Severe Epidemic

    Posted 17 days ago

    I agree this is an important topic and in 202, what we were dealing with the COVID-19 pandemic in NYC, we took very seriously and also thought about ways to better plan for the next pandemic.  The major statisticians working at most of the major institutions in NYC the the BERD (Biostatistical & Epidemiology Research and Design) consulting units then, along with me, came up with ideas and planning for the next big one and wrote this article that was published in the American Statistician..  Please feel free to refer to our article that we wrote on this topic and I am also always happy to discuss more on this.  Also, working together with the ASA on this is is also very important. 

     Lee S, Bagiella E, Vaughan R, Govindarajulu U, Christos P, Esserman D, Zhong H,  & Kim M (2022). " COVID-19 Pandemic as a Change Agent in the Structure and Practice of Statistical Consulting Centers", The American Statistician, DOI: 10.1080/00031305.2021.2023045

    Thanks,



    ------------------------------
    Usha Govindarajulu
    Associate Professor of Biostatistics
    Icahn School of Medicine at Mount Sinai
    ------------------------------