Event Page: Sequential causal inference in experimental or observational settings (AI, Statistics & Data Science in Practice Series) | National Institute of Statistical Sciences
Date & Time: Tuesday, August 26, 2025 - 12:00pm to 1:30pm ET
Zoom Registration Link: Welcome! You are invited to join a webinar: NISS AI, Statistics & Data Science in Practice Series: Sequential causal inference in experimental or observational settings . After registering, you will receive a confirmation email about joining the webinar.
Sequential causal inference in experimental or observational settings (AI, Statistics & Data Science in Practice Series)
Overview
The AI, Statistics & Data Science in Practice Series during Fall 2025 will focus on the critical role of experimentation in the development and refinement of artificial intelligence (AI) systems: "Incorporating principles of design of experiments and randomization ensures that AI models are trained on reliable, unbiased data, leading to more generalizable and interpretable results. By planning data collection with experimental design and randomization, researchers can minimize bias from uncontrolled variables and improve the statistical validity of their conclusions, whether the models are inferential or predictive. However, in many real-world scenarios, fully controlled experiments may not be feasible. When working with observational data, researchers can employ quasi-experimental techniques to approximate the benefits of randomized trials. These methods help isolate the effects of key variables and adjust for potential confounders, improving the robustness of AI-driven insights. By integrating structured experimentation and causal inference methodologies, AI developers can enhance the reliability and applicability of their models in practice.
Speaker
Aaditya Ramdas, Associate Professor, Department of Statistics and Data Science & Department of Machine Learning, Carnegie Mellon University
Moderator
Will Wei Sun, Associate Professor of Quantitative Methods, Daniels School of Business, Purdue University
Abstract
Title: Sequential causal inference in experimental or observational settings
Abstract: I will discuss three modern statistical topics around experimentation and deployment of AI models at scale: (a) how to track the risk of a deployed model and detect harmful distribution shifts, (b) how to sequentially estimate average treatment effects in A/B tests or observational studies, (c) post-selection inference when performing doubly-sequential experimentation. Solutions will be enabled by the development of new methodology, like asymptotic analogs of Robbins' confidence sequences and online analogs of classical multiple testing procedures like the Benjamini-Hochberg procedure. These methods in turn require the development of new foundational statistical concepts like time-uniform central limit theory, and e-values.
About the Speaker
Aaditya Ramdas is an Associate Professor at Carnegie Mellon University in the Departments of Statistics and Machine Learning. His work has been recognized by the Presidential Early Career Award (PECASE), the highest distinction bestowed by the US government to young scientists, a Kavli fellowship from the NAS, a Sloan fellowship in Mathematics, a CAREER award from the NSF, the inaugural COPSS Emerging Leader Award, the Bernoulli new researcher award and the IMS Peter Hall Early Career Prize, and faculty research awards from Adobe and Google. He was recently elected Fellow of the IMS, was awarded Statistician of the Year by the ASA's Pittsburgh Chapter, and will be the program chair of AISTATS 2026. See Profile
About the Moderator
Dr. Will Wei Sun is an Associate Professor of Quantitative Methods at Purdue University's Mitchell E. Daniels, Jr. School of Business, with a courtesy appointment in the Department of Statistics. He serves as the PhD Coordinator for Quantitative Methods and is recognized for his expertise in statistical foundations of large language models, trustworthy reinforcement learning, tensor data analysis. Dr. Sun's research has been supported by notable grants from the National Science Foundation and the Office of Naval Research. Dr. Sun earned his Ph.D. in Statistics from Purdue University in 2015. Before that, he was a research scientist at Yahoo Labs and an assistant professor at Miami Business School. Dr. Sun is on the editorial board for Annals of Applied Statistics, Statistical Analysis and Data Mining. See Profile
About AI, StAtIstics and Data Science in Practice
The NISS AI, Statistics and Data Science in Practice is a monthly event series will bring together leading experts from industry and academia to discuss the latest advances and practical applications in AI, data science, and statistics. Each session will feature a keynote presentation on cutting-edge topics, where attendees can engage with speakers on the challenges and opportunities in applying these technologies in real-world scenarios. This series is intended for professionals, researchers, and students interested in the intersection of AI, data science, and statistics, offering insights into how these fields are shaping various industries. The series is designed to provide participants with exposure to and understanding of how modern data analytic methods are being applied in real-world scenarios across various industries, offering both theoretical insights, practical examples, and discussion of issues.
Featured Topics:
- Veridical Data Science - Speaker: Bin Yu, October 15,2024
- Random Forests: Why they Work and Why that's a Problem - Speaker: Lucas Mentch, November 19, 2024
- Causal AI in Business Practices - Speakers: Victor Lo, and Victor Chen, January 24, 2025
- Large Language Models: Transforming AI Architectures and Operational Paradigms - Speaker: Frank Wei, February 18, 2025
- Machine Learning for Airborne Biological Hazard Detection - Speaker: Jared Schuetter, March 11, 2025
- Trustworthy AI in Weather, Climate, and Coastal Oceanography - Speaker: Dr. Amy McGovern, May 13, 2025
- Sequential Causal Inference in Experimental or Observational Settings - Speaker: Aaditya Ramdas, August 26, 2025
- Reinventing Operations Management's Research and Practice with Data Science - Speaker: David Simchi-Levi, September 23, 2025
- ML and Bayesian geospatial approaches for prediction of opioid overdose deaths - Speaker: Soledad Fernández, November 18, 2025
------------------------------
Randy Freret
NISS.org
rfreret@niss.org------------------------------