UPCOMING WORKSHOP

Human and Organizational Factors in AI Risk Management

Artificial intelligence offers the promise of making sense of information more quickly and consistently than humans. However, the use of this technology brings with it new risks stemming from the human and organizational realities of the resulting sociotechnical systems. These challenges are compounded by the difficulty of connecting design, development, deployment, and operational practices to societal values-and challenges with AI models such as limited transparency and explainability.
 
Join the National Academies for a series of workshop events to explore the latest thinking about human and organizational factors in implementing AI, including how to incorporate human insights about AI-produced output, human oversight of AI systems, and AI operation in real-world environments.  

Workshop sessions will focus on ways to broaden stakeholder participation; needs for evaluation, testing, and oversight; and the interplay between AI and organizational cultures. A final session will recap insights from the prior sessions and highlight paths forward.
 

Workshop Dates and Topics

All workshop sessions are open for online participation, but the final session will also take place in person in Washington, D.C.  Please note that each session has a separate registration page.  

Broadening Stakeholder Participation
Join us online on June 11 from 10:30am-4:30pm ET to discuss how to ensure a full range of stakeholders participate in AI system design and development, how labor processes may change with the development and use of AI, and how to build equitable infrastructure to address risk and build trust. Learn more and register 

Evaluation, Testing, and Oversight 
Join us online on June 20 from 10:30am-4:30pm ET to explore how to qualitatively and quantitatively evaluate AI systems across different use cases. Speakers will discuss key criteria for evaluation, how to determine and report on impact, and the evaluation governance ecosystem. Learn more and register

Organizational Culture and Processes
Join us online on June 26 from 10:30am-4:30pm ET to discuss the effects of AI systems on organizational culture.  Speakers will explore how to set meaningful metrics when designing tools; highlight existing organizational safety frameworks in an array of industries including healthcare, aviation, and transportation; and consider the impacts of organizational processes on the success of designing and deploying AI safety frameworks. Learn more and register

Designing Paths Forward in AI Risk Management
Join us in person or online on July 2 from 10:30am-4:30pm ET to review lessons learned about building trust as AI systems are designed, developed, deployed, and used, consider how to operationalize ideas surfaced during the prior workshop sessions, and identify areas needing further work. Learn more and register

This workshop series is organized by the National Academies' Computer Science and Telecommunications Board and Board on Human-System Integration.