Uncertainty Quantification
When AI can explain to us that it's unsure, it adds a critical layer of transparency for its safe deployment and use. We’re developing ways to foster and streamline the common practices of quantifying, evaluating, improving, and communicating uncertainty in the AI application development lifecycle.
Our work
IBM’s Uncertainty Quantification 360 toolkit boosts trust in AI
ReleasePrasanna Sattigeri and Vera Liao7 minute readAI boosts the discovery of metamaterials vital for next-gen gadgets
ResearchYoussef Mroueh, Karthikeyan Shanmugam, and Payel Das10 minute read
Publications
Sequential Uncertainty Quantification with Contextual Tensors for Social Targeting,
- Ide-San Ide
- Keerthiram Murugesan
- et al.
- 2024
- KAIS
Advanced Physics-AI Models for Rain Enhancement in Arid Regions
- Lloyd Treinish
- Mukul Tewari
- et al.
- 2024
- AGU 2024
Modelling the Extreme July 2023 Hudson Valley Precipitation Event Using WRF
- Anthony Praino
- Lloyd Treinish
- et al.
- 2024
- AGU 2024
Graph-based Uncertainty Metrics for Long-form Language Model Generations
- Mingjian Jiang
- Yangjun Yangjun
- et al.
- 2024
- NeurIPS 2024
Weak Supervision Performance Evaluation via Partial Identification
- Felipe Maia Polo
- Subha Maity
- et al.
- 2024
- NeurIPS 2024
Consistency-based Black-box Uncertainty Quantification for Text-to-SQL
- Debarun Bhattacharjya
- Balaji Ganesan
- et al.
- 2024
- NeurIPS 2024