Campus Event Calendar

Event Entry

What and Who

Making machine learning predictably reliable

Andrew Ilyas
Massachusetts Institute of Technology
CIS@MPG Colloquium

Andrew Ilyas is a PhD student in Computer Science at MIT, where he is advised by Aleksander Madry and Constantinos Daskalakis. His research aims to improve the reliability and predictability of machine learning systems. He was previously supported by an Open Philanthropy AI Fellowship.
AG 1, AG 2, AG 3, INET, AG 4, AG 5, D6, SWS, RG1, MMCI  
AG Audience

Date, Time and Location

Wednesday, 17 April 2024
60 Minutes


Despite ML models' impressive performance, training and deploying them is currently a somewhat messy endeavor. But does it have to be? In this talk, I overview my work on making ML “predictably reliable”---enabling developers to know when their models will work, when they will fail, and why.

To begin, we use a case study of adversarial inputs to show that human intuition can be a poor predictor of how ML models operate. Motivated by this, we present a line of work that aims to develop a precise understanding of the ML pipeline, combining statistical tools with large-scale experiments to characterize the role of each individual design choice: from how to collect data, to what dataset to train on, to what learning algorithm to use.


Geraldine Anderson
+49 631 9303 9607
--email hidden
passcode not visible
logged in users only

Tags, Category, Keywords and additional notes

Please contact MPI Office for zoom link

Geraldine Anderson, 04/16/2024 14:31 -- Created document.