SHF: Medium: Reasoning about Multiplicity in the Machine Learning Pipeline

University Of California-San Diego, La Jolla CA

Investigators

Abstract

Machine learning is deployed across various domains (e.g., finance, education, hiring) with the assumption that model outcomes are accurate and authoritative. But in reality, the specific model that is deployed is just one option of many: previous work has shown that multiplicity – the existence of multiple equally good models – arises at many stages of the machine learning pipeline. Formally reasoning about multiplicity is challenging due to the large (potentially infinite) set of models one has to take into account. As such, existing techniques are currently only able to reason about certain forms of model-based multiplicity, and generally only with empirical guarantees. This project’s novelties are a set of approaches that increase the auditability of machine learning pipelines. These techniques consist of frameworks and formal techniques to understand how multiplicity in the dataset creation and modeling processes impacts the final learned model that is deployed. The project’s impacts are especially prominent in domains where the decisions of machine learned models directly affect humans --- understanding multiplicity is vital for developing machine learning models that are fair and robust. The investigators are involved with organizing outreach programs to expose high schoolers and undergraduates to computer science and topics in machine learning. This project investigates multiplicity for diverse model architectures across the whole machine learning pipeline including training data, model predictions, and model explanations. The research integrates formal methods and robust machine learning techniques to provide techniques to help answer the question of whether machine learning outcomes are reliable, or whether they are just an artifact of multiplicity. For instance, the investigators study algorithms to certify (deterministically or probabilistically, depending on the model architecture) whether a model’s prediction is robust under various sources of multiplicity. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.