RI: Small: Controlling Generative Models

Cornell University, Ithaca NY

Investigators

Abstract

Artificial intelligence (AI) systems that generate text and images, such as chatbots and image creation tools, have become increasingly powerful and widespread. However, these systems often produce unpredictable outputs that can be inappropriate, illogical, or harmful, especially in sensitive applications like healthcare, customer service, and education. For example, a medical chatbot might accidentally provide incorrect health information, or an image generator might create illogical content. This unpredictability prevents these technologies from being safely deployed in many important real-world applications where reliability is crucial. This project addresses this critical problem by developing new methods to give users precise control over what these artificial intelligence systems generate, while maintaining their creative capabilities. The research will enable safer deployment of generative artificial intelligence in sensitive settings and unlock new applications that require guaranteed reliability. The work will advance the field of artificial intelligence safety, support education through safer AI tools, and benefit society by enabling AI systems that can be confidently used in healthcare, education, and other critical domains. This project develops novel approaches to control generative models through three interconnected research thrusts. First, the team will investigate language diffusion methods that integrate the controllability of diffusion models with autoregressive text generation, including guidance mechanisms for transformer posterior distributions and diffusion-based planning architectures for controllable internal reasoning at inference time. Second, the research will develop inference-time personalization methods for large language models using classifier-guided and classifier-free approaches that leverage conditional independence between preference dimensions to avoid exponential complexity. Third, the project will create a principled framework for fine-tuning image diffusion models using human preferences through iterative classifier-guided diffusion processes, where classifiers are trained with pseudo-labels from reward models. The research methodology combines theoretical analysis of probabilistic inference frameworks with empirical validation across text and image generation tasks. The project will produce new algorithms, software implementations, and evaluation frameworks that enable reliable control over generative model outputs while preserving their generative capabilities. This work will advance the theoretical understanding of controllable generation and provide practical tools for deploying generative artificial intelligence in safety-critical applications. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.