Center Calendar
"Human-AI Collaboration" - Dr. Mark Steyvers, Dept. of Cognitive Science, University of California, Irvine
Tuesday, April 30, 2024, 02:00pm - 03:30pm
152 Frelinghuysen Rd, Psych Bldg, Busch Campus, Room 105
Abstract: Artificial intelligence (AI) and machine learning models are increasingly deployed in real-world applications. In many of these applications, there is strong motivation to develop hybrid systems in which humans and AI algorithms can work together, leveraging their complementary strengths and weaknesses. I will present research exploring the cognitive decision process and people's mental models of AI across various AI-assisted decision-making paradigms. I will review empirical findings on how AI communicates with humans through confidence signals (numeric or verbal) and explanations. Specifically, I will explore our latest research on conveying uncertainty through Large Language Models (LLMs). Although these models are reasonably calibrated for certain problems—aware of their knowledge limits—conveying this certainty or uncertainty to users is challenging. Our work reveals a 'calibration gap,' with users struggling to assess the LLMs' knowledge scope. Our research highlights how cognitive science enhances our understanding of AI perception and AI-assisted decision-making.
Bio: Dr. Mark Steyvers
My research in cognitive science is primarily concerned with high-level cognition. Through empirical studies and computational modeling, the goal is to understand how people self-reflect, learn, and make decisions. These insights into human intelligence can help us advance not only cognitive science and psychology, but also AI research.
