Security Summit Agenda

15:00 - 15:45 BST
10:00 AM - 10:45 AM EDT

The Science of Generative AI: What’s happening, where it came from, and what it can do

Speaker: Klinton Bicknell, Head of AI, Duolingo

Generative Artificial Intelligence is rapidly gaining popularity across various industries. However, the potential impacts of generative AI on assessments are still relatively unexplored. The purpose of this session is to provide accurate information about the capabilities and limitations of generative AI technology and to present those facts free of influence or hype. Additionally, we will highlight some of the key players utilizing generative AI in the development of assessment products. While the integration of generative AI in assessments may present exciting opportunities, it also creates significant challenges marred with security concerns, privacy issues, and the potential for misuse. This session aims to provide foundational knowledge for researchers, practitioners, and policymakers in the field of assessment science to better understand generative AI.

15:45 - 16:15 BST
10:45 AM - 11:15 AM EDT

Break

16:15 - 17:30 BST
11:15 AM - 12:30 PM EDT

Cheating, Chatbots, and Generative AI

Moderator: Rachel Schoenig, Cornerstone Strategies

Panelists: Basim Baig, Duolingo; Donna McPartland, Han Santos

Generative Artificial Intelligence has the potential to change the testing landscape for all stakeholders – including those stakeholders interested in circumventing testing rules or profiting from cheating behavior. In fact, innovative uses of Generative AI are already available today - from crafting essay responses and answering math problems to producing deep fakes and writing software code. This session will explore the current and potential applications of Generative AI that pose a risk to exam design, development, delivery, and results. Together, we’ll dive into the emerging uses of generative AI that threaten testing and score validity as well as the regulatory gaps that allow for the commercialization of these tools. Powered by a panel of real live experts (no deep fakes here!), we’ll raise your awareness of the threats and opportunities posed by this technology. It’s a session you won’t want to miss (and any chatbot should have told you that).

15:00 - 16:00 BST
10:00 AM - 11:00 AM EDT

How to Stay on Top of AI – Key Considerations on Handling Security Threats to Assessments and Assessment Programs

Moderator: Isabelle Gonthier, Senior Vice President of Content Services, PSI Services

Speakers: David Yunger, Vaital; Ye Tong, NBME; Benjamin Hunter, Caveon

Prevent, detect, and deter: three extremely important key words for test security. With generative AI tools being used to support exam delivery, creating content, and generating test responses, the pressure remains strong and consistent regarding the importance of protecting the integrity of assessment programs. Generative AI platforms are now a part of our industry, and we need to remain vigilant about test security. In this global panel discussion, we will review and comment on strategies and key considerations with the use of AI tools and how we can identify and address threats related to cheating, content exposure, and test validity concerns.

16:00 - 16:30 BST
11:00 AM - 11:30 AM EDT

Break

16:30 - 17:30 BST
11:30 AM - 12:30 PM EDT

Using AI “For Good”: How to Take Advantage of This Important Technology in Test Construction and Program Advancement

Moderator: Pamela Becker, General Manager, Hogrefe

Speakers: Professor Rose Luckin, EDUCATE Ventures; Pat Ward, President and CEO, Internet Testing Systems; Neil McGough, Learnosity

Let's think with our opportunistic hat on: within the parameters of safe and secure assessments and programs, what new opportunities could generative AI technology offer our developers and our customers? For example, could it help our industry experts develop assessments that so far, have been impractical to pursue due to difficult content creation or expense? Could it help us to generate more practice items, more resources for assessment undertanding, more advanced reporting?

Our global panel will outline ideas about how the use of generative AI technology could positively impact program opportunities and enable us to safely harness the knowledge that generative AI can provide to its users.