ICER 2024
Mon 12 - Thu 15 August 2024 Melbourne, Victoria, Australia
Tue 13 Aug 2024 13:55 - 14:15 - GenAI and Computing Education (I) Chair(s): Judy Sheard

The capability of large language models (LLMs) to generate, debug, and explain code has sparked the interest of researchers and educators in undergraduate programming, with many anticipating their transformative potential in programming education. However, decisions about why and how to use LLMs in programming education may involve more than just the assessment of an LLM’s technical capabilities. Using the social shaping of technology theory as a guiding framework, our study explores how students’ social perceptions influence their own LLM usage. We then examine the correlation of self-reported LLM usage with students’ self-efficacy and midterm performances in an undergraduate programming course. Triangulating data from an anonymous student survey (n = 158), a self-efficacy survey (n=158), student interviews (n = 10), self-reported LLM usage on homework, and midterm performance, we discovered that students’ use of LLMs was associated with their expectations for their future careers and their perceptions of peer usage. Additionally, early self-reported LLM usage in our context correlated with lower self-efficacy and lower midterm scores, while perceived over-reliance on LLMs, rather than reported usage, correlated with decreased self-efficacy later in the course.

Tue 13 Aug

Displayed time zone: Brisbane change

13:15 - 14:15
GenAI and Computing Education (I)Research Papers
Chair(s): Judy Sheard Monash University
13:15
20m
Talk
Debugging with an AI Tutor: Investigating Novice Help-seeking Behaviors and Perceived Learning
Research Papers
Stephanie Yang Harvard University, Hanzhang Zhao Harvard Graduate School of Education, Yudian Xu Harvard Graduate School of Education, Karen Brennan Harvard Graduate School of Education, Bertrand Schneider Harvard Graduate School of Education
13:35
20m
Talk
Evaluating Contextually Personalized Programming Exercises Created with Generative AI
Research Papers
Evanfiya Logacheva Aalto University, Arto Hellas Aalto University, James Prather Abilene Christian University, Sami Sarsa University of Jyväskylä, Juho Leinonen Aalto University
Link to publication DOI Pre-print
13:55
20m
Talk
Insights from Social Shaping Theory: The Appropriation of Large Language Models in an Undergraduate Programming Course
Research Papers
Aadarsh Padiyath University of Michigan, Xinying Hou University of Michigan, Amy Pang University of Michigan, Diego Viramontes Vargas University of Michigan, Xingjian Gu University of Michigan, Tamara Nelson-Fromm University of Michigan, Zihan Wu University of Michigan, Mark Guzdial University of Michigan, Barbara Ericson University of Michigan
Pre-print