From Feedback to Formative Guidance: Leveraging LLMs for Personalized Support in Programming Projects

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

Large Language Models (LLMs) offer scalable opportunities to personalize feedback in education, yet their trustworthiness and effectiveness remain underexplored. We present a study conducted in an introductory programming and data science course with approximately 1,400 first-year university students. A subset of these students received both peer and LLM-generated feedback on their individual programming projects. Our results show that 56% of students preferred the LLM feedback, and 52% could not reliably distinguish it from human-written feedback. Student ratings suggest that LLM feedback is perceived as helpful, constructive, and relevant, though it often lacks personalized depth and motivational nuance. These findings underline the potential of LLMs to support scalable, personalized education, while pointing to key areas for responsible improvement. Based on these insights, we outline the future roadmap for the course in which LLM-generated feedback supports students in their learning journey but also instructors through monitoring student performance and helping to allocate instructional resources more effectively. Given limited human resources this approach enables personalized instructor feedback to be scaled to a large group of students.

OriginalspracheEnglisch
TitelUMAP 2025 - Adjunct Proceedings of the 33rd ACM Conference on User Modeling, Adaptation and Personalization
HerausgeberCristina Conati, Fedelucio Narducci, Gaetano Rossiello, Cataldo Musto, Julita Vassileva
Anzahl der Seiten6
VerlagAssociation for Computing Machinery, Inc
Erscheinungsdatum12.06.2025
Seiten398-403
ISBN (elektronisch)9798400713996
DOIs
PublikationsstatusErschienen - 12.06.2025
Veranstaltung33rd Conference on User Modeling, Adaptation and Personalization - UMAP 2025 - New York, USA / Vereinigte Staaten
Dauer: 16.06.202519.06.2025
Konferenznummer: 33

Bibliographische Notiz

Publisher Copyright:
© 2025 Copyright held by the owner/author(s).

DOI

Zuletzt angesehen

Publikationen

  1. Communication
  2. Introduction
  3. Doing everything you can, but not (yet) getting it right
  4. Uniting against a common enemy
  5. Creativity in Spaces of Possibilities for Sustainable Urban Development
  6. Cognitive load and science text comprehension
  7. Science teaching and learning in schools
  8. Australian Graziers value sparse trees in their pastures: A viewshed analysis of Photo-elicitation
  9. Multiple import sourcing.
  10. Discrete-Point Analysis of the Energy Demand of Primary versus Secondary Metal Production
  11. Value, values, symbols and outcomes
  12. Productivity and the product scope of multi-product firms:
  13. Shrub management is the principal driver of differing population sizes between native and invasive populations of Rosa rubiginosa L
  14. How transformational leadership transforms followers’ affect and work engagement
  15. The relationship between working alliance and client outcomes in coaching
  16. Using nestedness and species-accumulation analyses to strengthen a conservation plan for littoral forest birds in south-eastern Madagascar
  17. Between mutuality, autonomy and domination
  18. The Effect of Dislike on Accuracy and Bias in Person Perception
  19. Effect of cascading of higher-lying states on a delayed 1 s-2 p transition after beam-foil excitation of 56 MeV hydrogen-like oxygen and fluorine
  20. The well- and unwell-being of a child
  21. Divide and Share
  22. The Multiple Self Objection to the Prudential Lifespan Account
  23. art thinking doing art: Artistic Practices in Educational Contexts from 1900 to Today
  24. Characteristics of adaptive teacher behavior in mathematical modelling
  25. How action-oriented entrepreneurship training transforms university students into entrepreneurs: Insights from a qualitative study

Presse / Medien

  1. "The lights won't go out"