Skip to content

Arto Hellas

Publication record assembled from the DBLP archive of ranked conferences.

Papers indexed

94

Venues

11

Active years

2016–2026

Best venue rank

A*

Where they publish

Papers

94 indexed papers, newest first.

YearVenueTitleAuthors
2026AIEDThe Missing Evaluation Axis: What 10,000 Student Submissions Reveal About AI Tutor Effectiveness.Rose Niousha, Samantha Boatright Smith, Bita Akram, Peter Brusilovsky, Arto Hellas, Juho Leinonen, John DeNero, Narges Norouzi
2026SIGCSEThe Impostor Phenomenon and the Confidence Gap.Arto Hellas, Andrew Petersen
2026SIGCSEKnowledge Component-Driven Alignment of CS1 Textbooks and Exercises.Samantha Boatright Smith, Arun Balajiee Lekshmi Narayanan, Anurata Prabha Hridi, Rafaella Sampaio de Alencar, Bita Akram, Arto Hellas, Juho Leinonen, Peter Brusilovsky, Narges Norouzi
2025ACEOn the Opportunities of Large Language Models for Programming Process Data.John Edwards, Arto Hellas, Juho Leinonen
2025ACELLM-itation is the Sincerest Form of Data: Generating Synthetic Buggy Code Submissions for Computing Education.Juho Leinonen, Paul Denny, Olli Kiljunen, Stephen MacNeil, Sami Sarsa, Arto Hellas
2025AIEDEmergence of LLMs: (Not-so-)Significant Delving in Essay Answers in a MOOC on the Ethics of AI.Leo Leppnen, Lili Aunimo, Arto Hellas, Jukka K. Nurminen, Linda Mannila
2025EDMReinforcement Learning for Programming Feedback: Aligning Small Language Models Without Human Preferences.Charles Koutcheme, Nicola Dainese, Arto Hellas
2025SIGCSEEvaluating Language Models for Generating and Judging Programming Feedback.Charles Koutcheme, Nicola Dainese, Sami Sarsa, Arto Hellas, Juho Leinonen, Syed Ashraf, Paul Denny
2024ACEDecoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models.Stephen MacNeil, Paul Denny, Andrew Tran, Juho Leinonen, Seth Bernstein, Arto Hellas, Sami Sarsa, Joanne Kim
2024EDMLeveraging Large Language Models for Next-Generation Educational Technologies.Neil T. Heffernan, Rose E. Wang, Christopher MacLellan, Arto Hellas, Chenglu Li, Candace A. Walkington, Joshua Littenberg-Tobias, David Joyner, Steven Moore, Adish Singla, Zach A. Pardos, Maciej Pankiewicz, Juho Kim, Shashank Sonkar, Clayton Cohn, Anthony Botelho, Andrew S. Lan, Lan Jiang, Mingyu Feng, Tanja Kser, Eamon Worden
2024ICEREvaluating Contextually Personalized Programming Exercises Created with Generative AI.Evanfiya Logacheva, Arto Hellas, James Prather, Sami Sarsa, Juho Leinonen
2024ICSELet's Ask AI About Their Programs: Exploring ChatGPT's Answers To Program Comprehension Questions.Teemu Lehtinen, Charles Koutcheme, Arto Hellas
2024ITiCSE"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students Using Large Language Models.Seth Bernstein, Paul Denny, Juho Leinonen, Lauren Kan, Arto Hellas, Matt Littlefield, Sami Sarsa, Stephen MacNeil
2024ITiCSEAnalyzing Students' Preferences for LLM-Generated Analogies.Seth Bernstein, Paul Denny, Juho Leinonen, Matt Littlefield, Arto Hellas, Stephen MacNeil
2024ITiCSEOpen Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge.Charles Koutcheme, Nicola Dainese, Sami Sarsa, Arto Hellas, Juho Leinonen, Paul Denny
2024SIGCSEUsing Large Language Models for Teaching Computing.Juho Leinonen, Stephen MacNeil, Paul Denny, Arto Hellas
2024SIGCSEExperiences from Integrating Large Language Model Chatbots into the Classroom.Arto Hellas, Juho Leinonen, Leo Leppnen
2024SIGCSEDiscussing the Changing Landscape of Generative AI in Computing Education.Stephen MacNeil, Juho Leinonen, Paul Denny, Natalie Kiesler, Arto Hellas, James Prather, Brett A. Becker, Michel Wermelinger, Karen Reid
2024SIGCSESynthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing Students.Stephen MacNeil, Magdalena Rogalska, Juho Leinonen, Paul Denny, Arto Hellas, Xandria Crosland
2024SIGCSESolving Proof Block Problems Using Large Language Models.Seth Poulsen, Sami Sarsa, James Prather, Juho Leinonen, Brett A. Becker, Arto Hellas, Paul Denny, Brent N. Reeves
2024SIGCSEInstructor Perceptions of AI Code Generation Tools - A Multi-Institutional Interview Study.Judy Sheard, Paul Denny, Arto Hellas, Juho Leinonen, Lauri Malmi, Simon
2023ACEExperiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them?Nea Pirttinen, Arto Hellas, Juho Leinonen
2023AIEDAutomated Program Repair Using Generative Models for Code Infilling.Charles Koutcheme, Sami Sarsa, Juho Leinonen, Arto Hellas, Paul Denny
2023ICERExploring the Responses of Large Language Models to Beginner Programmers' Help Requests.Arto Hellas, Juho Leinonen, Sami Sarsa, Charles Koutcheme, Lilja Kujanp, Juha Sorva
2023ICEREvaluating Distance Measures for Program Repair.Charles Koutcheme, Sami Sarsa, Juho Leinonen, Lassi Haaranen, Arto Hellas
2023ICSEFactors Affecting Compilable State at Each Keystroke in CS1.Steven Scott, Arto Hellas, Juho Leinonen, John Edwards
2023ICWEThe Rise of Disappearing Frameworks in Web Development.Juho Vepslinen, Arto Hellas, Petri Vuorimaa
2023ITiCSEComparing Code Explanations Created by Students and Large Language Models.Juho Leinonen, Paul Denny, Stephen MacNeil, Sami Sarsa, Seth Bernstein, Joanne Kim, Andrew Tran, Arto Hellas
2023ITiCSESeeing Program Output Improves Novice Learning Gains.Juho Leinonen, Arto Hellas, John Edwards
2023ITiCSEEvaluating the Performance of Code Generation Models for Solving Parsons Problems With Small Prompt Variations.Brent N. Reeves, Sami Sarsa, James Prather, Paul Denny, Brett A. Becker, Arto Hellas, Bailey Kimmel, Garrett B. Powell, Juho Leinonen
2023SIGCSEUsing Large Language Models to Enhance Programming Error Messages.Juho Leinonen, Arto Hellas, Sami Sarsa, Brent N. Reeves, Paul Denny, James Prather, Brett A. Becker
2023SIGCSETime-constrained Code Recall Tasks for Monitoring the Development of Programming Plans.Ava Heinonen, Arto Hellas
2023SIGCSEThe Implications of Large Language Models for CS Teachers and Students.Stephen MacNeil, Joanne Kim, Juho Leinonen, Paul Denny, Seth Bernstein, Brett A. Becker, Michel Wermelinger, Arto Hellas, Andrew Tran, Sami Sarsa, James Prather, Viraj Kumar
2023SIGCSEAutomatically Generating CS Learning Materials with Large Language Models.Stephen MacNeil, Andrew Tran, Juho Leinonen, Paul Denny, Joanne Kim, Arto Hellas, Seth Bernstein, Sami Sarsa
2023SIGCSEExperiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book.Stephen MacNeil, Andrew Tran, Arto Hellas, Joanne Kim, Sami Sarsa, Paul Denny, Seth Bernstein, Juho Leinonen
2023WEBISTImplications of Edge Computing for Static Site Generation.Juho Vepslinen, Arto Hellas, Petri Vuorimaa
2023WEBISTThe State of Disappearing Frameworks in 2023.Juho Vepslinen, Arto Hellas, Petri Vuorimaa
2023WEBISTOverview of Web Application Performance Optimization Techniques.Juho Vepslinen, Arto Hellas, Petri Vuorimaa
2022ACEMethodological Considerations for Predicting At-risk Students.Charles Koutcheme, Sami Sarsa, Arto Hellas, Lassi Haaranen, Juho Leinonen
2022ACECodeProcess Charts: Visualizing the Process of Writing Code.Raj Shrestha, Juho Leinonen, Arto Hellas, Petri Ihantola, John Edwards
2022FIEEvaluating CodeClusters for Effectively Providing Feedback on Code Submissions.Teemu Koivisto, Arto Hellas
2022FIEPiloting Natural Language Generation for Personalized Progress Feedback.Leo Leppnen, Arto Hellas, Juho Leinonen
2022FIEOn Things that Matter in Learning Programming: Towards a Scale for New Programming Students.Hannu Pesonen, Arto Hellas
2022FIEHow to Help to Ask for Help? Help Request Prompt Structure Influence on Help Request Quantity and Course Retention.Sami Sarsa, Jesper Pettersson, Arto Hellas
2022ICERAutomatic Generation of Programming Exercises and Code Explanations Using Large Language Models.Sami Sarsa, Paul Denny, Arto Hellas, Juho Leinonen
2022ICSESeeking Flow from Fine-Grained Log Data.Benjamin Ultan Cowley, Arto Hellas, Petri Ihantola, Juho Leinonen, Michiel M. A. Spap
2022ICSEPausing While Programming: Insights From Keystroke Analysis.Raj Shrestha, Juho Leinonen, Albina Zavgorodniaia, Arto Hellas, John Edwards
2022ITiCSEPlanning a Multi-institutional and Multi-national Study of the Effectiveness of Parsons Problems.Barbara J. Ericson, Paul Denny, James Prather, Rodrigo Duran, Arto Hellas, Juho Leinonen, Craig S. Miller, Briana B. Morrison, Janice L. Pearce, Susan H. Rodger
2022ITiCSEParsons Problems and Beyond: Systematic Literature Review and Empirical Study Designs.Barbara J. Ericson, Paul Denny, James Prather, Rodrigo Duran, Arto Hellas, Juho Leinonen, Craig S. Miller, Briana B. Morrison, Janice L. Pearce, Susan H. Rodger
2022ITiCSEExploring How Students Solve Open-ended Assignments: A Study of SQL Injection Attempts in a Cybersecurity Course.Charles Koutcheme, Artturi Tilanter, Aleksi Peltonen, Arto Hellas, Lassi Haaranen
2022ITiCSEWho Continues in a Series of Lifelong Learning Courses?Sami Sarsa, Arto Hellas, Juho Leinonen
2022SIGCSETime-on-Task Metrics for Predicting Performance.Juho Leinonen, Francisco Enrique Vicente Castro, Arto Hellas
2021EDMFine-Grained Versus Coarse-Grained Data for Estimating Time-on-Task in Learning Programming.Juho Leinonen, Francisco Enrique Vicente Castro, Arto Hellas
2021ICERAlgorithm Visualization and the Elusive Modality Effect.Albina Zavgorodniaia, Artturi Tilanter, Ari Korhonen, Otto Seppl, Arto Hellas, Juha Sorva
2021ICSEMorning or Evening? An Examination of Circadian Rhythms of CS1 Students.Albina Zavgorodniaia, Raj Shrestha, Juho Leinonen, Arto Hellas, John Edwards
2021ITiCSEDoes the Early Bird Catch the Worm? Earliness of Students' Work and its Relationship with Course Outcomes.Juho Leinonen, Francisco Enrique Vicente Castro, Arto Hellas
2020FIERelation of Individual Time Management Practices and Time Management of Teams.Tapio Auvinen, Nickolas J. G. Falkner, Arto Hellas, Petri Ihantola, Ville Karavirta, Otto Seppl
2020FIEOn the Differences in Time That Students Take to Write Solutions to Programming Problems.Fabian Fagerholm, Arto Hellas
2020FIEDeadlines and MOOCs: How Do Students Behave in MOOCs with and without Deadlines.Petri Ihantola, Ilenia Fronza, Tommi Mikkonen, Miska Noponen, Arto Hellas
2020FIEStudy Major, Gender, and Confidence Gap: Effects on Experience, Performance, and Self-Efficacy in Introductory Programming.Nea Pirttinen, Arto Hellas, Lassi Haaranen, Rodrigo Duran
2020ICERProgramming Versus Natural Language: On the Effect of Context on Typing in CS1.John Edwards, Juho Leinonen, Chetan Birthare, Albina Zavgorodniaia, Arto Hellas
2020ICWETeaching Container-Based DevOps Practices.Jami Kousa, Petri Ihantola, Arto Hellas, Matti Luukkainen
2020ITiCSECapturing and Characterising Notional Machines.Sally Fincher, Johan Jeuring, Craig S. Miller, Peter Donaldson, Benedict du Boulay, Matthias Hauswirth, Arto Hellas, Felienne Hermans, Colleen M. Lewis, Andreas Mhling, Janice L. Pearce, Andrew Petersen
2020ITiCSENotional Machines in Computing Education: The Education of Attention.Sally Fincher, Johan Jeuring, Craig S. Miller, Peter Donaldson, Benedict du Boulay, Matthias Hauswirth, Arto Hellas, Felienne Hermans, Colleen M. Lewis, Andreas Mhling, Janice L. Pearce, Andrew Petersen
2020ITiCSECrowdsourcing Content Creation for SQL Practice.Juho Leinonen, Nea Pirttinen, Arto Hellas
2020ITiCSEAchievement Goal Orientation Profiles and Performance in a Programming MOOC.Kukka-Maaria Polso, Heta Tuominen, Arto Hellas, Petri Ihantola
2020SIGCSEGender Differences in Introductory Programming: Comparing MOOCs and Local Courses.Rodrigo Duran, Lassi Haaranen, Arto Hellas
2020SIGCSEA Study of Keystroke Data in Two Contexts: Written Language and Programming Language Influence Predictability of Learning Outcomes.John Edwards, Juho Leinonen, Arto Hellas
2019ICERExploring the Value of Student Self-Evaluation in Introductory Programming.Rodrigo Duran, Jan-Mikael Rybicki, Juha Sorva, Arto Hellas
2019ICERAdmitting Students through an Open Online Course in Programming: A Multi-year Analysis of Study Success.Juho Leinonen, Petri Ihantola, Antti Leinonen, Henrik Nygren, Jaakko Kurhila, Matti Luukkainen, Arto Hellas
2019ITiCSETowards a Common Instrument for Measuring Prior Programming Knowledge.Rodrigo Silva Duran, Jan-Mikael Rybicki, Arto Hellas, Sanna Suoranta
2019ITiCSENon-restricted Access to Model Solutions: A Good Idea?Henrik Nygren, Juho Leinonen, Arto Hellas
2019ITiCSEA Periodic Table of Computing Education Learning Theories.Claudia Szabo, Nickolas J. G. Falkner, Andrew Petersen, Heather Bort, Cornelia Connolly, Kathryn I. Cunningham, Peter Donaldson, Arto Hellas, James Robinson, Judy Sheard
2019ITiCSEReview and Use of Learning Theories within Computer Science Education Research: Primer for Researchers and Practitioners.Claudia Szabo, Nickolas J. G. Falkner, Andrew Petersen, Heather Bort, Kathryn I. Cunningham, Peter Donaldson, Arto Hellas, James Robinson, Judy Sheard
2019SIGCSEExploring the Applicability of Simple Syntax Writing Practice for Learning Programming.Antti Leinonen, Henrik Nygren, Nea Pirttinen, Arto Hellas, Juho Leinonen
2018ACELearning programming, syntax errors and institution-specific factors.Alireza Ahadi, Raymond Lister, Shahil Lal, Arto Hellas
2018ITiCSETaxonomizing features and methods for identifying at-risk students in computing courses.Arto Hellas, Petri Ihantola, Andrew Petersen, Vangel V. Ajanovski, Mirela Gutica, Timo Hynninen, Antti Knutas, Juho Leinonen, Chris H. Messom, Soohyun Nam Liao
2018ITiCSEPredicting academic performance: a systematic literature review.Arto Hellas, Petri Ihantola, Andrew Petersen, Vangel V. Ajanovski, Mirela Gutica, Timo Hynninen, Antti Knutas, Juho Leinonen, Chris H. Messom, Soohyun Nam Liao
2018ITiCSECrowdsourcing programming assignments with CrowdSorcerer.Nea Pirttinen, Vilma Kangas, Irene Nikkarinen, Henrik Nygren, Juho Leinonen, Arto Hellas
2018SIGCSEA Study of Pair Programming Enjoyment and Attendance using Study Motivation and Strategy Metrics.Onni Aarne, Petrus Peltola, Juho Leinonen, Arto Hellas
2018SIGCSESupporting Self-Regulated Learning with Visualizations in Online Learning Environments.Kalle Ilves, Juho Leinonen, Arto Hellas
2018SIGCSESubgoal Labeled Worked Examples in K-3 Education.Johanna Joentausta, Arto Hellas
2018SIGCSESocial Help-seeking Strategies in a Programming MOOC.Matti Nelimarkka, Arto Hellas
2018SIGCSEAchievement Goals in CS1: Replication and Extension.Daniel Zingaro, Michelle Craig, Leo Porter, Brett A. Becker, Yingjun Cao, Phillip T. Conrad, Diana Cukierman, Arto Hellas, Dastyni Loksa, Neena Thota
2017ACEPerformance and Consistency in Learning to Program.Alireza Ahadi, Raymond Lister, Shahil Lal, Juho Leinonen, Arto Hellas
2017ICERComparison of Time Metrics in Programming.Juho Leinonen, Leo Leppnen, Petri Ihantola, Arto Hellas
2017ICSEUsing and Collecting Fine-Grained Usage Data to Improve Online Learning Materials.Leo Leppnen, Juho Leinonen, Petri Ihantola, Arto Hellas
2017ICSEAssessing IOT Projects in University Education - A Framework for Problem-Based Learning.Hanna Menp, Samu Varjonen, Arto Hellas, Sasu Tarkoma, Tomi Mnnist
2017ITiCSESearching for Early Developmental Activities Leading to Computational Thinking Skills.Quintin I. Cutts, Peter Donaldson, Elizabeth Cole, Bedour Alshaigy, Mirela Gutica, Arto Hellas, Edurne Larraza-Mendiluze, Robert McCartney, Elizabeth Patitsas, Charles Riedesel
2017ITiCSEEarly Developmental Activities and Computing Proficiency.Quintin I. Cutts, Elizabeth Patitsas, Elizabeth Cole, Peter Donaldson, Bedour Alshaigy, Mirela Gutica, Arto Hellas, Edurne Larraza-Mendiluze, Robert McCartney, Charles Riedesel
2017ITiCSEPlagiarism in Take-home Exams: Help-seeking, Collaboration, and Systematic Cheating.Arto Hellas, Juho Leinonen, Petri Ihantola
2017SIGCSEProgsnap: Sharing Programming Snapshots for Research (Abstract Only).David Hovemeyer, Arto Hellas, Andrew Petersen, Jaime Spacco
2017SIGITEPredicting Academic Success Based on Learning Material Usage.Leo Leppnen, Juho Leinonen, Petri Ihantola, Arto Hellas
2016ICERControl-Flow-Only Abstract Syntax Trees for Analyzing Students' Programming Progress.David Hovemeyer, Arto Hellas, Andrew Petersen, Jaime Spacco