| Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools J Prather, J Leinonen, N Kiesler, JG Benario, S Lau, S MacNeil, N Norouzi, ... arXiv preprint arXiv:2412.14732, 2024 | 1 | 2024 |
| Breaking the Programming Language Barrier: Multilingual Prompting to Empower Non-Native English Learners J Prather, BN Reeves, P Denny, J Leinonen, S MacNeil, A Luxton-Reilly, ... arXiv preprint arXiv:2412.12800, 2024 | | 2024 |
| Detecting Learning Behaviour in Programming Assignments by Analysing Versioned Repositories J Chen, S Lau, J Leinonen, V Terragni, N Giacaman IEEE Access, 2024 | | 2024 |
| Experiences from integrating large language model chatbots into the classroom A Hellas, J Leinonen, L Leppänen Proceedings of the 2024 on ACM Virtual Global Computing Education Conference …, 2024 | 7 | 2024 |
| Integrating Natural Language Prompting Tasks in Introductory Programming Courses C Kerslake, P Denny, DH Smith IV, J Prather, J Leinonen, A Luxton-Reilly, ... Proceedings of the 2024 on ACM Virtual Global Computing Education Conference …, 2024 | 2 | 2024 |
| Synthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing Students S MacNeil, M Rogalska, J Leinonen, P Denny, A Hellas, X Crosland Proceedings of the 2024 on ACM Virtual Global Computing Education Conference …, 2024 | | 2024 |
| " Sometimes You Just Gotta Risk It for the Biscuit": A Portrait of Student Risk-Taking J Leinonen, P Denny Proceedings of the 2024 on ACM Virtual Global Computing Education Conference …, 2024 | | 2024 |
| Why students fail to revise? Analysis of written metalinguistic feedback and cognitive effort on revision success JM Rybicki, W Hämäläinen, KK Pitkänen, L Malmi Ampersand 13, 100211, 2024 | | 2024 |
| Howzat? Appealing to Expert Judgement for Evaluating Human and AI Next-Step Hints for Novice Programmers NCC Brown, P Weill-Tessier, J Leinonen, P Denny, M Kölling arXiv preprint arXiv:2411.18151, 2024 | | 2024 |
| Post Primary Teachers' Perspectives on Machine Learning and Artificial Intelligence in the Leaving Certificate Computer Science Curriculum J Mahon, B A. Becker, B Mac Namee, J Leinonen Proceedings of the 24th Koli Calling International Conference on Computing …, 2024 | | 2024 |
| On the Opportunities of Large Language Models for Programming Process Data J Edwards, A Hellas, J Leinonen arXiv preprint arXiv:2411.00414, 2024 | 1 | 2024 |
| LLM-itation is the Sincerest Form of Data: Generating Synthetic Buggy Code Submissions for Computing Education J Leinonen, P Denny, O Kiljunen, S MacNeil, S Sarsa, A Hellas arXiv preprint arXiv:2411.10455, 2024 | | 2024 |
| You can learn well regardless of your motivation type–Evidence from a virtual learning environment H Pesonen, S Leikas, L Malmi Learning and Motivation 88, 102069, 2024 | | 2024 |
| Midwives’ account of virtual reality childbirth education M Siivola, L Malmi Finnish Journal of eHealth and eWelfare 16 (3), 362-376, 2024 | | 2024 |
| Trends in STEM Education Research in Europe in 2005-2019 J Lampiselkä, A Kaasinen, P Kinnunen, L Malmi Πανελλήνιο Συνέδριο της Διδακτικής των Φυσικών Επιστημών και Νέων …, 2024 | | 2024 |
| Computing-specific pedagogies and theoretical models: common uses and relationships L Malmi, J Sheard, C Szabo, P Kinnunen arXiv preprint arXiv:2409.12245, 2024 | | 2024 |
| The widening gap: The benefits and harms of generative ai for novice programmers J Prather, BN Reeves, J Leinonen, S MacNeil, AS Randrianasolo, ... Proceedings of the 2024 ACM Conference on International Computing Education …, 2024 | 37 | 2024 |
| Evaluating Contextually Personalized Programming Exercises Created with Generative AI E Logacheva, A Hellas, J Prather, S Sarsa, J Leinonen Proceedings of the 2024 ACM Conference on International Computing Education …, 2024 | 8 | 2024 |
| Students Struggle with Concepts in Dijkstra's Algorithm A Tilanterä, J Sorva, O Seppälä, A Korhonen Proceedings of the 2024 ACM Conference on International Computing Education …, 2024 | 2 | 2024 |
| Flipping Childbirth Education M Siivola, L Malmi The Journal of Perinatal Education 33 (3), 127-147, 2024 | 1 | 2024 |
| Prompts First, Finally BN Reeves, J Prather, P Denny, J Leinonen, S MacNeil, BA Becker, ... arXiv preprint arXiv:2407.09231, 2024 | 1 | 2024 |
| Analyzing Students' Preferences for LLM-Generated Analogies S Bernstein, P Denny, J Leinonen, M Littlefield, A Hellas, S MacNeil Proceedings of the 2024 on Innovation and Technology in Computer Science …, 2024 | 3 | 2024 |
| How Instructors Incorporate Generative AI into Teaching Computing J Prather, J Leinonen, N Kiesler, JG Benario, S Lau, S MacNeil, N Norouzi, ... Proceedings of the 2024 on Innovation and Technology in Computer Science …, 2024 | 10 | 2024 |
| Evaluating Language Models for Generating and Judging Programming Feedback C Koutcheme, N Dainese, A Hellas, S Sarsa, J Leinonen, S Ashraf, ... arXiv preprint arXiv:2407.04873, 2024 | 4 | 2024 |
| Self-Regulation, Self-Efficacy, and Fear of Failure Interactions with How Novices Use LLMs to Solve Programming Problems LE Margulieux, J Prather, BN Reeves, BA Becker, G Cetin Uzun, D Loksa, ... Proceedings of the 2024 on Innovation and Technology in Computer Science …, 2024 | 7 | 2024 |
| Explaining code with a purpose: An integrated approach for developing code comprehension and prompting skills P Denny, DH Smith IV, M Fowler, J Prather, BA Becker, J Leinonen Proceedings of the 2024 on Innovation and Technology in Computer Science …, 2024 | 17 | 2024 |
| " Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students Using Large Language Models S Bernstein, P Denny, J Leinonen, L Kan, A Hellas, M Littlefield, S Sarsa, ... Proceedings of the 2024 on Innovation and Technology in Computer Science …, 2024 | 10 | 2024 |
| Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge C Koutcheme, N Dainese, S Sarsa, A Hellas, J Leinonen, P Denny Proceedings of the 2024 on Innovation and Technology in Computer Science …, 2024 | 10 | 2024 |
| A comparative analysis of master’s theses in STEM-related disciplines published in Türkiye and Finland O Oktay, I Reisoglu, S Gul, D Teke, M Sozbilir, I Gunes, R Yildiz, G Atila, ... Scandinavian Journal of Educational Research, 1-29, 2024 | 1 | 2024 |
| Benchmarking Educational Program Repair C Koutcheme, N Dainese, S Sarsa, J Leinonen, A Hellas, P Denny arXiv preprint arXiv:2405.05347, 2024 | 4 | 2024 |
| On the comprehensibility of functional decomposition: An empirical study E Tempero, P Denny, J Finnie-Ansley, A Luxton-Reilly, D Kirk, J Leinonen, ... Proceedings of the 32nd IEEE/ACM International Conference on Program …, 2024 | 1 | 2024 |
| Seth Bernstein, Paul Denny, Juho Leinonen, Lauren Kan A Hellas, M Littlefield, S Sarsa, S MacNeil | | 2024 |
| Using Large Language Models for Teaching Computing J Leinonen, S MacNeil, P Denny, A Hellas Proceedings of the 55th ACM Technical Symposium on Computer Science …, 2024 | | 2024 |
| Discussing the Changing Landscape of Generative AI in Computing Education S MacNeil, J Leinonen, P Denny, N Kiesler, A Hellas, J Prather, ... Proceedings of the 55th ACM Technical Symposium on Computer Science …, 2024 | 9 | 2024 |
| AI in Computing Education from Research to Practice B Akram, J Leinonen, N Norouzi, J Prather, L Zhang Proceedings of the 55th ACM Technical Symposium on Computer Science …, 2024 | | 2024 |
| Detecting ChatGPT-generated code submissions in a CS1 course using machine learning models M Hoq, Y Shi, J Leinonen, D Babalola, C Lynch, T Price, B Akram Proceedings of the 55th ACM Technical Symposium on Computer Science …, 2024 | 21 | 2024 |
| Prompt Problems: A new programming exercise for the generative AI era P Denny, J Leinonen, J Prather, A Luxton-Reilly, T Amarouche, BA Becker, ... Proceedings of the 55th ACM Technical Symposium on Computer Science …, 2024 | 89 | 2024 |
| Solving Proof Block Problems Using Large Language Models S Poulsen, S Sarsa, J Prather, J Leinonen, BA Becker, A Hellas, P Denny, ... Proceedings of the 55th ACM Technical Symposium on Computer Science …, 2024 | 8 | 2024 |
| Instructor Perceptions of AI Code Generation Tools-A Multi-Institutional Interview Study J Sheard, P Denny, A Hellas, J Leinonen, L Malmi, Simon Proceedings of the 55th ACM Technical Symposium on Computer Science …, 2024 | 19 | 2024 |
| Understanding Pathways to Computing Education Research (CER) K Sanders, A Hellas, L Malmi Koli Calling-International Conference on Computing Education Research, 2024 | | 2024 |
| Evaluating llm-generated worked examples in an introductory programming course B Jury, A Lorusso, J Leinonen, P Denny, A Luxton-Reilly Proceedings of the 26th Australasian Computing Education Conference, 77-86, 2024 | 41 | 2024 |
| Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models S MacNeil, P Denny, A Tran, J Leinonen, S Bernstein, A Hellas, S Sarsa, ... Proceedings of the 26th Australasian Computing Education Conference, 11-18, 2024 | 22 | 2024 |
| Computing education in the era of generative AI P Denny, J Prather, BA Becker, J Finnie-Ansley, A Hellas, J Leinonen, ... Communications of the ACM 67 (2), 56-67, 2024 | 189 | 2024 |
| Interactions with Prompt Problems: A New Way to Teach Programming with Large Language Models J Prather, P Denny, J Leinonen, DH Smith IV, BN Reeves, S MacNeil, ... arXiv preprint arXiv:2401.10759, 2024 | 10 | 2024 |
| Machine Learning Applications Supporting Large Scale Programming Education S Sarsa Aalto University, 2024 | | 2024 |
| Advantages of virtual reality childbirth education M Siivola, T Leinonen, L Malmi Computers & Education: X Reality 4, 100058, 2024 | 5 | 2024 |
| Decades of Striving for Pedagogical and Technological Alignment L Haaranen, L Ahrenberg, A Hellas Proceedings of the 23rd Koli Calling International Conference on Computing …, 2023 | 1 | 2023 |
| Domain-Specific Theories of Teaching Computing: Do they Inform Practice? L Malmi, J Sheard, J Sinclair, P Kinnunen, Simon Proceedings of the 23rd Koli Calling International Conference on Computing …, 2023 | 2 | 2023 |
| Understanding Pathways to Computing Education Research (CER) L Malmi, A Hellas, K Sanders Proceedings of the 23rd Koli Calling International Conference on Computing …, 2023 | | 2023 |
| Teaching Programming with Graphics: Pitfalls and a Solution L Chiodini, J Sorva, M Hauswirth Proceedings of the 2023 ACM SIGPLAN International Symposium on SPLASH-E, 1-12, 2023 | 2 | 2023 |
| Implications of Edge Computing for Static Site Generation J Vepsäläinen, A Hellas, P Vuorimaa arXiv preprint arXiv:2309.05669, 2023 | 7 | 2023 |
| The State of Disappearing Frameworks in 2023 J Vepsäläinen, A Hellas, P Vuorimaa arXiv preprint arXiv:2309.04188, 2023 | 4 | 2023 |
| Exploring the Interplay of Achievement Goals, Self-Efficacy, Prior Experience and Course Achievement H Pesonen, J Leinonen, L Haaranen, A Hellas Proceedings of the 2023 Conference on United Kingdom & Ireland Computing …, 2023 | 2 | 2023 |
| The effect of written metalinguistic feedback on cognitive effort and revision success JM Rybicki, W Hämäläinen, KK Pitkänen, L Malmi Biennial EARLI Conference for Research on Learning and Instruction …, 2023 | | 2023 |
| Evaluating Distance Measures for Program Repair C Koutcheme, S Sarsa, J Leinonen, L Haaranen, A Hellas Proceedings of the 2023 ACM Conference on International Computing Education …, 2023 | 1 | 2023 |
| Exploring the responses of large language models to beginner programmers’ help requests A Hellas, J Leinonen, S Sarsa, C Koutcheme, L Kujanpää, J Sorva Proceedings of the 2023 ACM Conference on International Computing Education …, 2023 | 126 | 2023 |
| Synthesizing research on programmers’ mental models of programs, tasks and concepts—A systematic literature review A Heinonen, B Lehtelä, A Hellas, F Fagerholm Information and Software Technology, 107300, 2023 | 25 | 2023 |
| Considering Computing Education in Undergraduate Computer Science Programmes Q Cutts, M Kallia, R Anderson, T Crick, M Devlin, M Farghally, C Mirolo, ... Proceedings of the 2023 Conference on Innovation and Technology in Computer …, 2023 | 4 | 2023 |
| Empirical Evaluation of a Differentiated Assessment of Data Structures: The Role of Prerequisite Skills M Begum, P Haglund, A Korhonen, V Lonati, M Monga, F Strömbäck, ... Informatics in Education, 2023 | 1 | 2023 |
| Automated Questions about Learners' Own Code Help to Detect Fragile Prerequisite Knowledge T Lehtinen, O Seppälä, A Korhonen Proceedings of the 2023 Conference on Innovation and Technology in Computer …, 2023 | 5 | 2023 |
| Evaluating the performance of code generation models for solving Parsons problems with small prompt variations B Reeves, S Sarsa, J Prather, P Denny, BA Becker, A Hellas, B Kimmel, ... Proceedings of the 2023 Conference on Innovation and Technology in Computer …, 2023 | 58 | 2023 |
| Comparing code explanations created by students and large language models J Leinonen, P Denny, S MacNeil, S Sarsa, S Bernstein, J Kim, A Tran, ... Proceedings of the 2023 Conference on Innovation and Technology in Computer …, 2023 | 188 | 2023 |
| Seeing Program Output Improves Novice Learning Gains J Leinonen, A Hellas, J Edwards Proceedings of the 2023 Conference on Innovation and Technology in Computer …, 2023 | | 2023 |
| Automated Program Repair Using Generative Models for Code Infilling C Koutcheme, S Sarsa, J Leinonen, A Hellas, P Denny International Conference on Artificial Intelligence in Education, 798-803, 2023 | 16 | 2023 |
| Human vs Machine: Comparison of Student-generated and AI-generated Educational Content P Denny, H Khosravi, A Hellas, J Leinonen, S Sarsa arXiv preprint arXiv:2306.10509, 2023 | 4 | 2023 |
| The Rise of Disappearing Frameworks in Web Development J Vepsäläinen, A Hellas, P Vuorimaa International Conference on Web Engineering, 319-326, 2023 | 14 | 2023 |
| Can We Trust AI-Generated Educational Content? Comparative Analysis of Human and AI-Generated Learning Resources P Denny, H Khosravi, A Hellas, J Leinonen, S Sarsa arXiv preprint arXiv:2306.10509, 2023 | 41 | 2023 |
| Factors Affecting Compilable State at Each Keystroke in CS1 S Scott, A Hellas, J Leinonen, J Edwards 2023 IEEE/ACM 45th International Conference on Software Engineering …, 2023 | | 2023 |
| Lessons Learned From Four Computing Education Crowdsourcing Systems N Pirttinen, P Denny, A Hellas, J Leinonen IEEE Access 11, 22982-22992, 2023 | 4 | 2023 |
| The Implications of Large Language Models for CS Teachers and Students S MacNeil, J Kim, J Leinonen, P Denny, S Bernstein, BA Becker, ... Proceedings of the 54th ACM Technical Symposium on Computer Science Education 2, 2023 | 36 | 2023 |
| Time-constrained Code Recall Tasks for Monitoring the Development of Programming Plans A Heinonen, A Hellas Proceedings of the 54th ACM Technical Symposium on Computer Science …, 2023 | | 2023 |
| Experiences from using code explanations generated by large language models in a web software development e-book S MacNeil, A Tran, A Hellas, J Kim, S Sarsa, P Denny, S Bernstein, ... Proceedings of the 54th ACM Technical Symposium on Computer Science …, 2023 | 202 | 2023 |
| Using large language models to enhance programming error messages J Leinonen, A Hellas, S Sarsa, B Reeves, P Denny, J Prather, BA Becker Proceedings of the 54th ACM Technical Symposium on Computer Science …, 2023 | 197 | 2023 |
| G is for Generalisation: Predicting Student Success from Keystrokes Z Pullar-Strecker, FD Pereira, P Denny, A Luxton-Reilly, J Leinonen Proceedings of the 54th ACM Technical Symposium on Computer Science …, 2023 | 4 | 2023 |
| Experiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them? N Pirttinen, A Hellas, J Leinonen Proceedings of the 25th Australasian Computing Education Conference, 123-131, 2023 | 2 | 2023 |
| Automated Questionnaires About Students’ JavaScript Programs: Towards Gauging Novice Programming Processes T Lehtinen, L Haaranen, J Leinonen Proceedings of the 25th Australasian Computing Education Conference, 49-58, 2023 | 16 | 2023 |
| Editorial for the Second Special Issue on “Conceptualizing and Using Theory in Computing Education Research” L Malmi, J Tenenberg ACM Transactions on Computing Education 23 (1), 1-4, 2023 | 2 | 2023 |
| Virtual Reality Childbirth Education With 360° Videos M Siivola, E Tiainen, E Ekholm, T Leinonen, L Malmi The Journal of Perinatal Education 32 (1), 35-47, 2023 | 3 | 2023 |
| Exploring the Past, Present and Future of Computing Education Research: An Introduction M Apiola, S López-Pernas, M Saqr, L Malmi, M Daniels Past, Present and Future of Computing Education Research: A Global …, 2023 | | 2023 |
| Computing Education Research in Finland L Malmi, A Hellas, P Ihantola, V Isomöttönen, I Jormanainen, T Kilamo, ... Past, Present and Future of Computing Education Research: A Global …, 2023 | 4 | 2023 |
| What is Computing Education Research (CER)? M Daniels, L Malmi, A Pears, Simon Past, Present and Future of Computing Education Research: A Global …, 2023 | 6 | 2023 |
| The Evolution of Computing Education Research: A Meta-Analytic Perspective L Malmi, J Sinclair, J Sheard, Simon, P Kinnunen Past, Present and Future of Computing Education Research: A Global …, 2023 | 3 | 2023 |
| Virtual Reality Childbirth Education With 360 Videos E Tiainen, E Ekholm, T Leinonen, L Malmi The Journal of Perinatal Education 32 (1), 36, 2023 | | 2023 |
| Misconceptions and the Beginner Programmer J Sorva Computer Science Education: Perspectives on Teaching and Learning in School …, 2023 | | 2023 |
| A Selective Review of Computing Education Research L Malmi, A Johri International Handbook of Engineering Education Research, 573-593, 2023 | 3 | 2023 |
| Reflections on Theory L Malmi ACM Transactions on Computing Education 23 (1), 2, 2023 | 2 | 2023 |
| Development and Use of Domain-specific Learning Theories, Models, and Instruments in Computing Education L Malmi, J Sheard, P Kinnunen, Simon, J Sinclair ACM Transactions on Computing Education 23 (1), 1-48, 2022 | 18 | 2022 |
| Towards Giving Timely Formative Feedback and Hints to Novice Programmers J Jeuring, H Keuning, S Marwan, D Bouvier, C Izu, N Kiesler, T Lehtinen, ... Proceedings of the 2022 Working Group Reports on Innovation and Technology …, 2022 | 44 | 2022 |
| Parsons problems and beyond: Systematic literature review and empirical study designs BJ Ericson, P Denny, J Prather, R Duran, A Hellas, J Leinonen, CS Miller, ... Proceedings of the 2022 Working Group Reports on Innovation and Technology …, 2022 | 49 | 2022 |
| Conceptualizing and Using Theory in Computing Education Research J Tenenberg, L Malmi ACM Transactions on Computing Education 22 (4), 1-8, 2022 | 8 | 2022 |
| Automatically Generating CS Learning Materials with Large Language Models S MacNeil, A Tran, J Leinonen, P Denny, J Kim, A Hellas, S Bernstein, ... arXiv preprint arXiv:2212.05113, 2022 | 53 | 2022 |
| Finding Significant p in Coffee or Tea: Mildly Distasteful S Sarsa, A Hellas, J Leinonen Proceedings of the 22nd Koli Calling International Conference on Computing …, 2022 | 1 | 2022 |
| Experiences With and Lessons Learned on Deadlines and Submission Behavior FEV Castro, J Leinonen, A Hellas Proceedings of the 22nd Koli Calling International Conference on Computing …, 2022 | 7 | 2022 |
| Trends From Computing Education Research Conferences: Increasing Submissions and Decreasing Acceptance Rates J Leinonen, N Pirttinen, A Hellas Proceedings of the 22nd Koli Calling International Conference on Computing …, 2022 | 1 | 2022 |
| Robosourcing Educational Resources--Leveraging Large Language Models for Learnersourcing P Denny, S Sarsa, A Hellas, J Leinonen arXiv preprint arXiv:2211.04715, 2022 | 48 | 2022 |
| Evaluating CodeClusters for Effectively Providing Feedback on Code Submissions T Koivisto, A Hellas 2022 IEEE Frontiers in Education Conference (FIE), 1-9, 2022 | 9 | 2022 |
| On Things that Matter in Learning Programming: Towards a Scale for New Programming Students H Pesonen, A Hellas 2022 IEEE Frontiers in Education Conference (FIE), 1-9, 2022 | 4 | 2022 |
| How to Help to Ask for Help? Help Request Prompt Structure Influence on Help Request Quantity and Course Retention S Sarsa, J Pettersson, A Hellas 2022 IEEE Frontiers in Education Conference (FIE), 1-9, 2022 | 1 | 2022 |
| Piloting Natural Language Generation for Personalized Progress Feedback L Leppänen, A Hellas, J Leinonen 2022 IEEE Frontiers in Education Conference (FIE), 1-8, 2022 | 3 | 2022 |
| Empirical Evaluation of Deep Learning Models for Knowledge Tracing: Of Hyperparameters and Metrics on Performance and Replicability S Sarsa, J Leinonen, A Hellas Journal of Educational Data Mining 14 (2), 2022 | 21 | 2022 |
Lauri MalmiProfessor of Computer Science, Aalto UniversityVerified email at aalto.fi
