Evaluating the Impact of Generative Ai Tools on Learning Outcomes of Computer Science Students in Tertiary Institutions in New Bussa Metropolis, Niger State, Nigeria

Abstract

This study investigates the familiarity levels, perceived benefits, effectiveness, and challenges of using generative AI tool (ChatGPT) in  computer science education, particularly in aiding students' understanding of programming concepts. A sample of 103 computer science  students was surveyed, with the results analyzed using descriptive statistics, chi-square tests, and one-sample t-tests. The findings  indicate that students are moderately familiar with generative AI tools, with differences observed by level of study. Students perceived  ChatGPT as beneficial in enhancing their understanding and problem-solving skills, with statistically significant results supporting the  positive influence of ChatGPT on learning outcomes. Additionally, ChatGPT was found to be effective in helping students comprehend  and apply complex programming concepts to real-world problems. While students reported some challenges, including issues with  accuracy and engagement, these challenges were not statistically significant. The study concludes that ChatGPT is a valuable educational  tool with potential to improve programming education, though proper training and ethical guidelines are recommended to maximize its  benefits.