A recent study conducted by experts at the University of East Anglia (UEA) has examined the effectiveness of artificial intelligence (AI) writing tools like ChatGPT in producing academic essays, providing insight into the current capabilities and limitations of AI in higher education.
The research involved a direct comparison between 145 essays written by actual university students and 145 essays generated by ChatGPT on the same topics. The team observed that while the AI-produced essays were "impressively coherent and grammatically sound," they failed to capture a key element that differentiates human writing— a "personal touch."
Professor Ken Hyland, from UEA's School of Education and Lifelong Learning, explained the context behind the study, noting the widespread anxiety among educators since the public release of ChatGPT. Many teachers have expressed concern that AI tools could be used by students to complete assignments unfairly, potentially undermining core literacy and critical thinking skills. "The fear is that ChatGPT and other AI writing tools potentially facilitate cheating and may weaken core literacy and critical thinking skills," he said.
The study specifically focused on how writers engage their readers, revealing that although ChatGPT could mimic certain academic writing conventions, it struggled to inject personality or a clear stance into the text. In contrast, student-written essays frequently employed "engagement strategies" such as rhetorical questions and direct appeals to readers, resulting in work that was generally more engaging, convincing, and reflective of diverse perspectives.
Professor Hyland highlighted the educational importance of these findings: "When a student comes to school, college, or university, we're not teaching them how to write—we're teaching them how to think. That's something no algorithm can replicate."
The research suggests that while AI tools like ChatGPT demonstrate impressive language skills, their current inability to emulate authentic human engagement and critical thought poses significant challenges for their use in academic writing. This study adds to ongoing discussions about the role of AI in education and its implications for teaching and learning processes.
Source: Noah Wire Services