Effects of Orai AI on ESL introvert students’ speaking skills: Mixed method

Abstract

This study investigates the effectiveness of Orai, an AI-powered platform, in enhancing the speaking performance of ESL students, emphasizing the critical role of speaking in digital communication. Employing a mixed-method approach within a pre-test and post-test design, 107 engineering students were selected through comprehensive sampling. The participants were categorized into two groups as Introvert and extrovert group and practiced speaking using Orai. Their progress was assessed through pre-and post-tests, with results analyzed using paired-sample t-tests and one-sample t-tests. The findings revealed a statistically significant difference between the two groups, with introverted students showing greater improvement in their speaking abilities with Task-Based Instruction Theory. Specifically, they demonstrated enhanced conciseness, fewer filler words, increased confidence, greater energy, and better control over their speaking pace. These improvements suggest that AI-based tools like Orai can effectively support language development, particularly for students who may struggle with traditional speaking practice. Furthermore, qualitative insights from semi-structured interviews highlighted the positive perceptions of students regarding AI-assisted learning. Many students expressed that AI tools provided valuable feedback, personalized learning experiences, and a comfortable environment for practice, contributing to their overall progress in speaking skills.