According to a recent meta-analysis published in Nature, ChatGPT has demonstrated significant positive effects on student learning outcomes, with a large positive impact on learning performance and moderate positive effects on learning perception and higher-order thinking based on data from 51 studies conducted between 2022 and 2025.
The effectiveness of ChatGPT in educational settings varies significantly depending on implementation factors. The strongest learning gains occur in problem-based learning environments and skill-driven courses12. Course type, learning model, and duration all moderate ChatGPT's impact on learning performance3. Studies recommend a 4-8 week implementation period for optimal results and suggest that ChatGPT is most effective when integrated as an intelligent tutor for developing higher-order thinking skills3.
ChatGPT provides several educational advantages, including personalized learning experiences, reduction in teacher workload, and interactive learning environments that respond to student needs4. It serves as effective scaffolding for personalized learning in various disciplines, from programming to language education4. However, researchers caution that distinguishing between the quality of ChatGPT outputs and actual learning gains requires more complex, project-based assessments rather than simple well-defined problems5.
ChatGPT excels particularly in skill-based learning environments, where it serves as a powerful tool for developing practical abilities across various disciplines. In programming education, ChatGPT has been shown to significantly improve computational thinking skills, algorithmic thinking, and problem-solving abilities12. Students using ChatGPT for skill development demonstrated enhanced self-programming abilities and increased motivation compared to control groups3.
Beyond technical fields, ChatGPT supports skill development in diverse areas including language acquisition, medical education, and critical thinking. Medical students benefit from ChatGPT's ability to simulate clinical scenarios and guide problem-solving processes during problem-based learning activities45. The technology functions as an intelligent tutor that can brainstorm solutions, validate hypotheses, and provide personalized guidance that adapts to individual learning styles6. This personalized approach allows students to develop higher-order thinking skills through active engagement rather than passive memorization, making ChatGPT particularly valuable for project-based and inquiry-driven learning environments78.
ChatGPT has demonstrated a moderate positive impact on fostering higher-order thinking skills, with its effectiveness varying based on course type and implementation role.12 When used as an intelligent tutor, ChatGPT significantly enhances critical thinking, problem-solving, and analytical abilities by providing diverse perspectives that challenge students' current ways of thinking.34 Research shows students report substantial improvements in their confidence to ask insightful questions (from 61% to 89%), analyze information (from 55% to 84%), and understand complex concepts (from 64% to 92%) after engaging with ChatGPT.3
The integration of ChatGPT with structured frameworks like Bloom's Taxonomy and argument mapping proves particularly effective for developing complex cognitive abilities.56 Studies recommend providing appropriate learning scaffolds when using ChatGPT to develop higher-order thinking rather than using it for direct solutions.78 This approach shifts students to the top of Bloom's taxonomy by encouraging them to apply, analyze, evaluate, and create rather than simply consume information, making ChatGPT a valuable tool for cultivating intellectually engaging learning environments despite varied user perceptions.94