Does ChatGPT Help You Learn Better or Just Get in the Way? What Research Says

Contents:

• What studies were included in the review
• How does the use of ChatGPT affect academic performance and cognitive skills
• What concerns were expressed by the authors of the review
• How does the use of ChatGPT affect students' motivation and self-efficacy
• Why does assistance from a neural network seem to have a negative effect on diligence
• What advice did the authors of the review give to researchers

What studies were included in the review

The researchers analyzed 69 studies on the impact of ChatGPT on the educational process. These studies cover various levels of education, from elementary school to university, and touch on a wide range of subjects - from linguistics to programming and medicine. It's important to note that the results of these studies are mixed: some studies have shown significant improvements in academic outcomes, while others have found negative consequences or no noticeable effects.

The meta-analysis included both surveys and empirical studies, including experimental and cross-sectional methods. The effects of ChatGPT were assessed based on the subjective opinions of survey participants and predetermined criteria developed by the researchers. These criteria include changes in academic performance, the level of mastery of cognitive skills, motivation, as well as the effort that participants put into the learning process, and self-efficacy. The latter concept, according to Albert Bandura's social cognitive theory, implies a person's confidence in their abilities and ability to achieve their goals.

The integration of ChatGPT into the educational process demonstrates a variety of approaches and methods of use. In most cases, participants used a chatbot from OpenAI, but some experiments also used applications developed on its basis. Students interacted with artificial intelligence to perform various tasks, such as working with texts (retelling, summarizing, explaining terms), analyzing program code for errors, as well as preparing homework and solving tests. The experiments ranged in duration from short-term interactions lasting ten minutes to long-term projects with regular use of AI for 16 weeks. This approach to integrating ChatGPT into learning opens up new horizons in educational methods and helps optimize the process of material assimilation.

Each study involved over one hundred people.

How ChatGPT Impacts Academic Performance and Cognitive Skills

Research shows that using ChatGPT can significantly improve student performance. Students who have begun to use artificial intelligence for educational purposes report an increase in their grades. This is due to the personalization of the learning process, access to a variety of data and opinions, and the opportunity for deeper interaction with the educational material. For example, ChatGPT can provide additional explanations, hints, and recommendations, which contributes to more effective assimilation of information. The introduction of AI in education opens up new horizons for students and helps them achieve better results.

Researchers are actively studying the positive impact of various factors on student performance. It is important to understand that academic success can depend on many aspects, including motivation, teaching methods, and the psychological state of students. By analyzing these factors, it is possible to identify key elements that contribute to increased academic performance and a better educational process. This research opens up new opportunities for optimizing curricula and creating a more effective educational environment.

• the level of education at which ChatGPT was used (school or university);
• the subject area of ​​​​education;
• the conditions of the experiment (in a regular classroom or in a laboratory setting);
• the duration and mode of application of ChatGPT.

The use of chatbots is widely used in various fields, including the arts, social and human sciences, medicine, and the natural sciences. These technologies can improve interaction with users, automate processes, and provide access to information in a convenient form. Chatbots can be an effective tool for training, customer support, and research, making them indispensable in today's world.

Research shows that the environment in which experiments are conducted significantly influences the results. A more significant positive impact on student performance has been observed in a regular classroom setting compared to a laboratory setting. This highlights the importance of a natural learning environment for achieving better learning outcomes.

The duration of the subjects' interaction with artificial intelligence turned out to be an important factor in obtaining the results. Studies have shown that the greatest effect is observed in experiments lasting from one week to one month. At the same time, longer studies that lasted five weeks or more demonstrate lower effectiveness. Short experiments lasting up to one week did not reveal significant results. Thus, the optimal duration of interaction with AI to achieve the maximum effect is from one to four weeks.

What doubts did the authors of the review express?

The authors of the review regarding improving academic performance using ChatGPT express skepticism and recommend a cautious approach to conclusions. In some studies, experiment participants were allowed to use neural networks when completing tasks designed to assess knowledge. This means that as a result of completing such tasks for which grades were assigned, student success may have been due not to an improvement in their knowledge, but to an improvement in the quality of task performance thanks to the assistance of AI. Moreover, a number of studies do not specify whether students were allowed to use AI assistants during knowledge assessments. Therefore, in some cases, improved academic performance may be due not to students' actual knowledge, but to the ability of the neural network to cheat.

Studies show that using ChatGPT allows participants to significantly improve their skills in analyzing, evaluating, and synthesizing new knowledge. However, the authors of these studies express doubts about the validity of this effect.

Some studies that have established a link between bot use and improved cognitive abilities relied on student self-assessment. This means that the students themselves assessed whether their ability to analyze information and synthesize new knowledge improved after working with the neural network. The authors of the meta-analysis emphasize that such findings should be supported by objective test results and solutions to various problems that could confirm the development of these skills. This is important for increasing the reliability of the findings and understanding the real impact of neural networks on cognitive abilities.

To achieve optimal results in search engines, it is important to create high-quality content. Make sure your text contains keywords that match the topic and interests of your audience. This will help attract attention and improve page ranking. Don't forget about the importance of uniqueness and relevance of the text. Regularly updating information also helps improve search engine visibility. Use internal and external links to increase the authority of your content. Focus on creating informative and useful materials that address user needs. Pay attention to text structure and readability to ensure a comfortable reading experience.

Quote of the Week: The Negative Consequences of Simplifying Education

In recent years, there has been a trend toward simplifying educational processes, which has raised concerns among experts. They emphasize that reducing the complexity of learning can negatively impact students' understanding of the material and their ability to think critically. Simplifying educational programs can lead to superficial knowledge, which in turn reduces the overall quality of education. Maintaining intellectual challenge in curricula is essential to ensure that future professionals are adequately prepared and able to solve complex real-world problems.

How ChatGPT Impacts Student Motivation and Self-Efficacy

Research shows that using ChatGPT can significantly increase student motivation and make the learning process more enjoyable. Results from student surveys and questionnaires conducted during observations support this conclusion. However, the authors of the review express doubts about the long-term nature of these effects. Most of the analyzed studies had a limited time frame, making it difficult to assess the sustainability of ChatGPT's positive impact on the learning process. Therefore, it cannot be said with certainty that the increase in motivation is solely due to the implementation of ChatGPT in educational practice. It's possible that the observed effect was the result of a sense of novelty—the unusual interaction with the neural network could temporarily enhance learning, but over time this feeling could become habitual and lose its effectiveness.

Changing the routine learning process, even if not technology-related, can have a significant positive impact on students. Interesting innovations can increase motivation and engagement, promoting more effective learning.

The increase in motivation among schoolchildren and university students is uneven. Among schoolchildren, the effect is only slightly noticeable. Experts attribute this to the fact that university assignments and their difficulty are better suited to ChatGPT's capabilities. Furthermore, students tend to have more experience with modern technology, making it easier for them to use AI solutions. Thus, differences in the perception and use of AI across age groups are becoming apparent.

Research shows that using ChatGPT does not significantly impact self-efficacy, which is defined as belief in one's own abilities and ability to succeed. A meta-analysis revealed that, despite several studies claiming the positive impact of the neural network in this area, they have not sufficiently explored the mechanisms that contribute to increased self-efficacy. Possible reasons for this effect may lie in the development of knowledge and skills, as students receive individualized feedback and prompts from the neural network. Furthermore, increased motivation to learn may be associated with improved emotional state, which, in turn, may have arisen due to the bot's empathetic responses and praise for students. The effectiveness of ChatGPT in the educational process requires further study to understand how it can contribute to improving student self-efficacy.

A year ago, Benjamin Riley, an American expert in pedagogy and the implementation of artificial intelligence in education, criticized an AI tutor based on GPT-4 and launched on the Khan Academy platform. He noted that this tutor insufficiently rewarded students for their achievements, which contradicts pedagogical principles. Perhaps, following this criticism, GPT and similar neural network AI assistants have improved their algorithms, allowing them to more actively praise users for their learning successes. This emphasizes the importance of feedback and support in the educational process, which can significantly increase student motivation.

Why neural network assistance seems to be detrimental to student engagement

A meta-analysis demonstrated that using ChatGPT in educational settings reduces students' cognitive load. As a result, students begin to rely on artificial intelligence assistance, which may lead to decreased effort and slack in their learning. This highlights the need for a balanced approach to integrating technology into educational methods to maintain student motivation and active participation in the learning process.

In The meta-analysis included studies that demonstrated the positive impact of neural networks on students' mental effort and improved academic performance. However, it is worth noting that in some cases, participants were allowed to use neural networks while taking tests, which may call into question the validity of these findings. In contrast, a study in which students were prohibited from using ChatGPT during testing showed not only a decrease in mental effort but also a deterioration in reasoning and argumentation abilities. These results highlight the importance of traditional teaching methods and critical thinking in the educational process.

A study conducted by researchers from the United States and Hungary found that high school students using ChatGPT performed better on mathematics tests than those who did not use a neural network. However, when access to ChatGPT was blocked to participants, their performance declined, resulting in lower scores compared to those who had never used the tool. This may indicate a decrease in cognitive effort for students relying on bot support, highlighting the importance of a balanced use of technology in the educational process.

Rework the text, maintaining the main topic and adding SEO optimization, avoiding unnecessary characters and structured sections. Ensure the content remains relevant and informative.

Read also:

An expert expressed the opinion that the introduction of artificial intelligence into the educational process may prove ineffective. The main reasons for this include the lack of preparedness of educational institutions for such changes and potential adaptation issues for both teachers and students. Despite the significant potential of AI to personalize learning and optimize the educational process, there is concern that technology will not be able to completely replace traditional teaching and interaction methods. This statement highlights the importance of a holistic approach to integrating AI into education, taking into account both technical and human aspects.

What advice did the review authors give to researchers?

The review authors cautiously concluded that ChatGPT has significant potential in education. However, more comprehensive research is needed to be certain. It is important that these studies include:

• assessing students' knowledge objectively, without allowing them to use the neural network when completing assessment tasks;
• measuring the long-term impact of the AI ​​assistant on the learning process;
• investigating the mechanisms by which ChatGPT has (if any) beneficial effects on educational outcomes.

We also expect similar studies to appear in the near future.