Contents:
Course with employment: "Profession Methodologist from scratch to PRO»
Find out moreWhich aspects of the educational experience are the most important?
Dean of the School of Education and moderator of the discussion, Asya Fursova, proposed defining what a student's educational experience includes, as well as which of its elements influence the assessment of the quality of education. The discussion participants highlighted several key aspects that play a significant role in shaping a successful educational process.
Mikhail Sverdlov, Business Development Director at Skypro, noted that many people rarely articulate their educational goals. He cited internal statistics from Skyeng, which indicate that a significant portion of adult students do not have a clear idea of why they are studying, for example, English. This lack of understanding can lead to low motivation and ineffective learning. Clearly defined educational goals help students not only focus on the learning process but also achieve more meaningful results. By setting specific goals, such as improving speaking skills or preparing for exams, students can use their time and resources more effectively, ultimately leading to successful language acquisition.
At Skyeng, only 20% of students can clearly define their learning goals. Another 60% rely on the opinions of others when answering questions about their reasons for learning the language: "Perhaps for work or study?" They often mention wanting to watch Netflix in English. In practice, we know who actually uses the language for this purpose. For the remaining 20%, an introductory lesson with a methodologist ends with the phrase: "You can just pay and start learning, and then we'll figure out your goals."
Mikhail notes that while there are people who set clear goals, such as learning English for emigration or upgrading their skills after losing a job, this is rather the exception. It is important to understand how consciously a person makes decisions when choosing an educational product. One key metric that can help with this is student attrition, or the return rate. This metric shows the number of people who realized they chose the wrong course and dropped out. An informed choice of educational program is crucial for achieving desired results in language learning and professional development.
Marina Litvinova, Product Director and Head of the Guild of Methodologists at EdMarket, discussed the problem of student attrition from a technical administrator course offered by online schools. One of the main reasons for dropouts was students' misunderstanding of the course content and its requirements. The course includes a significant number of technical assignments, requiring students to independently master various tools. Many of them were not ready for such a workload, which was the reason for their refusal to continue their education.
EdMarket methodologists have updated the content of the open A promotional webinar introducing the technical administrator profession was launched. This change aims to more clearly present the tasks and responsibilities of a technical administrator to potential students. The introductory session thoroughly discusses the key tasks students will encounter during their studies, and presents real-world examples. This approach allowed us to more accurately define the target audience, eliminating those for whom the course is unsuitable, and to prepare students for the expected workload in advance. This allows students to better navigate the program and be prepared for future challenges in the IT field.
Marina Litvinova raised an important issue typical of group learning: students with diverse goals may be in a single group. Some are eager to master a new profession and immerse themselves in the material, others are looking for quick ways to earn money to pay off loans, and still others come to the course to socialize and expand their network. This situation raises a number of questions: how to effectively support the learning of such a diverse group, how to organize individualized tutoring assistance, and what criteria to use to evaluate the educational experience of participants with different goals. Addressing these issues is essential to improving the quality of education and meeting the needs of all students.
EdMarket actively uses feedback to assess student satisfaction with its support service. In each stream, evaluating metrics such as NPS, midterm and final COR, and other key metrics is a mandatory part of the process. This allows you to not only identify strengths but also pinpoint areas for improvement, which ultimately contributes to improving the quality of educational services.
Learning new topics and interesting materials is always beneficial. We recommend paying attention to additional sources of information that will help deepen your knowledge and expand your horizons. This will allow you not only to stay up to date with the latest developments but also to develop your skills in areas of interest to you. Don't miss the opportunity to read relevant articles and research that can be a valuable addition to your educational process.
Evaluating the effectiveness of an online course is an important step to understanding its impact on student learning and development. To do this, several key factors must be considered.
First, you should define the course objectives and align them with the learning outcomes. This may include analyzing student performance, engagement, and satisfaction levels. Metrics such as course completion rates, the number of assignments completed on time, and participant feedback will help you gain a complete understanding of the outcome.
You should also consider using surveys and questionnaires to collect student feedback. This will help you identify the strengths and weaknesses of the course and understand what areas require improvement.
Analyzing data on student interactions with the course is equally important. Online learning platforms often provide analytics tools that can show how often and for how long students engage with the material.
Finally, evaluating the effectiveness of an online course should include a comparative analysis with similar courses. This will help you understand how competitive your course is and what improvements can be made to increase its appeal.
Therefore, a comprehensive approach to evaluating the effectiveness of an online course will not only allow you to understand its current performance but also develop strategies for further improvement.
Maxim Skryabin, Director of Education at PostNauka.Academy, emphasizes the importance of participating in a community of like-minded individuals for those pursuing a new profession. Marina Litvinova supports this view, noting that interacting with students in small groups or project teams provides valuable experience that cannot be gained through individual learning. This approach promotes the development of soft skills, which is especially important in the modern world. Participating in a team not only enriches knowledge but also develops communication, critical thinking, and collaboration skills, which are key to career success.
Mikhail Sverdlov emphasized that communication and support from mentors and classmates play a key role in students' lives. These elements contribute not only to academic success but also to personal development. Support from others helps students overcome challenges, find motivation, and form valuable connections, which in turn has a positive impact on their learning process and overall well-being.
I observe activity in community chats on the Slack platform and on Miro boards of our students who are studying bootcamp programs using the ISA model. This interaction has a positive impact on their motivation. Students are accustomed to a learning format in which one teacher works with many students. They perceive themselves not as individuals, but as part of a group. In our approach, mentors, similar to specialists at EdMarket, provide individual support to each student, providing personalized feedback. By working in teams and monitoring each other's progress, students receive additional incentive and motivation for further learning.
Asya Fursova noted the importance of the OECD Learning Compass 2030 analytical review, which highlights key global trends in education. Well-being, which implies a sense of safety and well-being, and sustainability, which is sustainable development, have become key areas of focus. In today's educational process, the alignment of values between students and other participants is increasingly important, contributing to the creation of a harmonious and productive learning environment. Given these trends, educational institutions must adapt their programs and approaches to meet the new demands and expectations of young people. Education can manifest itself in various aspects, including environmental awareness and the well-being of participants. For example, when plastic bottles are distributed to everyone, this may evoke negative feelings in someone with a strong environmental consciousness. However, if the educational process is organized with an emphasis on the well-being of all participants, this is felt throughout the entire learning process. Such value aspects can become a significant metric for students, influencing their perception and satisfaction with the educational environment. It is important to consider how educational practices influence the formation of students' consciousness and values, which in turn contributes to the creation of a more responsible and sustainable society.
How to evaluate educational experience metrics
After listing the key parameters influencing the educational experience, a natural question arises: is it possible to measure them? Experts identify several methods for achieving this goal. Measuring educational parameters can include both quantitative and qualitative approaches, which helps to better understand the effectiveness of the educational process and its impact on students.
Several measurable metrics can be used to assess the formation of connections between students. These include the speed of responses to questions in the chat, the number of participants in the conversation, and the number of useful messages calculated for the number of students. Mikhail Sverdlov emphasizes that such metrics can be applied on any platform where communication between students occurs. These indicators will help to better understand the dynamics of interaction and the level of student engagement in the educational process.
Marina Litvinova noted that separate groups often emerge from the educational chat, such as "Who's taking the psychology course?", "Who's from St. Petersburg?", and "Any newcomers?" These small groups can be effectively used to assess community activity. Monitoring such groups allows us to better understand the interests of participants and contributes to a more active and engaged learning environment.
We are observing the emergence of a new chat, which allows us to count the number of chats that have emerged from the main study chat. If it is possible to connect to these groups without disrupting their atmosphere, we can analyze, for example, the presence of small mastermind groups of 5-7 people. It is important to determine the frequency of their meetings, their activity level, the number of posts per day, their willingness to accept new members, and whether their small community is growing. Analyzing these factors will help understand the dynamics of interaction within the group and identify potential for further development.
Maxim Skryabin noted that not only chat correspondence but also any form of collaborative interaction can serve as a metric for student activity. For example, if students self-organize and regularly hold online meetings on Zoom, this can also be considered a significant measure of their activity.
In his speech, he noted that analyzing community metrics is part of social learning analytics, which examines quantitative parameters of interactions between people, including the density of connections. To more accurately assess the experience of a specific student, various sociological methods can be used, including measuring the ego network—the totality of an individual's social connections. This will allow for a deeper understanding of how interactions with others influence the educational process and student development.
Reading is an important aspect of personal development and broadening horizons. It not only enriches knowledge but also promotes the development of critical thinking. Immersion in various literary works helps to understand the world and people around us, and also develops imagination and creativity. Regular reading improves writing skills and helps expand vocabulary. In today's world, where information is available in various formats, it is important to choose quality sources and focus on both entertaining and educational materials. The variety of genres and authors allows everyone to find something to their liking, making the reading process even more engaging.
Observational learning is the process by which an individual acquires new knowledge and skills by observing the behavior of others. This learning method plays a key role in social interaction, as many aspects of human behavior and skills are transmitted from one person to another in this way. Learning is viewed as a social process because it does not occur in isolation but is formed through interaction with others. People learn from each other by adopting experiences, behaviors, and reactions, which contributes to the development of both individual and social skills. Thus, observational learning emphasizes the importance of social connections in the learning process and knowledge transfer.
Measuring students' subjective feelings in the context of values, comfort, and other individual aspects is a complex task. Unlike social interaction metrics, which can be easily quantified, subjective experiences require a more in-depth approach. Qualitative methods, such as surveys, interviews, and focus groups, can be used to analyze them, providing insight into students' personal preferences and feelings. Rating scales are also useful for systematizing and quantifying levels of comfort and satisfaction. It's important to remember that each student is unique, and their perceptions may differ significantly from those of others. Therefore, combining various research methods will help provide a more complete understanding of students' subjective feelings and values.
Marina Litvinova emphasizes that the results of training and the associated changes in personality can be unexpected. These effects can manifest not only in the professional sphere but also in personal life, influencing behavior, thinking, and emotional state. It is important to understand that the learning process does not always lead to predictable results, and each person may experience it differently. Unexpected changes can open new horizons and opportunities, making training an important tool for personal growth and development.
People often experience unexpected changes in their lives. After attending training, they may rethink their priorities and realize they have developed new interests. This can lead to increased self-esteem, quitting a job, leaving a toxic relationship, or the courage needed to ace a job interview. Such changes often contribute to personal growth and have a positive impact not only on the individual but also on their loved ones, family, and community. These transformations emphasize the importance of self-knowledge and striving for betterment.
Read also:
Learning as a process of change: the concept of transformative adult learning
Transformative adult learning is a methodology that focuses on profound changes in the perception and understanding of the world. This approach doesn't simply impart knowledge; it also promotes personal growth and transformation of thinking. Unlike traditional teaching methods, which focus on memorizing facts and skills, transformative learning emphasizes critical thinking and self-reflection.
The primary goal of transformative learning is to help adults recognize their beliefs and assumptions and then rethink them. This can lead to significant changes in behavior and perception, which, in turn, contributes to more successful solutions to life and professional challenges. Such changes can be especially beneficial in a rapidly changing world, where adaptability and learning ability are becoming key factors for success.
Transformative learning incorporates active methods such as discussions, group projects, and hands-on assignments that encourage participants to examine their views and engage with the perspectives of others. This approach is especially relevant for adult learners who already have experience and knowledge and are committed to further development. Thus, transformative adult learning is becoming an important tool for those who want not only to learn but also to change, opening up new horizons for personal and professional growth. It is impossible to quantify students' personal changes. However, according to Marina, such changes can be reflected in their responses to the questions "Are you willing to recommend us?" and "How much did you enjoy the training?" These responses form the basis for key metrics such as the CSI (Customer Satisfaction Index) and NPS (Net Promoter Score), which play an important role in assessing the quality of the educational process. It is important to consider that positive changes in student perceptions of learning can significantly impact overall student satisfaction and their willingness to recommend the course to others. To measure and influence key metrics, EdMarket uses feedback and reflection methods. An example of this approach is the motivation survey, which students complete several weeks after starting the course. The survey questions are aimed at identifying students' satisfaction with the learning process, factors that facilitate or hinder their learning, self-support methods, and possible assistance from the support service. This process not only improves the quality of the educational process but also increases student motivation, which in turn facilitates more effective learning.
At the end of each module, students are given the opportunity to answer a question about what they can praise themselves for. In the final reflective block, which takes place during the defense of their theses, graduates are asked about their thoughts at the beginning of their studies, what changes have occurred during this period, and what plans they have for the future. This practice allows students to recognize their progress and prepare for the next steps in their professional careers.
Maxim Skryabin confirmed the importance of reflection with scientific data. Research shows that students who use reflective methods in their learning demonstrate higher test scores compared to control groups. This highlights the importance of integrating reflective practices into the educational process to improve learning effectiveness.
Check out additional materials:
Improving an existing course is an important task to increase its effectiveness and participant satisfaction. To begin with, it is necessary to collect and analyze student feedback to identify the strengths and weaknesses of the program. This will help identify which aspects of the course require improvement.
Learning materials should be regularly updated to keep pace with current trends and market demands. Incorporating new technologies and teaching methods can also significantly increase interest in the course. It is important to monitor changes in the area covered by the course and adapt the content accordingly.
Creating an active community around the course contributes to its improvement. Forums and discussion groups help students exchange experiences and ideas, which can lead to additional program improvements. It is also worth considering webinars and workshops to deepen students' knowledge and provide them with additional resources.
Don't forget about personalization of learning. An individual approach to each student can increase engagement and satisfaction with the course. The use of technologies such as adaptive learning will create a more flexible and effective learning environment.
Therefore, improving an existing course requires a comprehensive approach, including analyzing feedback, updating materials, building a community, and personalizing learning. These actions will help make the course more attractive and effective for students.
Why Companies Measure and Grow Educational Experience Metrics
Community building, student personal changes, and student satisfaction with learning support are important aspects that have significant practical implications for EdTech businesses. Measuring these metrics allows companies not only to improve the quality of the educational process but also to increase customer retention. Students who feel part of a community and receive the necessary support are more likely to complete their studies and become loyal platform users.
Satisfied students are also more likely to recommend educational programs to their friends, which contributes to audience growth and enhances the company's reputation. It is important for EdTech companies to actively work on these aspects, as this directly impacts their competitiveness and financial performance. Successful changes in student personal development and the creation of an active community can be key factors contributing to the successful development of online education businesses.
Expert opinions have shown that educational experience metrics and learning outcomes significantly influence each other. Mikhail Sverdlov cited a case study from Skyeng, which illustrates how comfortable student conditions contribute to improved educational outcomes and positively impact the business's financial performance. This confirms the importance of creating a comfortable learning environment for achieving high results for both students and educational institutions.
Skyeng discovered that beginner-level students—those new to English—drop out significantly faster than those at more advanced levels. On average, beginners complete only 15 lessons, while more experienced students master 28 to 50. To understand the reasons for this, Skyeng surveyed students and found that many experienced difficulties and discomfort during the learning process, due to the high workload of instructors. These subjective student impressions were reflected in the company's objective business metrics.
The company implemented a new course and revised its teaching methodology. Learning outcomes remained high, and student attrition decreased significantly. Just a few months after the launch of the updated program, the average number of lessons among beginners increased to 23. This demonstrates increased interest in learning and the effectiveness of the new educational strategy.
Marina Litvinova shared her experience. After the first wave of COVID-19 and the introduction of restrictive measures, many people with little technology experience joined EdMarket courses. Even using online editors became a real challenge. The Google Docs issue became the first major hurdle for users. Many struggled with their first homework assignments. This was especially difficult for adults, especially teachers in their 40s and 50s, who felt psychological discomfort and shame when asking for help. We invested significant effort in creating user support manuals and supplementary materials for introductory lessons to simplify the process of learning the platform. Despite this, many people were afraid to ask questions. Creating a comfortable environment where it was safe to ask questions and make mistakes became a key element of learning. It is important to understand that mistakes are part of the learning process, and only in a safe environment can you develop and achieve success.
The support service effectively interacts with students who Lack of basic digital skills. At the beginning of each course, students receive training in the basics of digital literacy, which significantly reduces attrition caused by initial difficulties, fear of asking questions, and self-doubt. According to Marina, such problems can only be resolved through personal communication and empathy. This approach helps create a more comfortable learning environment and facilitates students' successful adaptation to the educational process.
What should the educational experience be like in the new reality?
For almost two years, we have been living with the COVID-19 pandemic and associated restrictions, which has created an atmosphere of uncertainty and anxiety. These circumstances significantly impact the educational experience of students in continuing professional education (CPE) programs. It is important to understand how the pandemic is affecting student learning and interaction, as well as what measures companies can take to improve the quality of education during this challenging period. Providing flexible learning formats, implementing digital technologies, and creating a supportive learning environment can significantly improve the student experience and help them adapt to changing conditions.
Marina Litvinova noted that even before the pandemic, students faced personal circumstances that hindered their studies, such as heavy workloads, health issues, and unforeseen situations. However, such cases were rare. Currently, students are more likely to experience illnesses, post-COVID syndrome, and psychological fatigue, yet they remain committed to learning despite the current difficulties. This creates significant challenges for EdMarket's support team, which must adapt educational plans, find ways to integrate the learning process into students' lives, and discuss possible return-to-course timelines.
Marina noted that resolving such issues requires an individual approach, often through face-to-face conversations. It can be difficult for a person to clearly articulate the essence of the problem through correspondence. Care team mentors share case studies and action plans for various situations with colleagues, but there are no universal rules for such cases within the company due to the numerous nuances.
The expert emphasized the importance of supporting employees under increased informational and psychological stress. EdMarket organizes meetings with a psychologist to provide the necessary assistance. Currently, the possibility of providing similar support to students who have encountered difficult situations is being considered.
Maxim Skryabin noted that there is currently a significant increase in demand for psychological support. He emphasized that in 2020, one of the most popular courses on the Coursera platform was "The Science of Wellbeing." This demonstrates the growing interest in the topics of mindfulness and self-regulation, which also influence the design of educational experiences. In a context of increased stress and uncertainty, it is important to consider psychological aspects in learning, which allows for the creation of more effective and supportive educational programs. Creating an educational environment requires special attention to the comfort and safety of participants. It is necessary to create a space in which people can freely make mistakes and learn from their mistakes. A supportive atmosphere is especially important, as some aspects of learning may be perceived more acutely after the COVID-19 pandemic. Therefore, it is important to provide an environment conducive to openness and collaboration, which will help improve the quality of education and increase learner confidence. Experts note that supportive roles in education, such as tutors, mentors, and course curators, are becoming increasingly significant. An effective student support service directly impacts business results. Objective metrics can identify problems in the educational process, but understanding their causes and finding optimal solutions requires personal, trusting interaction. This interaction helps create a comfortable educational environment and increase student satisfaction, which, in turn, has a positive impact on the reputation of the educational institution.
Read also:
- Online courses on Well-Being really help improve well-being
- How to motivate adults to study
- 5 ways to increase the success rate of an online course
- Quotes of the month about the quality of education and the professionalism of those who teach
- Will higher education lose to professional courses?
