EdTech

How EdTech is Finding Approaches to Assessing the Quality of Online Courses

How EdTech is Finding Approaches to Assessing the Quality of Online Courses

Course with employment: "Profession Methodologist from scratch to PRO»

Find out more

How to evaluate the quality of online education?

Alexander Laryanovsky notes that the online education market in Russia has reached a level that allows us to talk about the quality of EdTech products. This indicates that the initial "foam" has subsided, and it is now possible to more objectively evaluate the offers on the market. The expert identifies two key parameters of paramount importance. The first is the degree to which students' expectations match actual learning outcomes. It is important that these expectations are conscious and based on previous educational experience. For example, when we go to a coffee shop, even if we don't know how to make coffee, we can evaluate how well the resulting drink meets our expectations.

The second key aspect of quality, according to Alexander, is the share of academic costs in the project's economics. A high-quality product is one in which, all other things being equal, a significant portion of expenditure is directed toward content creation and the salaries of highly qualified teachers and methodologists, rather than toward marketing and presentation. This approach ensures a deeper understanding of the material and increases the value of the educational project.

Dmitry Krutov disagreed with the assertion that the EdTech market has reached a stage at which the issue of online education quality has become critical. In his opinion, it is too early to speak of a sufficient level of maturity in this area to focus on the quality of educational services. It is important to continue developing technologies and teaching methods to ensure high standards and meet the needs of learners.

Currently, the content market continues to saturate, and the process of digitization of materials will likely continue for another five years. We are seeing more and more information being converted into digital format, and the quality of these materials varies: some are truly valuable, while others do not meet high standards. Within three to five years, we will be able to discuss content quality in more depth. The number of companies in the market is expected to increase, and the market itself will become more diverse and competitive. This will create new opportunities for the creation and distribution of high-quality content that meets audience needs.

According to Dmitry, an important trend in quality measurement is already being observed in EdTech—the focus is on the product, not on student goals and expectations. Existing metrics help evaluate the work of a producer or methodologist, but do not provide an understanding of how well a course meets student needs. The head of Skillbox believes that EdTech should move toward developing customer-centric metrics. However, the question arises: how can a course's compliance with student expectations be assessed if only a small percentage of them make an informed choice of educational product? This underscores the need to develop more accurate and customer-focused methods for assessing educational quality.

Frame: Yandex / YouTube

In modern business, the use of standard metrics such as NPS, CSAT and COR allows you to evaluate the quality of services provided. These metrics provide insight into how effectively tasks are completed and how satisfied clients are. However, it's important to understand that these metrics primarily focus on internal processes, such as content quality and team professionalism.

It's crucial to shift to more customer-centric metrics that will help us better understand client expectations and perceptions. We need to explore how accurately clients formulate their expectations and how we can better meet them. Instead of solely evaluating the performance of methodologists and producers, it's worth focusing on metrics that reflect the opinions of listeners and students. This will help create a more accurate picture of client needs and improve the quality of services offered by the company.

Understanding and implementing such metrics will not only increase customer satisfaction but also improve customer engagement, which in turn will contribute to business growth.

Who and under what conditions can EdTech bring the greatest benefit?

A person planning to study may have vague ideas about the nature of the process and its benefits. It is important to understand that learning is not only about acquiring knowledge but also about developing skills that will be useful in personal and professional life. Understanding the goals and expectations of the educational process will help you better prepare for it and reap the maximum benefit.

Dmitry Krutov emphasizes that the opportunity to become familiar with various educational areas and try out different training options plays a key role in forming the right expectations. He cites a common example: someone enrolls in a Python development course seeking a higher-paying career, but realizes during the course that their true interest lies in interior design. In such cases, Skillbox offers the opportunity to change their curriculum. Additionally, for career guidance, the company organizes open webinars where students can learn about various courses and careers, allowing them to make a more informed choice. Agreeing with the need to help clients formulate their expectations, Alexander Laryanovsky emphasizes the importance of another aspect. EdTech is aimed at a motivated audience, but its share remains extremely small. "There are very few people interested in self-development and willing to invest time and money in training," he notes. This underscores the need for a deeper understanding of the needs and expectations of the target audience in educational technology. Most adults work long hours to earn the median salary in the country, which is 30,000 rubles. As expert Alexander notes, all of them have completed school education, and many have received higher education, but they perceive education as of little benefit. However, he believes that vocational training can be key to their development and improved quality of life. According to official statistics, about a third of our country's population lives below the poverty line. When discussing quality of life, it's important not only to focus on highly motivated people who are easy to communicate with and who can choose their own educational programs. We need to get down to the level of those facing real challenges and learn to speak their language. This will help us achieve real results and improve the quality of life for all segments of the population.

Frame: Yandex / YouTube

In his Facebook post, Alexander emphasizes the importance of EdTech companies being able to reach a wide audience. He emphasizes that companies shouldn't limit themselves to only the most resourceful and motivated students. The key idea is that long-term success will come from those EdTech companies that can measure their results not only by revenue growth, but also by the number of people trained who have made significant changes in their lives. This approach will create a more inclusive educational environment and improve the effectiveness of educational programs.

Can graduate employment be a measure of educational quality?

Dmitry Krutov emphasizes the importance of additional education in the context of employment, noting that in addition to professional knowledge, the ability to adapt to the culture of the profession and a specific company is critical. Successful integration into the work environment depends not only on qualifications but also on the ability to interact with the team and understand the values ​​and norms of the organization. Adaptability and cultural compatibility are becoming essential factors for career advancement. The challenge isn't just about matching the hard skills and basic requirements necessary for the job. Cultural context is also an important aspect. It's important to assess how well a candidate fits into a company's corporate culture, such as Yandex, Skyeng, or Skillbox. Cultural background and soft skills play a key role in determining whether they will integrate into the team and align with the organization's values. Therefore, influencing this area also requires attention. Dmitry emphasized the importance of creating an educational environment for students that facilitates their immersion in the professional context in which they will work in the future. Creating such an environment allows students not only to better absorb the material but also to develop the practical skills necessary for career success. It's important that the learning process be connected to the real-world tasks and challenges they will face in their future professional careers.

Many prefer to separate education into online and offline formats. However, in my opinion, we and our colleagues are not exclusively focused on online education. We work with integrated learning formats, where the primary goal is to create a comprehensive educational environment. This is achieved through conferences, meetups, workshops, and seminars, as well as through personal review of homework, graduation projects, and internships. These approaches effectively combine various teaching methods and ensure deep learning.

At a recent conference, one participant asked about employers' mistrust of candidates with specialized education obtained through online courses. This question sparked a lively discussion. In response, Dmitry Krutov noted that in 2021, Skillbox successfully placed over 5,000 graduates in jobs, including representatives of well-known brands. This challenges the common perception that employers distrust online education. Employers have the option of requesting that graduates demonstrate their final coursework, which confirms the quality of the knowledge and skills acquired.

In response to the question, Alexander Laryanovsky emphasized two key points. First, the reputation of the formal vocational education system, including universities, leaves much to be desired, with the exception of leading educational institutions that rank among the top. Second, there is a persistent stereotype that the state is the main employer in the country. In reality, finding employment with government agencies or state-owned companies without a higher education degree is difficult, as a university degree, not a coursework degree, is an essential requirement for employment.

Frame: Yandex / YouTube

Alexander noted that people study not only for the purpose of employment. Education brings pleasure because it stimulates the production of dopamine and serotonin, hormones responsible for feelings of joy. Although measuring these levels is difficult, it is important to consider a person's emotional state. If learning makes a person even a little happier, then it is beneficial.

Isn't it time for EdTech to introduce strict student selection, as universities do?

In a discussion of the divide between traditional higher education and EdTech, moderator Daria Ryzhkova expressed the opinion that high-quality education cannot be accessible to everyone. She cited the rector of a private university, who noted that his institution strictly selects students, the curriculum is challenging, and theses require significant effort. According to him, only a few students make it this far, but he is confident that they become qualified specialists with the necessary knowledge.

Alexander Laryanovsky noted that selective applicants are not a blessing, but rather highlight the shortcomings of universities that are unable to scale. He emphasized that higher education institutions primarily engage with motivated students, but education as a tool for changing lives is essential for many others. It is important to create conditions that make education accessible to a wider range of people, fostering personal and professional growth.

Those who have achieved success often find joy in helping others. It is easy to select among the successful, similar to how professional sports select the best athletes. However, it is worth striving for the entire nation to become healthier. Instead of focusing only on individual successes, it is important to create conditions for the overall improvement of the health and well-being of the population.

Dmitry Krutov noted that many university graduates often return to study in the EdTech field. He believes that opposing this process is inappropriate. Instead, it is worth focusing on creating partnerships between higher education institutions and EdTech companies, which will allow each party to effectively solve their problems and adapt to the rapidly changing demands of the labor market.

Read also:

  • The best EdTech startups in Russia and the CIS in 2021
  • EdTech tools that have no complete analogues on our market yet
  • 5 problems of vocational education and the labor market
  • How universities and companies divide the DPO market