Education

What ethical issues are associated with measuring intelligence in education?

What ethical issues are associated with measuring intelligence in education?

Learn: The Profession of a Methodologist from Scratch to PRO

Learn More

Tests for diagnosing intelligence have a rich history, which reflects the evolution of approaches to psychodiagnostics and psychometrics. As this development progressed, views on ethical and unethical methods of measuring intelligence changed. These topics were discussed at the 12th annual international conference of the Eurasian Association for the Evaluation of Education Quality (EAEQE). Conference participants examined key aspects related to the history and current trends in psychodiagnostics, as well as their impact on educational practices and the assessment of intellectual abilities.

  • Ekaterina Orel, Head of the Project-Based Laboratory for Modeling and Assessing Competencies in Higher Education and Senior Researcher at the Center for Psychometrics and Measurement in Education, Institute of Education, HSE;
  • Tatiana Kanonir, Associate Professor, Department of Educational Programs and Researcher at the Center for Psychometrics and Measurement in Education, Institute of Education, HSE.

The speakers discussed the importance of intelligence measurements in education and highlighted the key ethical principles developed by the professional community. The evolution of ethical issues associated with intelligence testing since its inception in 1905 was also considered. The discussion focused on how intelligence tests influence educational practices and the challenges they pose to society.

Ekaterina and Tatiana's presentation is available for viewing on YouTube. In this article, we present a summary of the main points of their report.

Why Intelligence Measurements Are Used in Education

Tatiana Kanonir noted that intelligence testing plays a significant role in education. The results of such tests help identify the characteristics of a child's intellectual development. This knowledge is crucial for developing individual educational plans that take into account the potential difficulties a student may encounter during the learning process. Thus, intelligence testing not only contributes to a deeper understanding of a child's abilities but also helps teachers adapt teaching methods to achieve maximum results.

Intelligence test results play a vital role in diagnosing mental retardation, as well as identifying specific disabilities such as dyslexia and autism spectrum disorders. The Psychological, Medical, and Pedagogical Commission (PMPC) uses this data to formulate conclusions about the necessary educational conditions for children with special needs. For example, tutoring in a regular school or education in a special educational institution may be recommended. A proper understanding of test results helps ensure that each child receives optimal conditions for education and development.

Decisions regarding intelligence diagnostics have a significant impact on the lives of children and their families. The speaker emphasizes the importance of using valid and reliable measurement methods. Ethical aspects of diagnostics also play a key role. Tatyana proposed examining how four basic principles have been observed in the field of intelligence assessment from the beginning of the 20th century to the present day. These principles ensure the correctness and fairness of diagnostic procedures, which in turn contributes to a more accurate understanding of the needs of children and their families.

  • respect for the rights, freedoms, and dignity of the individual;
  • honesty;
  • competence;
  • responsibility.

Read also:

Psychometrics is a field of science that deals with the measurement of psychological phenomena, such as intelligence, personality traits, and abilities. In education, psychometrics plays an important role, allowing us to assess the level of knowledge and skills of students, as well as identify their strengths and weaknesses. The use of psychometrics in educational institutions helps in the development of effective teaching methods and the adaptation of educational programs to the individual needs of students. In addition, psychometric tests can be used to diagnose and predict academic performance, which contributes to a more personalized approach to learning. In general, psychometrics is an important tool for improving the quality of education and increasing the effectiveness of the learning process.

How inappropriate use of tests leads to discrimination

The principles of fairness and respect for individual rights, as the speaker noted, are much more difficult to observe in practice than in theory. This requires eliminating bias towards different social groups, striving for objective assessment, and considering important aspects such as voluntary participation and informed consent. These elements are fundamental to creating a fair and ethical approach in any interaction.

In practice, as Tatyana noted, recognizing violations of the principles of intelligence measurement can be quite difficult. The history of research in this area clearly demonstrates how difficult it is to identify and acknowledge these violations.

Modern intelligence tests have their roots in 1905, when French psychologists Alfred Binet and Théodore Simon developed the Binet-Simon Intelligence Scale. In its fifth version, refined by researchers at Stanford University, this test remains relevant and widely used. The original purpose of the test was to identify children with developmental disabilities who were unable to successfully master the general educational curriculum. The Binet-Simon test became the basis for further research in psychology and education, as well as for the development of new methods for assessing intellectual ability.

Tatiana Kanonier noted that Alfred Binet, when creating the first test, emphasized the importance of an ethical approach to its use. The test should be used exclusively for selecting students for specialized educational programs, and not for labeling children based on their developmental characteristics. Binet also recognized that his scale measured only specific aspects of intellectual ability and cautioned his colleagues against using the test for general assessment of intelligence. This highlights the need for a responsible approach to psychometric tools in education and the importance of a comprehensive analysis of children's individual abilities.

Read also:

The theory of multiple intelligences, developed by Howard Gardner, is a concept according to which intelligence is not a single, fixed entity. Gardner identifies several types of intelligence, each reflecting different aspects of human abilities and talents. This theory challenges the traditional view of intelligence based on IQ tests and offers a more multifaceted approach to understanding mental abilities.

Modern research in psychology and neuroscience supports Gardner's ideas, confirming that the human brain is capable of a variety of mental activities. For example, musical, linguistic, logical-mathematical, spatial, bodily-kinesthetic, interpersonal, and intrapersonal intelligence—all these categories demonstrate that individual differences in abilities can vary significantly.

This concept has important practical applications, including education and personal skill development. The application of multiple intelligence theory in educational settings allows for the consideration of individual student characteristics and the creation of more effective teaching methods. Instead of a one-size-fits-all approach focused on standardized tests, educators can develop programs that address different types of intelligence, thereby promoting deeper and more comprehensive student development.

Thus, Howard Gardner's theory of multiple intelligences remains relevant and in demand in academia and educational practice, offering new ways to understand and develop human abilities.

In 1916, after Alfred Binet's death, his test was brought to the United States, where it was adapted for an American audience and became known as the Stanford-Binet test. In 1917, a team of psychologists led by Robert Yerkes, president of the American Psychological Association, developed the Army Alpha and Army Beta intelligence tests. These tests were intended for mass testing of recruits during World War I, and over a million people ultimately took them. According to Tatiana Kanonier, Yerkes's developments had a significant influence not only on the development of testing methods but also on the formation of generally accepted ideas about intelligence. These events marked the beginning of the evolution of psychometrics and intelligence testing, which remain relevant and in demand in modern society.

Army Alpha was a verbal test that many recruits failed due to low reading proficiency or insufficient English proficiency, especially among immigrants. In response, a non-verbal version of the test, called the Army Beta, was developed. Yerkes, the test's creator, claimed that they measured innate intelligence rather than educational attainment or acquired skills. However, according to Tatiana, these tests were clearly targeted at the educated middle class, calling into question their universality and objectivity.

During this period, eugenic ideas were actively disseminated, arguing that intellectual ability was fixed and determined by heredity. This implied that intelligence was directly linked to social class, race, and nationality. Yerkes' test results fueled anti-immigrant bias and xenophobia in the United States, showing that immigrants performed worse on tests, which eugenicists believed indicated their lower intelligence than native-born citizens. These ideas significantly influenced public opinion and policy, shaping stereotypes and prejudices about immigrants and their ability to integrate into American society.

The work of the eugenicist psychologist significantly influenced the development of the National Origins Equation. This series of federal laws, in effect from 1921 to 1965, severely restricted immigration based on nationality. These restrictions shaped US immigration policy for decades, with long-term consequences for the diversity of the country's population.

According to the expert, flawed testing only exacerbated discrimination in the United States. In 1971, a landmark court case began in San Francisco over the placement of African-American students in special classes for the "mentally retarded" based on IQ test scores. The court found that the test did not actually measure intelligence, but rather knowledge and skills that African-American children were unable to adequately acquire due to a lack of access to a quality education. Therefore, such test scores could not be used to justify the selection of students for general or special education programs. This case became a landmark in the fight for educational equality, highlighting the need to consider the educational context when administering testing.

In 1954, the US Supreme Court ruled racial segregation in schools illegal. In this photo, African-American students walk into a predominantly white school in Tennessee, 1956. Photo: Thomas J. O'Halloran / Library of Congress.

Tatiana Kanonier noted that modern psychometrics has already partially resolved this problem. The scientific community has come to the conclusion that intellectual abilities are formed not only on an innate basis, but also under the influence of cultural and educational factors. Research aimed at comparing racial and national differences in intelligence has lost its relevance, as it turned out that existing measurement tools cannot adequately assess different populations. However, this does not mean that modern psychometrics is completely immune to such errors. Further research and improved methods are needed to ensure a fair and accurate assessment of intellectual abilities for all population groups.

There is a deceptive feeling that we are protected from violating the principles of respect and fairness in assessment. However, each of us has our own biases. As test developers and implementers, we have a responsibility to carefully consider our true beliefs about the children, students, and adults we assess. This applies to both intelligence assessment and educational outcomes. It is important to recognize and adjust our understanding of the construct to ensure a more objective and fair approach to assessment.

Why Professionals Struggle to Choose Quality Tests

Ekaterina Orel noted that two key principles of intelligence assessment are competence and responsibility. These principles are reflected in the fact that the assessor is responsible for selecting high-quality instruments and using them correctly. Every detail in the assessment process is important for obtaining accurate and reliable results.

The issue of accessibility of high-quality psychological tests for professionals is becoming increasingly relevant. In Russia, the situation is exacerbated by the fact that, since 1936, restrictions on measurement and diagnostics have been imposed in the fields of pedagogy and psychology. This occurred following the issuance of the decree of the Central Committee of the All-Union Communist Party (Bolsheviks) "On Pedological Perversions in the System of People's Commissariats of Education." As a result, psychodiagnostics and psychometrics remained virtually stagnant for decades, and only began to experience a revival in the 1980s. During this time, Anna Anastasi's classic work "Psychological Testing" was translated into Russian, marking a significant step in the restoration of psychodiagnostic practice in Russia. Thus, despite historical obstacles, interest in high-quality psychological tests is growing again, which opens up new opportunities for specialists in this field.

Read also:

Pedology in Soviet schools: from innovations to pseudoscience and its Decline

Pedology, as a science of child development and education, initially attracted the attention of Soviet educators with its innovative approach. This discipline sought to combine psychology, pedagogy, and biology to gain a deeper understanding of child development. However, over time, pedology has undergone significant changes, leading to its transformation from a promising science into a field often associated with pseudoscientific ideas.

In the early 20th century, pedology gained popularity thanks to its attempts to adapt educational methods to the individual characteristics of each child. However, with the rise of Stalinism, the science was subject to ideological influences, which contributed to its distortion and transformation into a tool of social engineering. Pedology began to be used to justify harsh methods of upbringing and control over children, which ultimately led to its discredit.

By the mid-1950s, pedology was officially rejected, which was a result of both scientific criticism and political repression. Ultimately, the decline of pedology in Soviet schools became emblematic of a broader problem—the conflict between science and ideology. This process underscores the importance of critical thinking and a scientific approach in education, which remains relevant today.

Ekaterina noted that at that time, Russia lacked not only a developed science of measurement but also a testing culture. This led to practitioners using tools borrowed from the West, often without due regard for their quality and experimental validation in Russian conditions. In the 1990s, a system-wide crisis, including a crisis in science funding in the country, only exacerbated this situation. Ekaterina Orel cited psychologist and expert in psychodiagnostics and psychometrics Alexander Shmelev from his article "Test as a Weapon," emphasizing the importance of a critical approach to testing methods in the face of a lack of resources and knowledge.

Domestic testing failed to develop, never moving beyond the initial stage. It turns out that using stolen Western methods is far more profitable than developing original domestic solutions. Meanwhile, domestic specialists, who legitimately expected compensation for their skilled work, are left at a disadvantage. Developing domestic test production requires not only investment but also government support for the creation of competitive products. Since the publication of the book "The Best Psychological Tests" in 1992, a proliferation of test collections has begun. As the expert notes, these commercially available publications often contained tests written by unknown authors and lacking scientific validation. A single book could contain professional tools for assessing memory and attention alongside tests like "Will You Become a Millionaire?" This created difficulties for domestic specialists, who were forced to use readily available materials, as they lacked the resources to develop high-quality tools or seriously adapt Western tests. As a result, the quality of testing and diagnostics in psychology remained low, highlighting the need to develop reliable and validated psychometric instruments.

Read also:

Using ready-made tests from the Internet is a solution that has its pros and cons. On the one hand, ready-made tests can significantly save time and effort by providing already verified questions and answers. This is especially useful for students and professionals who need to quickly assess their knowledge or prepare for exams.

On the other hand, it is important to keep in mind that the quality and relevance of such tests can vary. Not all materials are reliable or up-to-date. Using outdated or irrelevant tests can lead to an inaccurate assessment of knowledge and skills. It is also worth remembering the risk of plagiarism if tests are used for educational purposes.

It is recommended to approach the selection of ready-made tests with caution. It is best to look for resources that offer tests developed by experts in their field. This will help ensure that the information is up-to-date and relevant to your educational or professional goals. When choosing ready-made tests, be sure to check their sources and relevance to ensure high-quality preparation and adequate assessment of your knowledge.

Using tests of inadequate quality leads to errors on the part of the psychologist or psychodiagnostician. When the diagnostic results affect the respondent's life path, the consequences of these errors can be extremely serious. It is important to select only valid and reliable psychodiagnostic instruments to minimize risks and ensure the accuracy of results.

According to Ekaterina, the selection of high-quality diagnostic instruments is complicated by the fact that developers often fail to pay due attention to standardization and validation. For example, the Wechsler test, which is widely used by school and clinical psychologists, including specialists from psychological, medical, and pedagogical commissions, is used to measure intellectual development. However, as the speaker notes, its manual lacks information about the sample on which standardization was conducted. Moreover, the document states that standardization studies on a Russian sample for this test have not been conducted. This emphasizes the need for careful selection and analysis of diagnostic instruments to ensure their effectiveness and reliability in various contexts.

Ekaterina Orel emphasizes that unscrupulous developers of diagnostic instruments may intentionally expand the target audience beyond that on which the actual tests were conducted. This can lead to incorrect conclusions about the effectiveness and safety of the products. Therefore, it is important to carefully verify information about testing and the target audience of diagnostic instruments to avoid risks and ensure the reliability of the results.

Tests developed by psychology departments are often tested on an available sample of students. Their use can include testing schoolchildren as well as assessing adults for personnel selection purposes. However, this practice is widespread and carries its own risks. Specialists must recognize that expanding the testing audience without proper preparation and justification is unacceptable, as this can lead to distorted results and incorrect conclusions.

Ekaterina emphasized that the standardization process, as well as the principles of validity and reliability, are discussed in detail in textbooks for psychologists and are included in the mandatory psychodiagnostic curriculum for undergraduate students. Nevertheless, the professional paths of specialists are diverse, and tests can be used by people without a higher education in psychology. The speaker noted that in the West, this problem is solved by training specialists during the acquisition of specific tests, which allows them to master the methodology of application and the principles of selecting high-quality instruments. In Russia, however, such a culture has not yet become widespread, highlighting the need to improve the training and awareness of test users.

Tatyana Kanonir emphasizes that modern and valid tests for comprehensively measuring intelligence are currently lacking. Existing popular tests were developed long ago, and their content has become outdated. For example, versions of the Wechsler test for adults and children have been used since the 1950s. During this time, ideas about the structure of intelligence and the parameters that should be measured have changed. Therefore, Russian specialists are urgently seeking high-quality and relevant tools for assessing intelligence. The development of new tests that meet modern requirements could significantly improve the diagnosis and understanding of intellectual abilities.

Learn more about education and current news on our Telegram channel. Subscribe to stay up-to-date with important updates and useful content.

Also read:

  • Why you can't just translate a good foreign test into Russian
  • Developing educational tests: instructions on how to do it
  • Psychometricians explained how to use neural networks in developing educational tests
  • 8 books on psychometrics for those who develop educational tests

Profession Methodologist from scratch to PRO

You will improve your skills in developing curricula for online and offline courses. Master modern teaching practices, structure your experience, and become a more sought-after specialist.

Find out more