Standards for Educational Testing: A Comprehensive Overview

The Standards for Educational and Psychological Testing (often simply referred to as "the Standards") serves as a cornerstone document in the fields of education, psychology, and employment testing. Published collaboratively by the American Educational Research Association (AERA), the American Psychological Association (APA), and the National Council on Measurement in Education (NCME), it provides a framework for operational best practices in validity, fairness, reliability, design, delivery, scoring, and the responsible use of tests. Often regarded as the "Bible" of psychometricians and testing industry professionals, these standards offer guidance on testing in the United States and globally.

Historical Context and Evolution of the Standards

The development of testing standards has been an ongoing process, reflecting advancements in the field of psychometrics and changes in legal and societal contexts.

The journey began with more concise publications, such as the Technical Recommendations for Psychological Tests and Diagnostic Techniques in 1952 and 1954. The 1966 edition, titled Standards for Educational and Psychological Tests and Manuals, comprised only 40 pages.

A significant expansion occurred with the 1985 edition, which adopted the current name and more than doubled in size. The 1999 edition nearly doubled again, incorporating more in-depth background material, a greater number of standards, and an expanded glossary and index. The 1999 version reflected changes in United States federal law and measurement trends affecting validity, testing individuals with disabilities or different linguistic backgrounds, and new types of tests as well as new uses of existing tests.

The most recent edition, the 7th, was released in July 2014 and is available in printed form and as freely downloadable PDFs in English and Spanish. The 2014 edition shares the same names as the 1985 and 1999 editions.

Read also: Comprehensive Guide to Florida Early Learning Standards

In 2024, the sponsoring organizations (AERA, NCME, and APA) announced that they would be updating the guidelines once again, and The Standards would again be available both in printed and freely downloadable formats. The management committee has already indicated an interest in updating The Standards more frequently. It also has announced that it hopes to provide greater transparency about disagreement among committee members; to be more clear about when there is a strong consensus and when there is disagreement among experts about best practices.

Key Areas Addressed in the Standards

The Standards address a wide array of critical issues in testing, including:

  • Validity: The extent to which a test measures what it is intended to measure and the appropriateness of inferences made from test scores.
  • Fairness: Ensuring that tests are equitable and do not unfairly disadvantage any particular group of examinees. A chapter on fairness in testing was added to emphasize accessibility and fairness as fundamental issues in testing. The topics formerly addressed in several chapters are now combined into a single, comprehensive chapter, more broadly cast to support appropriate testing and valid score interpretations for all examinees.
  • Reliability: The consistency and stability of test scores over time and across different administrations.
  • Test Design and Development: Principles and procedures for creating high-quality tests that meet specific purposes.
  • Test Administration: Guidelines for administering tests in a standardized and fair manner.
  • Scoring: Methods for accurately and consistently scoring tests.
  • Test Use: Ethical and responsible use of test scores for decision-making.

Updates and Revisions in the 2014 Edition

The 2014 edition of the Standards incorporated several important updates and revisions, reflecting developments in the field of testing between 1999 and 2014. These included:

  • Accountability Issues: Examining the accountability issues for the uses of tests in educational policy.
  • Accessibility: Broadening the concept of accessibility of tests for all examinees.
  • Workplace Testing: Representing more comprehensively the role of tests in the workplace.
  • Technology: Taking into account the expanding role of technology in testing. The impact of technology was considered throughout the volume.
  • Structure: Improving the structure of the book for better communication of the standards.

The Revision Process

The development and revision of the Standards involve a rigorous and collaborative process. Teams of experts collaborate in developing and crafting Standards, while each of the three organizations assumed responsibility for reviewing the work to ensure quality standards that are robust and applicable across educational and psychological contexts in which tests are developed, administered, and used.

In February 2024, the co-chairs of the Joint Committee leading the revision of the Standards for Educational and Psychological Testing were named. Andres (Andy) De Los Reyes, PhD, a professor in the department of psychology at the University of Maryland, and Ye Tong, PhD, the senior vice president of assessment operations at the National Board of Medical Examiners, were appointed to these roles.

Read also: ISTE Standards Explained

De Los Reyes' expertise lies in psychometrics and clinical assessment of diverse populations in developmental and mental health contexts. Tong is a nationally recognized expert in measurement, with publications and presentations in areas such as equity in assessment, equating, computer adaptive testing, and educational policy.

The selection process incorporated member input from all sponsoring organizations that informed the thorough set of selection criteria that was applied. Moving forward, the management committee will work with Tong and De Los Reyes to select joint committee members.

Companion Volumes and Related Initiatives

In 1974, the Joint Committee on Standards for Educational Evaluation was charged with the responsibility of writing a companion volume to the 1974 revision of the Standards for Educational and Psychological Tests. This companion volume was to deal with issues and standards for program and curriculum evaluation in education. In 1975, the Joint Committee began work and ultimately decided to establish three separate sets of standards.

Significance and Impact

The Standards for Educational and Psychological Testing has a profound impact on the field of testing. It serves as a guide for test developers, administrators, and users, promoting best practices and ensuring the quality and fairness of tests. The Standards are used in a wide range of settings, including education, psychology, employment, and licensure.

Availability

The 2014 edition of the Standards for Educational and Psychological Testing is available for purchase in printed form. In March of 2021, NCME, along with its coauthoring organizations AERA and APA, announced the open access release of the 2014 Standards for Educational and Psychological Testing. This open-access, free download is available. A Spanish edition of the Standards was published in 2017. Institutions ordering 10 or more copies will receive a 20% discount off the non-member price. Members may order multiple copies but will not receive an additional discount below the member price. No refunds for returned books.

Read also: Demystifying Virginia's SOL

tags: #standards #for #educational #testing

Popular posts: