The “shelflife” of a test validation study: A survey of expert opinion

Abstract

Anonymous mailed surveys containing a description of a competent and successful content validation or criterion-related validation study were returned by 106 experts in employment test validation: Fellows of SIOP, ABPP Diplomates in I/O Psychology, and experienced practitioners nominated by the first two groups. More than 70% replied that they would seek additional supportive evidence within 5 years or less following the validation. The most frequently suggested action was a review of the target job requirements. Opinions did not differ as a function of demographic and experiential variables—except between those who have been involved in Title VII employment discrimination litigation and those who have not, and between those who have primarily represented employers vs those who have represented plaintiffs more frequently in such litigation. Whereas decrements to the original supporting evidence would lead respondents to shorten their estimates of longevity, a surplus of supportive evidence would not lead to extended estimates. Generalizability and limitations of the survey are discussed as well as implications for Title VII litigation.