Cognitive Ability

Dilchert, S.
In D. S. Ones, N. Anderson, C. Viswesvaran, & H. Sinangil (Eds.)
The SAGE Handbook of Industrial, Work and Organizational Psychology: Vol. 1. Personnel psychology and employee performance (2nd ed., pp. 248–276).
SAGE
(2018)

This chapter summarizes important issues surrounding the use of cognitive ability tests in organizational settings, and highlights new developments that are becoming particularly pertinent given demographic changes in many societies and international economic trends (e.g., age differences, cross-cultural assessment, internet-based testing).

Ones, D. S., Dilchert, S., Viswesvaran, C., & Salgado, J. F.
In J. L. Farr & N. T. Tippins (Eds.),
Handbook of employee selection (2nd ed., pp. 251-276).
Routledge
(2017)

In this chapter, we provide an overview of cognitive ability’s key role in staffing organizations and provide evidence-based practice recommendations. We first present a brief synopsis of the history, current usage, and acceptance of cognitive ability tests in employee selection. Second, we highlight the theoretical underpinnings and structure of cognitive ability as a construct. Third, we discuss developments in its measurement. Fourth, we present an overview of the criterion-related validity of cognitive ability tests in predicting valued work behaviors and outcomes, including non-task-performance criteria that have been increasingly investigated in recent years. Fifth, we discuss the issue of group differences in cognitive ability test scores both within the United States and internationally. We conclude by discussing future research and challenges facing organizations that intend to use cognitive ability tests in making employee selection decisions.

Klein, R. M., Dilchert, S. Ones, D. S., & Dages, K. D.
Journal of Applied Psychology, 100, 1497-1510.
(2015)

Age differences on measures of general mental ability and specific cognitive abilities were examined in 2 samples of job applicants to executive positions as well as a mix of executive/nonexecutive positions to determine which predictors might lead to age-based adverse impact in making selection and advancement decisions. Generalizability of the pattern of findings was also investigated in 2 samples from the general adult population. Age was negatively related to general mental ability, with older executives scoring lower than younger executives. For specific ability components, the direction and magnitude of age differences depended on the specific ability in question. Older executives scored higher on verbal ability, a measure most often associated with crystallized intelligence. This finding generalized across samples examined in this study. Also, consistent with findings that fluid abilities decline with age, older executives scored somewhat lower on figural reasoning than younger executives, and much lower on a letter series test of inductive reasoning. Other measures of inductive reasoning, such as Raven’s Advanced Progressive Matrices, also showed similar age group mean differences across settings. Implications for employee selection and adverse impact on older job candidates are discussed.

Dilchert, S.
In J. F. Carlson, K. F. Geisinger, & J. L. Johnson (Eds.),
Mental measurements yearbook (19th ed., pp. 491-494). Lincoln, NE: University of Nebraska Press.
(2014)

This review provides information about the development, reliability, and validity of the Non-Verbal IQ Test (NVIQT). The NVIQT is a nonverbal measure of cognitive ability, developed to assess spatial ability and pattern recognition. The stated purpose of the test is to serve as a measure of intelligence that minimizes irrelevant cultural or educational influences on test scores. The technical manual accompanying the test does not further delineate the nature of the construct that the test is intended to assess. Limited information is provided on the intended target population or intended uses of the test…

Ones, D. S., Dilchert, S., & Viswesvaran, C.
In N. Schmitt (Ed.),
Oxford handbook of personnel assessment and selection (pp. 179-224). New York: Oxford University Press.
(2012)

This chapter describes measures of cognitive ability (general mental ability and specific abilities) and examines their usefulness for personnel selection. An overview of definitional and theoretical issues as they apply to use of such measures in personnel decision making is provided first. Then, issues of reliability of measures are discussed, again with particular emphasis on implications for personnel selection (e.g., impact on rank order of candidates when using different measures). Next, validities of cognitive ability tests are summarized for the following criteria: overall job performance, task performance, contextual performance, counterproductive work behaviors, leadership, creativity and innovation, voluntary turnover, job satisfaction, and career success. The authors address the nature of predictor-criterion relationships (e.g., usefulness of general versus specific abilities, criterion dynamicity, assumption of linearity) by discussing both recent large-scale evidence in normal samples and among the highly gifted. Finally, the extent to which cognitive ability is captured in tools other than standardized tests is summarized, enabling an evaluation of other selection assessments as substitutes and/or supplements to standardized cognitive ability tests.

Ones, D. S., & Dilchert, S.
In R. A. Spies, J. F. Carlson, & K. F. Geisinger (Eds.),
Mental measurements yearbook (18th ed., pp. 1-4). Lincoln, NE: University of Nebraska Press.
(2010)

This review provides information about the development, reliability, and validity of the A-4 Police Officer Video Test. The A-4 Police Officer Video Test is a 90-item multiple-choice test designed to assess both cognitive and noncognitive competencies relevant for success in police office jobs. The test is administered using a video tape, which contains narrated instructions. Administration of the test takes a total time of 155 minutes…

Ones, D. S., & Dilchert, S.
In R. A. Spies, J. F. Carlson, & K. F. Geisinger (Eds.),
Mental measurements yearbook (18th ed., pp. 387-390). Lincoln, NE: University of Nebraska Press.
(2010)

This review provides information about the development, reliability, and validity of the P-1SV and P-2SV Police Officer Tests. The P-lSV and P-2SV Police Officer Tests are intended to assess some characteristics required to perform entry level police officer jobs successfully. Each test form contains 100 multiple-choice questions, which are dichotomously scored (correct/incorrect), and each test yields a single overall score. The knowledge, skills, abilities, and personal characteristics (KSAPs) that the tests assess are specified in the technical manual as: (a) Reasoning Ability, (b) Observation/Perceptiveness, (c) Ability to Learn Proper Police Procedures, (d) Speaking Ability, (e) Ability to Learn Laws to be Enforced, (f) Writing Ability, (g) Problem Solving, (h) Memory, (i) Learning, G) Reading, and (k) Planning/Organizing….

Ones, D. S., Dilchert, S., Viswesvaran, C. & Salgado, J. F.
In J. L. Farr & N. T. Tippins (Eds.),
Handbook of employee selection (pp. 255-275).
New York: Routledge.
(2010)

Intelligence affects individuals’ lives in countless ways. As such, it is an exceedingly precious trait to include in employee selection systems. In this chapter, we provide an overview of cognitive ability’s key role in staffing organizations and provide evidence-based practice recommendations. We first present a brief synopsis of the history, current usage, and acceptance of cognitive ability tests in employee selection. Second, we highlight the theoretical underpinnings of cognitive ability as a construct. Third, we discuss developments in its measurement. Fourth, we present an overview of the criterion-related validity of cognitive ability tests in predicting valued work behaviors and outcomes. Fifth, we discuss the issue of group differences in cognitive ability test scores both within the United States and internationally. We conclude by discussing future research and practice challenges.

Dilchert, S., & Ones, D. S.
International Journal of Selection and Assessment, 17, 254-270.
(2009)

This study provides an investigation of the nomological net for the seven primary assessment center (AC) dimensions identified by Arthur, Day, McNelly, and Eden (Personnel Psychology, 56, 125–154, 2003). In doing so, the authors provide the first robust estimates of the relationships between all primary AC dimensions with cognitive ability and the Big 5 factors of personality. Additionally, intercorrelations between AC dimensions based on sample sizes much larger than those previously available in the meta-analytic literature are presented. Data were obtained from two large managerial samples (total N = 4985). Primary data on AC dimensions, personality, and cognitive ability interrelationships were subsequently integrated with meta-analytic data to estimate incremental validity for optimally and unit-weighted AC dimension composites as well as overall AC ratings over psychometric tests of personality and cognitive ability. Results show that unit- and optimally weighted composites of construct-based AC dimensions add incremental validity over tests of personality and cognitive ability, while overall AC ratings (including those obtained using subjective methods of data combination) do not.

Ones, D. S., & Dilchert, S.
Industrial and Organizational Psychology, 2, 163-170.
(2009)

Hollenbeck (2009) suggests that executive selection decisions are often wrong and believes that selection of executives should be differentiated from selection at lower levels. In addition, he asserts that by focusing on competencies, rather than characteristics, ‘‘we are doing it backwards.’’ We agree with Hollenbeck that sound personnel selection should start with and be based on personal characteristics rather than amorphous, often ill-defined competencies. Yet, this principle applies to all selection not just executive selection. In order to determine whether executive selection should truly be a special process, two key questions must be asked and answered.

Dilchert, S., Ones, D. S., Davis, R. D., & Rostow, C. D.
Journal of Applied Psychology, 92, 616-627.
(2007)

Over the past 2 decades, increasing attention has been directed at the relationship between individual differences and counterproductive work behaviors (CWB). However, most of this research has focused on personality variables as potential predictors of CWB; surprisingly little research has investigated the link between counterproductivity and cognitive ability. This study presents the first focal investigation of the cognitive ability-CWB relationship. The authors measured organizational and interpersonal CWB using organizational records of formally recorded incidents (e.g., destruction of property, physical violence). In a predictive study, for a large sample of law enforcement job applicants, a standardized psychometric test of cognitive ability predicted CWB, whereas educational attainment did not.

Van Rooy, D. L., Viswesvaran, C., Dilchert, S., & Ones, D. S.
In J. H. Greenhaus & G. A. Callanan (Eds.),
Encyclopedia of career development (vol. 1, pp. 259-265).
Thousand Oaks, CA: Sage.
(2006)

Emotional intelligence (EI) is a concept that has caught the attention of researchers, practitioners, and the general public over the last decade. The idea that career development involves not only a cognitive but also an affective component has been promoted in recent years. Popular books discuss the importance of EI for success in academic and occupational settings, as well as how it determines success in current jobs, promotions, and other important life outcomes. Claims abound that successful negotiation of relationships in a career depends on the perceptions and management of emotions in oneself and others. This entry covers three areas associated EI. First, there is a review of the competing conceptualizations (and associated measurements) of EI. Second, there is an overview of empirical studies that attempt to link EI to successful career development. Finally, there is an identification of some critical future research needs and potential applications.

Van Rooy, D. L., Dilchert, S., Viswesvaran, C., & Ones, D. S.
In K. R. Murphy (Ed.), A critique of emotional intelligence:
What are the problems and how can they be fixed? (pp. 235-262).
Mahwah, NJ: Lawrence Erlbaum Associates.

A wide range of measures have been used to help make decisions in personnel selection, and an extensive research base exists on the criterion-related validity of these measures. Across different jobs, general mental ability (GMA) has been found to be the best predictor of overall performance and task performance. Even if organizations value additional criteria, the prediction of task performance is central to personnel selection. In a fast-changing competitive environment, organizations will generally strive to select individuals high on intelligence in an attempt to maximize performance. On the downside, selecting individuals based on GMA often results in adverse impact for minority groups and can lead to costly litigation for organizations in the United States. Furthermore, there is the competing demand for a diverse workforce as an advantage in a multicultural society and global economy. These two conflicting demands (the need to hire individuals high on general cognitive ability and to obtain a diverse workforce) have contributed to interest in the development of measures of alternate or multiple intelligences. In this chapter, we discuss the three intelligences that have received the most attention in the personnel selection arena. The “Big 3” intelligences consist of general, emotional, and practical intelligence. In this chapter, we provide an overview of each of these and discuss the main merits of each. We conclude by relating the three intelligences together and discuss if there is a “best” intelligence to rely on in personnel selection.

Ones, D. S., Viswesvaran, C., & Dilchert, S.
In A. Evers, O. Voskuijl, & N. Anderson (Eds.),
Handbook of personnel selection (pp. 143-173).
Oxford, UK: Blackwell.
(2005)

Our main objective in this chapter is to provide an overview of the vast literature on CA tests in selection contexts. We first discuss the unique status of CA in selection, and clarify its psychometric and psychological meaning. We then review information on the prevalence of CA test use in personnel selection from around the world. We also discuss acceptability of ability testing and applicant reactions. Next, we review the evidence supporting the use of CA tests for selection by summarizing results from meta-analyses examining their criterion-related validity in occupational settings, across national boundaries. The overwhelming evidence suggests that CA tests are predictive of job performance across jobs and cultures. Given this conclusion, we explore the causal mechanisms through which CA comes to influence job performance. Next, we briefly note research on race, ethnic group, gender, and age differences on CA tests and their implications for adverse impact. We conclude our chapter with a discussion of current and new directions for research on CA, including the assessment of CA using various selection methods such as interviews, assessment centers, situational judgment tests (SJTs), and newly proposed intelligences (such as practical intelligence, emotional intelligence, etc.).

Dilchert, S., Ones, D. S., Van Rooy, D. L., & Viswesvaran, C.
In F. Avallone, H. K. Sinangil, & A. Caetano (Eds.),
Convivence in organizations and society (pp. 161-168).
Milan, Italy: Guerini Studio.
(2005)

Emotional intelligence (EI) has dramatically gained in popularity over the last ten years. In recent years, the construct bas seen increased numbers of applications in diverse domains (Matthews, Zeidner, & Roberts, 2002) and has been touted as an essential ingredient for success in school, higher education, and the workplace (see, for example, Gibbs, 1995; Goleman. 1995). claims have been made that EI is an essential ingredient for successful relationships in all walks of life. Several recent works (see Murphy, in press; Van Rooy, Dilchert. Viswesvaran, & Ones, in press; Van Rooy & Viswesvaran, 2004) have evaluated the numerous claims regarding the utility of EI in applied contexts. The aim of this paper is to revisit validity and measurement issues, but to outline different conceptualizations of EI, and sketch its role in navigating through relationships in organizational contexts. The paper is organized into two main sections. In the first section, we review the different conceptualizations of the construct found in the scientific literature and summarize the differences between them. In the second section, we discuss potential process mechanisms through which EI relates to interpersonal behaviors in organizations.

Ones, D. S., & Dilchert, S.
In R. A. Spies & B. S. Plake (Eds.),
Mental measurements yearbook (16th ed., pp. 356-359). Lincoln, NE: University of Nebraska Press.
(2005)

The Emotional Judgment Inventory (EJI) is a self-report measure, assessing seven dimensions of emotional intelligence. The test is based on the definition of emotional intelligence from Salovey and Mayer (1990) as “the ability to appraise one’s own and others’ emotions, manage one’s own and others’ emotions, and use one’s emotions intelligently and adaptively in problem solving” (manual, p. 1). Seven EJl scales assess (a) being aware of emotions, (b) identifying own emotions, (c) identifying others’ emotions, (d) managing own emotions, (e) managing others’ emotions, (f) using emotions in problem solving, and (g) expressing emotions adaptively…

Ones, D. S., Viswesvaran, C., & Dilchert, S. (2005)
In O. Wilhelm & R. W. Engle (Eds.),
Handbook of understanding and measuring intelligence (pp. 431-468).
Thousand Oaks, CA: Sage.
(2040)

In this chapter, our objective is to summarize the evidence supporting the use of cognitive ability tests for personnel selection and for university admissions. We first provide an overview of results from meta-analyses examining the criterion-related validity of cognitive ability tests in multiple educational and occupational settings, across national boundaries. The overwhelming evidence suggests that cognitive ability tests are predictive of important criteria across jobs and cultures. Given this evidence, we then explore why these tests are valid. In doing so, we discuss the different theoretical causal process mechanisms proposed and tested to explain how and why cognitive ability tests come to predict important behaviors and outcomes in educational and work settings. We also discuss controversial issues around cognitive ability testing in selection settings: (a) predictive value of general mental ability versus specific abilities and (b) gender and ethnic group differences on cognitive ability measures and implications for adverse impact. We conclude with a discussion of individual and societal implications of using cognitive ability test scores for making important selection decisions in applied settings.

Viswesvaran, C., Ones, D. S., & Dilchert, S.
In F. Avallone, H. K. Sinangil, & A. Caetano (Eds.),
Identity and diversity in organizations (pp. 185-191).
Milan, Italy: Guerini Studio.
(2003)

Cognitive ability is a powerful predictor in personnel selection. It has been repeatedly shown to have strong criterion related validity for job performance across situations, jobs, organizations and settings. However, there are large mean differences in cognitive ability across racial groups. In this paper, we review findings, clarify some terms, and discuss the implications of these group differences for organizational diversity composition. We conclude with a discussion of alternatives proposed to address these issues.