Fire Figher Biodata: Summary of Validity and Fairness
Page 2 of 3 (Quick jump - 1, 2, 3)

Biodata Validity Estimation

A standard cross-validation design was applied to the total matched sample (N = 730). In applying this design, derivation and cross-validation samples of equal size (N = 365) were randomly chosen from the total matched sample. Within the derivation sample, separate biodata predictor scales were developed for physical performance (BIO_PHYS), cognitive performance (BIO_COGN), and teamwork performance (BIO_TEAM). These predictors were then converted to standard T scores (i.e., mean = 50, standard deviation = 10). An equal-weighted composite of the biodata predictors (ALL_BIO) was computed by summing the standard T scores for the three biodata predictors.

The resulting predictor measures were then applied to the cross-validation sample (N = 365) to estimate the validity of these measures when applied to an independent sample of fire fighters. The resulting cross-validity statistics are shown below.

The cross-validation data showed statistically significant validity coefficients (p < .001) for each of the three biodata predictor scales against their corresponding principal component criteria, ranging from .30 to .39. The overall biodata predictor composite (ALL_BIO) also showed statistically significant cross-validity (r = .27, p < .001) against the overall performance criterion (OVERALL). These results provide clear evidence for the criterion-related validity of the biodata predictors.

These results also provide evidence of construct validity for the biodata predictors. This evidence is seen by the low or negative correlations of the biodata predictors with off-diagonal criteria. For example, the biodata predictor for physical performance shows a .39 validity against the physical performance criterion (CRITFAC1), but has essentially zero correlation with the cognitive performance criterion (CRITFAC2, r = .00), and it shows a negative correlation with the teamwork criterion (CRITFAC3, r = -.18). Similar results are shown for the other two biodata predictor scales. This discriminant validity evidence supports the construct validity of the three biodata predictor scales. This means that each of the three biodata scales effectively predicts what it is intended to predict, and it does not predict other distinct components of fire fighter job performance, with which it should be unrelated.

Privacy Policy
Copyright © 1994 to 2018, San Diego, California. All rights reserved.

Selex, e-Selex, Selection Excellence, PreSelex, SkillSelex, JobSelex, WEBselex,
Selex Success, and SmartSelex are registered trademarks of
The Intelligent Choice, ACE, and Authorized Consulting Expert are trademarks of