Hostname: page-component-68c7f8b79f-wfgm8 Total loading time: 0 Render date: 2025-12-21T22:18:00.292Z Has data issue: false hasContentIssue false
  • English
  • Français

Failure of a single performance validity test matters after traumatic brain injury

Published online by Cambridge University Press:  18 December 2025

Jacobus Donders Open the ORCID record for Jacobus Donders [Opens in a new window] ,
Ferdinand Korneli  and
Leigha Slater
Jacobus Donders*
Affiliation:
Department of Psychology, Mary Free Bed Rehabilitation Hospital, Grand Rapids, MI, USA
Ferdinand Korneli
Affiliation:
Department of Psychology, Mary Free Bed Rehabilitation Hospital, Grand Rapids, MI, USA
Leigha Slater
Affiliation:
Department of Psychology, Mary Free Bed Rehabilitation Hospital, Grand Rapids, MI, USA
*
Corresponding author: Jacobus Donders; Email: jacobus.donders@maryfreebed.com
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective:

This study aimed to explore the correlates of zero, one, and multiple performance validity test (PVT) failures on cognitive test performance in patients with various degrees of severity of traumatic brain injury.

Method:

306 participants completed the Trail Making Test as part of a neuropsychological evaluation within 1–36 months post-injury. They were assigned to zero, one, or ≥ two fail groups on the basis of at least two independent PVTs. Group differences in Trail Making Test performance were analyzed with analysis of variance, with post hoc contrasts with the Bonferroni correction for multiple comparisons. Groups were also compared on various background characteristics.

Results:

Participants who passed all PVTs had statistically significantly better performance on both parts of the Trail Making Test as compared to those who failed either one or multiple PVTs, with the latter two groups not differing statistically significantly from each other. PVT failure was relatively more common in participants who were female, had an uncomplicated mild TBI, were involved in financial compensation-seeking, and were seen at a longer time point since injury.

Conclusion:

Failure of even only one PVT is associated with lower neuropsychological test performance in patients with traumatic brain injury, especially when empirically validated criteria are used that are stratified by injury severity. Such failure does not always reflect malingering but must be interpreted and addressed in the context of patient background characteristics.

Keywords

Assessmentcognitionsex differencesinjury severitycompensation-seekingtime since injury

Information

Type
Research Article
Information
Journal of the International Neuropsychological Society , First View , pp. 1 - 6
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of International Neuropsychological Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Azeredo, A., Geraldo, A., Moreira, D., & Barbosa, F. (2024). Traumatic brain injury and malingering: A systematic review. Psychology & Neuroscience, 17(2), 61–88.10.1037/pne0000331CrossRefGoogle Scholar
Boone, K. B., Litvin, P., & Victor, T. L. (2021). Base rates of feigned mild traumatic brain injury. In Boone, K. B. (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed., pp. 341–355). Guilford.Google Scholar
Boone, K. B., Lu, P., & Herzberg, D. (2002). The dot counting test. Western Psychological Services.Google ScholarPubMed
Carone, D. A., Iverson, G. L., & Bush, S. S. (2010). A model to approaching and providing feedback to patients regarding invalid test performance in clinical neuropsychological evaluations. The Clinical Neuropsychologist, 24(5), 759–778.10.1080/13854041003712951CrossRefGoogle Scholar
Dandachi-FitzGerald, B., Merckelbach, H., & Merten, T. (2022). Cry for help as a root cause of poor symptom validity: A critical note. Applied Neuropsychology: Adult, 31(4), 527–532.10.1080/23279095.2022.2040025CrossRefGoogle ScholarPubMed
Delis, D. C., Kramer, E., Kaplan, E., & Ober, B. A. (2017). California verbal learning test—Third edition. NCS Pearson.Google Scholar
Denning, J. H. (2023). When failing one performance validity test matters. Applied Neuropsychology, 32(5), 1418–1429.10.1080/23279095.2023.2285503CrossRefGoogle ScholarPubMed
Denning, J. H., & Horner, M. D. (2024). The impact of race and other demographic factors on the false positive rates of five embedded Performance Validity Tests (PVTs) in a Veteran sample. Journal of Clinical and Experimental Neuropsychology, 46(1), 25–35.10.1080/13803395.2024.2314737CrossRefGoogle Scholar
Dennis, J., Yengo-Kahn, A. M., Kirby, P., Solomon, G. S., Cox, N. J., & Zuckerman, S. L. (2019). Diagnostic algorithms to study post-concussion syndrome using electronic health records: Validating a method to capture an important patient population. Journal of Neurotrauma, 36(14), 2167–2177.10.1089/neu.2018.5916CrossRefGoogle ScholarPubMed
Donders, J., & Vos, M. (2023). Utility of CVLT–3 response bias as a measure of performance validity after traumatic brain injury. The Clinical Neuropsychologist, 37(1), 91–100.10.1080/13854046.2022.2051152CrossRefGoogle ScholarPubMed
Erdodi, L. A. (2023). From “below chance” to “a single error is one too many”: Evaluating various thresholds for invalid performance on two forced choice recognition tests. Behavioral Sciences & the Law, 41(5), 445–462.10.1002/bsl.2609CrossRefGoogle Scholar
Erdodi, L. A., Seke, K. R., Shahein, A., Tyson, B. T., Sagar, S., & Roth, R. M. (2017). Low scores on the Grooved Pegboard Test are associated with invalid responding and psychiatric symptoms. Psychology & Neuroscience, 10(3), 325–344.10.1037/pne0000103CrossRefGoogle Scholar
Greiffenstein, M. F., Baker, W. J., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218–224.10.1037/1040-3590.6.3.218CrossRefGoogle Scholar
Henry, G. K. (2023). Detection of noncredible cognitive performance with Wechsler Memory Scale–IV measures in mild traumatic brain injury litigants. Applied Neuropsychology: Adult. Advance online publication. https://doi.org/10.1080/23279095.2023.2287139 CrossRefGoogle Scholar
Hromas, G., Rolin, S., & Davis, J. J. (2022). Racial differences in positive findings on embedded performance validity tests. Applied Neuropsychology: Adult, 32(1), 28–36.10.1080/23279095.2022.2146504CrossRefGoogle ScholarPubMed
Karamian, A., Lucke-Wold, B., & Seifi, A. (2024). Prevalence of traumatic brain injury in the general adult population of the USA: A meta-analysis. Neuroepidemiology, 59(5), 558–567.10.1159/000540676CrossRefGoogle Scholar
Kim, S., Currao, A., Brown, E., Milberg, W. P., & Fortier, C. B. (2024). Importance of validity testing in psychiatric assessment: Evidence from a sample of multimorbid post-9/11 veterans. Journal of the International Neuropsychological Society, 30(4), 410–419.10.1017/S1355617723000711CrossRefGoogle ScholarPubMed
Kukla, T. J., Finley, J.-C. A., Kent, G. W., Newkirk, B. O., Payne, A.d, Fegter, O., …Soble, J. R. (2025). Failing more freestanding performance validity tests results in progressive artificial lowering of invalid neuropsychological test scores. Applied Neuropsychology: Adult, Advance online publication. https://doi.org/10.1080/23279095.2025.2507204 CrossRefGoogle Scholar
Lange, R. T., Iverson, G. L., Zakrzewski, M. J., Ethel-King, P. E., & Franzen, M. D. (2005). Interpreting the Trail Making Test following traumatic brain injury: Comparison of traditional time scores and derived indices. Journal of Clinical and Experimental Neuropsychology, 27(7), 897–906.10.1080/1380339049091290CrossRefGoogle ScholarPubMed
Leonhard, C. (2023). Review of statistical and methodological issues in the forensic prediction of malingering from validity tests: Part 2 – Methodological issues. Neuropsychology Review, 33(3), 604–623.10.1007/s11065-023-09602-6CrossRefGoogle Scholar
Lesica, S., Luu, H., & Lawrence, M. (2024). Performance validity in a presurgical epilepsy population. The Clinical Neuropsychologist, 39(4), 975–987.10.1080/13854046.2024.2391128CrossRefGoogle Scholar
Lippa, S. M. (2018). Performance validity testing in neuropsychology: A clinical guide, critical review, and update on a rapidly evolving literature. The Clinical Neuropsychologist, 32(3), 391–421.10.1080/13854046.2017.1406146CrossRefGoogle ScholarPubMed
Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the test of memory Malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119.10.1080/13854046.2019.1637027CrossRefGoogle ScholarPubMed
McCaul, C., Boone, K. B., Ermshar, A., Cottingham, M., Victor, T. L., Ziegler, E., Zeller, M. A., & Wright, M. (2018). Cross-validation of the Dot Counting Test in a large sample of credible and non-credible patients referred for neuropsychological testing. The Clinical Neuropsychologist, 32(6), 1054–1067.10.1080/13854046.2018.1425481CrossRefGoogle Scholar
McWhirter, L., Ritchie, C. W., Stone, J., & Carson, A. (2020). Performance validity test failure in clinical populations – A systematic review. Journal of Neurology, Neurosurgery & Psychiatry, 91(9), 945–952.10.1136/jnnp-2020-323776CrossRefGoogle ScholarPubMed
Peak, A. M., Marceaux, J. C., Chicota-Carroll, C., & Soble, J. R. (2024). Cross-validation of the Trail Making Test as a non-memory-based embedded performance validity test among veterans with and without cognitive impairment. Journal of Clinical and Experimental Neuropsychology, 46(1), 16–24.10.1080/13803395.2023.2287784CrossRefGoogle ScholarPubMed
Phillips, M. S., Whitman Kent, G., Ismail, H., Piszczor, J., Galindo, B. N., Shapiro, G., Gonzalez, L., Cerny, B. M., & Soble, J. R. (2025). Relationship between subjective cognitive concerns and objective neurocognitive performance in primary medical versus primary psychiatric populations. Psychological Medicine, 55. (Article e156). https://doi.org/10.1017/S0033291725001084 CrossRefGoogle ScholarPubMed
Proto, D. A., Pastorek, N. J., Miller, B. I., Romesser, J. M., Sim, A. H., & Linck, J. F. (2014). The dangers of failing one or more performance validity tests in individuals claiming mild traumatic brain injury-related postconcussive symptoms. Archives of Clinical Neuropsychology, 29(7), 614–624.10.1093/arclin/acu044CrossRefGoogle ScholarPubMed
Rabinowitz, A. R., Li, X., McCauley, S. R., Wilde, E. A., Barnes, A., Hanten, G., Mendez, D., McCarthy, J. J., & Levin, H. S. (2015). Prevalence and predictors of poor recovery from mild traumatic brain injury. Journal of Neurotrauma, 32(19), 1488–1496.10.1089/neu.2014.3555CrossRefGoogle ScholarPubMed
Roebuck-Spencer, T., & Sherer, M. (2018). Moderate and severe traumatic brain injury. In Morgan, J. E., & J.H.Ricker, J. H. (Eds.), Textbook of clinical neuropsychology (2nd ed. pp. 387–410). Routledge.Google Scholar
Rohling, M. L., Larrabee, G. J., & Davis, J. J. (2025). Collinearity, tetrachoric correlation, and criterion group assignment of examinees failing only one performance validity test (PVT): Testing Leonhard’s (2023) PVT critique. The Clinical Neuropsychologist, 1–17.10.1080/13854046.2025.2508472CrossRefGoogle ScholarPubMed
Roor, J. J., Knoop, H., Dandachi-FitzGerald, B., Peters, M. J. V., Bleijenberg, G., & Ponds, R. W. H. M. (2020). Feedback on underperformance in patients with Chronic Fatigue Syndrome: The impact on subsequent neuropsychological test performance. Applied Neuropsychology: Adult, 27(2), 188–196.10.1080/23279095.2018.1519509CrossRefGoogle ScholarPubMed
Schroeder, R. W., Boone, K. B., & Larrabee, G. J. (2021). Design methods in neuropsychological performance validity, symptom validity, and malingering research. In Boone, K. B. (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed. pp. 11–33). Guilford.Google Scholar
Schroeder, R. W., & Martin, P. K. (2025). Clinician’s guide to validity assessment and management in neuropsychology (pp. 170–188). Guilford.Google Scholar
Schroeder, R. W., Martin, P. K., Heinrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. https://doi.org/10.1080/13854046.2018.1484517 CrossRefGoogle ScholarPubMed
Schroeder, R. W., Martin, P. K., & Larrabee, G. J. (2021). Validity assessment in patients with mild traumatic brain injury. In Schroeder, R. W., & Martin, P. K. (Eds.), Validity assessment in clinical neuropsychological practice (pp. 338–356). Guilford.Google Scholar
Soble, J. R., Alverson, W. A., Phillips, J. I., Critchfield, E. A., Fullen, C., O’Rourke, J. J. F., Messerly, J., Highsmith, J. M., Bailey, K. C., Webber, T. A., & Marceaux, J. C. (2020). Strength in numbers or quality over quantity? Examining the importance of criterion measure selection to define validity groups in performance validity test (PVT) research. Psychological Injury and Law, 13(1), 44–56.10.1007/s12207-019-09370-wCrossRefGoogle Scholar
Stucky, K. J., Kirkwood, M. W., & Donders, J. (2020). Traumatic brain injury. In Stucky, K. J., Kirkwood, M. W., M., W., & Donders, J. (Eds.), Clinical neuropsychology study guide and board review (2nd ed. pp. 545–560). Oxford.Google Scholar
Suhr, J. A., & Barrash, J. (2007). Performance on standard attention, memory and psychomotor speed tasks as indicators of malingering. In Larrabee, G. L. (Ed.), Assessment of malingered neuropsychological deficits (131–170). Oxford.Google Scholar
Sullivan-Baca, E., Naylon, K., Zartman, A., Ardolf, B., & Westhafer, J. G. (2020). Gender differences in veterans referred for neuropsychological evaluation in an outpatient neuropsychology consultation service. Archives of Clinical Neuropsychology, 35(5), 562–575.10.1093/arclin/acaa008CrossRefGoogle Scholar
Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., Kirkwood, M. W., Schroeder, R. W., Suhr, J. A., & Conference Participants (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6), 1053–1106.10.1080/13854046.2021.1896036CrossRefGoogle ScholarPubMed
Tierney, S. M., Taiwo, Z., Choudhury, T. K., Lippa, S. M., Troyanskaya, M., Pastorek, N. J., Miller, B., Romesser, J., & Sim, A. (2023). Varying failure criteria on performance validity tests influences interpretation of cognitive outcomes. Neuropsychology, 37(1), 93–103.10.1037/neu0000857CrossRefGoogle ScholarPubMed
Tombaugh, T. N. (1996). Test of Memory Malingering. Multi Health Systems.Google Scholar
Truter, S. (2025). Performance invalidity in traumatic brain injury litigants with poor quality of education: A South African cross-cultural study. Journal of Clinical and Experimental Neuropsychology, 47(1-2), 26–39.10.1080/13803395.2025.2456045CrossRefGoogle ScholarPubMed
Uiterwijk, D., Stargatt, R., & Crowe, S. F. (2022). Objective cognitive outcomes and subjective emotional sequelae in litigating adults with a traumatic brain injury: The impact of performance and symptom validity measures. Archives of Clinical Neuropsychology, 37(8), 1662–1687.10.1093/arclin/acac039CrossRefGoogle ScholarPubMed
Young, G. (2019). The cry for help in psychological injury and law: Concepts and review. Psychological Injury and Law, 12(3-4), 225–237.10.1007/s12207-019-09360-yCrossRefGoogle Scholar