Abstract
The Inventory of Problems-29 (IOP-29; Viglione, Giromini, & Landis, Journal of Personality Assessment, 99(5), 534–544, 2017) is a 29-item, recently published, self-administered test aimed at assessing the credibility of various symptom presentations. Although available research strongly supports the use of this symptom validity test in malingering-related contexts, to date, only few studies have analyzed data from real-life forensic evaluations. To fill this gap and explore ecological and convergent validity, the current study analyzed data from 74 court-ordered evaluations aimed at establishing the possible presence of psychological injury. Such evaluations are high-stakes situations in which exaggeration or malingering occur relatively often. We used a research-supported and popular symptom validity test, i.e., the Structured Inventory of Malingered Symptomatology (SIMS; Smith & Burger, Journal of the American Academy on Psychiatry and Law, 25:180–183, 1997), as our criterion variable. The IOP-29 produced excellent area under the curve (AUC) values of .98 with a recommended SIMS total score cutoff (≥ 17) and .99 when eliminating too-close-to-classify cases (Rogers & Bender, 2018) and very large Cohen’s d effect sizes of 2.98 and 3.59, respectively. Crucially, when implementing established cut scores from previous research, the IOP-29 yielded very high specificity and sensitivity rates, and the predictions from the two tests were strikingly similar. Taken together, these findings support the strong convergent validity of the IOP-29 and its utility in applied clinical and forensic settings.
Similar content being viewed by others
Notes
It should be noted that when Giromini et al. (2019a) published their paper, no published studies had yet reported on evaluations from real-life forensic context. More recently, however, one of the samples inspected by Giromini et al. (2019c) did include a small group (n = 28) of patients who had been evaluated for possible malingering in work compensation-related, evaluation context.
Because homoscedasticity could not be assumed, Welch-Satterthwaite method was used to adjust degrees of freedom.
Because homoscedasticity could not be assumed, Welch-Satterthwaite method was used to adjust degrees of freedom.
References
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: Author.
Ben-Porath, Y. S., & Tellegen, A. (2008). The Minnesota Multiphasic Personality Inventory-2 Restructured Form: Manual for administration, scoring, and interpretation. Minneapolis, MN: University of Minnesota.
Berry, D. T. R., & Nelson, N. W. (2010). DSM-5 and malingering: A modest proposal. Psychological Injury and Law, 3(4), 295–303.
Brislin, R. W. (1980). Translation and content analysis of oral and written material. In H. C. Triandis & J. W. Berry (Eds.), Handbook of cross-cultural psychology (Vol. 1, pp. 389–444). Boston, MA: Allyn & Bacon.
Burla, F., Mazza, C., Cosmo, C., Barchielli, B., Marchetti, D., Verrocchio, M. C., & Roma, P. (2019). Use of the Parents Preference Test in Child Custody Evaluations: Preliminary Development of Conforming Parenting Index. Mediterranean Journal Of Clinical Psychology, 7(3).
Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., & Kaemmer, B. (2001). Minnesota Multiphasic Personality Inventory—2: Manual for administration, scoring and interpretation (rev ed.). Minneapolis, MN: University of Minnesota.
Chafetz, M., & Underhill, J. (2013). Estimated costs of malingered disability. Archives of Clinical Neuropsychology, 28, 633–639.
Clegg, C., Fremouw, W., & Mogge, N. (2009). Utility of the Structured Inventory of Malingered Symptomatology (SIMS) and the Assessment of Depression Inventory (ADI) in screening for malingering among outpatients seeking to claim disability. Journal of Forensic Psychiatry & Psychology, 20, 239–254.
Dandachi-FitzGerald, B., Ponds, R. W. H. M., & Merten, T. (2013). Symptom validity and neuropsychological assessment: A survey of practices and beliefs of neuropsychologists in six European countries. Archives of Clinical Neuropsychology, 28(8), 771–783.
Geisinger, K. F. (2003). Testing and assessment in cross-cultural psychology. In J. R. Graham & J. A. Naglieri (Eds.), Handbook of psychology. Part one (pp. 95–117). Hoboken, NJ: John Wiley & Sons, Inc..
Giger, P., Merten, T., Merckelbach, H., & Oswald, M. (2010). Detection of feigned crime-related amnesia: A multi–method approach. Journal of Forensic Psychology Practice, 10, 440–463.
Giromini, L., Barbosa, F., Coga, G., Azeredo, A., Viglione, D. J., & Zennaro, A. (2019b). Using the inventory of problems – 29 (IOP-29) with the Test of Memory Malingering (TOMM) in symptom validity assessment: A study with a Portuguese sample of experimental feigners. Applied Neuropsychology: Adult. https://doi.org/10.1080/23279095.2019.1570929.
Giromini, L., Carfora Lettieri, S., Zizolfi, S., Zizolfi, D., Viglione, D. J., Brusadelli, E., Perfetti, B., di Carlo, D. A., & Zennaro, A. (2019c). Beyond rare-symptoms endorsement: A clinical comparison simulation study using the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) with the Inventory of Problems-29 (IOP-29). Psychological Injury and Law. https://doi.org/10.1007/s12207-019-09357-7.
Giromini, L., Viglione, D. J., Pignolo, C., & Zennaro, A. (2018). A clinical comparison, simulation study testing the validity of SIMS and IOP-29 with an Italian sample. Psychological Injury and Law, 11(4), 340–350.
Giromini, L., Viglione, D. J., Pignolo, C., & Zennaro, A. (2019a). An Inventory of Problems – 29 (IOP-29) sensitivity study investigating feigning of four different symptom presentations via malingering experimental paradigm. Journal of Personality Assessment. https://doi.org/10.1080/00223891.2019.1566914.
Giromini, L., Viglione, D. J., Pignolo, C., & Zennaro, A. (2019d). An Inventory of Problems – 29 (IOP-29) study on random responding using experimental feigners, honest controls, and computer-generated data. Journal of Personality Assessment. https://doi.org/10.1080/00223891.2019.1639188.
Hathaway, S. R., & McKinley, J. C. (1940). A multiphasic personality schedule (Minnesota): I. Construction of the schedule. Journal of Psychology, 10, 249–254.
La Marca, S., Rigoni, D., Sartori, G., & Lo Priore, C. (2012). Structured Inventory of Malingered Symptomatology (SIMS): Manual (2nd ed.). Firenze, IT: Giunti O.S.
Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17, 54–68.
Lo Piccolo, C. J., Goodkin, K., & Baldewicz, T. T. (1999). Current issues in the diagnosis and management of malingering. Annals of Medicine, 31(3), 166–174.
Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey on North American professionals. The Clinical Neuropsychologist, 29(6), 741–776.
Mazza, C., Burla, F., Verrocchio, M. C., Marchetti, D., Ferracuti, S., Roma, P. (2019b). MMPI-2-RF profiles in child custody litigants. Frontiers in Psychiatry.
Mazza, C., Monaro, M., Orrù, G., Colasanti, M., Ferracuti, S., Burla, F., & Roma, P. (2019a). Introducing machine learning to detect personality faking-good in a male sample: A new model based on Minnesota Multiphasic Personality Inventory-2 restructured form scales and reaction times. Frontiers in Psychiatry, 10(389). https://doi.org/10.3389/fpsyt.2019.00389.
Merten, T., Merckelbach, H., Giger, P., & Stevens, A. (2016). The Self-Report Symptom Inventory (SRSI): A new instrument for the assessment of distorted symptom endorsement. Psychological Injury and Law, 9, 102–111.
Morey, L. C. (1991). Personality assessment inventory. Professional manual. Odessa, FL: Psychological Assessment Resources.
Morey, L. C. (2007). Personality assessment inventory (PAI). Professional manual (2nd ed.). Odessa, FL: Psychological Assessment Resources.
Rogers, R., & Bender, D. (2018). Clinical assessment of malingering and deception. New York, NY: Guilford Press.
Rogers, R., Gillis, J., Bagby, R., & Monteiro, E. (1991a). Detection of malingering on the Structured Interview of Reported Symptoms (SIRS): A study of coached and uncoached simulators. Psychological Assessment, 3, 673–677.
Rogers, R., Gillis, J. R., Dickens, S. E., & Bagby, R. M. (1991b). Standardized assessment of malingering: Validation of the structured interview of reported symptoms. Psychological Assessment, 4, 89–96.
Rogers, R., Sewell, K. W., & Gillard, N. D. (2010). Structured Interview of Reported Symptoms (SIRS) and professional manual. Lutz, FL: Psychological Assessment Resources, Inc..
Rogers, R., Sewell, K. W., Martin, M. A., & Vitacco, M. J. (2003). Detection of feigned mental disorders: A meta-analysis of the MMPI-2 and malingering. Assessment, 10(2), 160–177.
Roma, P., Mazza, C., Ferracuti, G., Cinti, M. E., Ferracuti, S., & Burla, F. (2019a). Drinking and driving relapse: Data from BAC and MMPI-2. PLoS One, 14(1), e0209116. https://doi.org/10.1371/journal.pone.0209116.
Roma, P., Mazza, C., Mammarella, S., Mantovani, B., Mandarelli, G., & Ferracuti, S. (2019b). Faking-good behavior in self-favorable scales of the MMPI-2: A study with time pressure. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015-5759/a000511.
Roma, P., Piccinni, E., Ferracuti, S. (2016). Using MMPI-2 in forensic assessment. Rassegna Italiana di Criminologia, 10(2), 116–122.
Roma, P., Ricci, F., Kotzalidis, G. D., Abbate, L., Lubrano, A., Versace, G., Pazzelli, F., Malagoli, M., Girardi, P., & Ferracuti, S. (2014). MMPI-2 in child custody litigation: A comparison between genders. European Journal of Psychological Assessment, 30, 110–116.
Roma, P., Verrocchio, M. C., Mazza, C., Marchetti, D., Burla, F., Cinti, M. E., & Ferracuti, S. (2018). Could time detect a faking-good attitude? A study with the MMPI-2-RF. Frontiers in Psychology, 9(1064). https://doi.org/10.3389/fpsyg.2018.01064.
Sharf, A. J., Rogers, R., Williams, M. M., & Henry, S. A. (2017). The effectiveness of the MMPI-2-RF in detecting feigned mental disorders and cognitive deficits: A meta-analysis. Journal of Psychopathology and Behavioral Assessment, 39(3), 441–455.
Smith, G. P., & Burger, G. K. (1997). Detection of malingering: Validation of the Structured Inventory of Malingered Symptomatology (SIMS). Journal of the American Academy on Psychiatry and Law, 25, 180–183.
Tombaugh, T. N. (1996). Test of memory malingering (TOMM). New York, USA: Multi Health Systems.
Tombaugh, T. N. (1997). The Test of Memory Malingering (TOMM): Normative data from cognitively intact and cognitively impaired individuals. Psychological Assessment, 9(3), 260–268.
Van de Vijver, F., & Hambleton, R. K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1, 89–99.
van Impelen, A., Merckelbach, H., Jelicic, M., & Merten, T. (2014). The Structured Inventory of Malingered Symptomatology (SIMS): A systematic review and meta-analysis. The Clinical Neuropsychologist, 28, 1336–1365.
Viglione, D. J., Giromini, L., & Landis, P. (2017). The development of the Inventory of Problems–29: A brief self-administered measure for discriminating bona fide from feigned psychiatric and cognitive complaints. Journal of Personality Assessment, 99(5), 534–544.
Widows, M. R., & Smith, G. P. (2005). SIMS-structured inventory of malingered symptomatology. Professional manual. Lutz, FL: Psychological Assessment Resources.
Wisdom, N. M., Callahan, J. L., & Shaw, T. G. (2010). Diagnostic utility of the structured inventory of malingered symptomatology to detect malingering in a forensic sample. Archives of Clinical Neuropsychology, 25, 118–125.
Author information
Authors and Affiliations
Contributions
Conceived the experiment: PR, CM, SF. Data acquisition: PR. Data analysis: LG. Data interpretation: PR, CM, LG, DV, FB, SF. Drafting of the manuscript: PR, CM, LG, DV. All authors revised the manuscript critically and gave final approval of the version to be published.
Corresponding author
Ethics declarations
Ethics Statement
This study was carried out with written informed consent by all subjects, in accordance with the Declaration of Helsinki. It was approved by the local ethics committee (Board of the Department of Human Neuroscience, Faculty of Medicine and Dentistry, Sapienza University of Rome).
Conflict of Interest
Luciano Giromini and Donald J. Viglione declare that they own a share in the corporate (LLC) that possesses the rights to Inventory of Problems. All other four authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Roma, P., Giromini, L., Burla, F. et al. Ecological Validity of the Inventory of Problems-29 (IOP-29): an Italian Study of Court-Ordered, Psychological Injury Evaluations Using the Structured Inventory of Malingered Symptomatology (SIMS) as Criterion Variable. Psychol. Inj. and Law 13, 57–65 (2020). https://doi.org/10.1007/s12207-019-09368-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12207-019-09368-4