Abstract
Abstract
For autism spectrum disorder (ASD) in adults there are several diagnostic instruments available with a need for consideration of the psychometric properties. This study aimed to conduct a first psychometric evaluation of a new diagnostic ASD instrument, the NIDA (Dutch Interview for Diagnostic assessment of ASD in adults) in 90 adult males without intellectual disability (age 18–65 years) in the Netherlands: 30 with ASD, 30 with a Personality Disorder and 30 nonpatient controls. The interrater agreement ranged from 0.79 to 1.00, the convergent validity including sensitivity and specificity ranged from 0.76 to 1.00, and we observed an adequate concurrent criterion-related validity. These promising findings can serve as foundation for future psychometric NIDA studies in a more diverse population.
Trial registration
The Netherlands National Trial Register NTR6391. Registered 04 May 2017.
Similar content being viewed by others
References
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed.). American Psychiatric Association.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association.
Anckarsäter, H., Stahlberg, O., Larson, T., Hakansson, C., Jutblad, S.-B., Niklasson, L., et al. (2006). The impact of ADHD and autism spectrum disorders on temperament, character and personality development. American Journal of Psychiatry, 163, 1239–1244.
Arntz, A., Kamphuis, J. H., & Derks, J. L. (2017). SCID-5-P: gestructureerd klinisch interview voor DSM-5 persoonlijkheidsstoornissen. [Structured clinical interview for DSM-5 personality disorders (SCID-5-PD)]. Amsterdam: Boom.
Bastiaansen, J. A., Meffert, H., Hein, S., Huizinga, P., Ketelaars, C., Pijnenborg, M., et al. (2011). Diagnosing autism spectrum disorders in adults: The use of Autism Diagnostic Observation Schedule (ADOS) module 4. Journal of Autism and Developmental Disorders, 41(9), 1256–1266.
Brugha, T. S., McManus, S., Bankart, J., Scott, F., Purdon, S., Smith, J., et al. (2011). Epidemiology of autism spectrum disorders in adults in the community in England. Archives of General Psychiatry, 68, 459–465.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.
de Bildt, A., Sytema, S., Meffert, H., & Bastiaansen, J. A. C. J. (2016). The autism diagnostic observation schedule, module 4: Application of the revised algorithms in an independent well-defined, Dutch sample (n = 93). Journal of Autism and Developmental Disorders, 46, 21–30.
Dietz, P. M., Rose, C. E., McArthur, D., & Maenner, M. (2020). National and state estimates of adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 50, 4258–4266.
Evers, K., Maljaars, J., Carrington, S. J., Carter, A. S., Happé, F., Steyaert, J., et al. (2021). How well are DSM-5 diagnostic criteria for ASD represented in standardized diagnostic instruments? European Child and Adolescent Child Psychiatry, 30(1), 75–87.
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191.
First, M. B., Spitzer, R. L., Gibbon, M., Williams, J. B. W., & Benjamin, L. (1997). Structured clinical interview for axis II personality disorders (SCID-II). American Psychiatric Inc.
First, M. B., Williams, J. B. W., Benjamin, L. S., & Spitzer, R. L. (2016). Structured clinical interview for DSM-5 personality disorders (SCID-5-PD). American Psychiatric Association.
Fleiss, J. L. (1981). Statistical methods for rates and proportions (2nd ed.). John Wiley.
Fusar-Poli, L., Brondino, N., Rocchetti, M., Panisi, C., Provenzani, U., Damiani, S., & Politi, C. (2017). Diagnosing ASD in adults without ID: Accuracy of the ADOS-2 and the ADI-R. Journal of Autism and Developmental Disorders, 47(11), 3370–3379.
Geurts, H. M., & Jansen, M. D. (2012). A retrospective chart study: The pathway to a diagnosis for adults referred for ASD assessment. Autism, 16(3), 299–305.
Happé, F. G., Mansour, H., Barrett, P., Brown, T., Abbott, P., & Charlton, R. A. (2016). Demographic and cognitive profile of individuals seeking a diagnosis of autism spectrum disorder in adulthood. Journal of Autism and Developmental Disorders, 46(11), 3469–3480.
Hayes, A. F., & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1(1), 77–89.
Hofvander, B., Delorme, R., Chaste, P., Nydén, A., Wentz, E., Ståhlberg, O., et al. (2009). Psychiatric and psychosocial problems in adults with normal-intelligence autism spectrum disorders. BMC Psychiatry, 9, 35.
Hoogduin, C. A. L. (1999). Standaardonderzoek voor psychische stoornissen: een semi-gestructureerd interview. In C. A. L. Hoogduin, S. Kneper, & H. W. Csánky (Eds.), Onderzoek bij psychische stoornissen voor bedrijfs- en verzekeringsartsen (pp. 38–64). Bohn Stafleu Van Loghum.
Huang, Y., Arnold, S. R. C., Foley, K.-R., & Trollor, J. N. (2020). Diagnosis of autism in adulthood: A sco** review. Autism, 24(6), 1311–1327.
Hus, V., & Lord, C. (2014). The autism diagnostic observation schedule, module 4: Algorithm and standardized severity scores. Journal of Autism and Developmental Disorders, 44(3), 1996–2012.
Jones, L., Goddard, L., Hill, E. L., Henry, L. A., & Crane, L. (2014). Experiences of receiving a diagnosis of autism spectrum disorder: A survey of adults in the United Kingdom. Journal of Autism and Developmental Disorders, 44(12), 3033–3044.
Kan, C. C., Geurts, H. M., van den Bosch, K., Forceville, E. J. M., van Manen, J., Schuurman, C. H., et al. (2013). Multidisciplinaire richtlijn diagnostiek en behandeling van autismespectrumstoornissen bij volwassenen (Dutch Guideline on diagnosis and treatment of adults on the autism spectrum). De Tijdstroom.
Krippendorff, K. (2012). Content analysis: An introduction to its methodology. Sage.
Lai, M. C., & Baron-Cohen, S. (2015). Identifying the lost generation of adults with autism spectrum conditions. Lancet, 2, 1013–1027.
Lai, M.-C., Lombardo, M. V., Pasco, G., Ruigrok, A. N. V., Wheelwright, S. J., Sadek, S. A., et al. (2011). A behavioral comparison of male and female adults with high functioning autism spectrum conditions. PLoS ONE, 6, e20835.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
Langmann, A., Becker, J., Poustka, L., Becker, K., & Kamp-Becker, I. (2017). Diagnostic utility of the autism diagnostic observation schedule in a clinical sample of adolescents and adults. Research in Autism Spectrum Disorders, 34, 34–43.
Lehnhardt, F. G., Gawronski, A., Volpert, K., Schilbach, L., Tepest, R., Vogeley, K., et al. (2012). Psychosocial functioning of adults with late diagnosed autism spectrum disorders–a retrospective study. Fortschritte Der Neurologie-Psychiatrie, 80(2), 88–97.
Lombard, M., Snyder-Duch, J., & Bracken, C. C. (2002). Content analysis in mass communication: Assessment and reporting of intercoder reliability. Human Communication Research, 28(4), 587–604.
Loomes, R., Hull, L., & Mandy, W. P. L. (2017). What is the male-to-female ratio in autism spectrum disorder? A systematic review and meta-analysis. Journal of the American Academy of Child & Adolescent Psychiatry, 56(6), 466–474.
Lord, C., Pickles, A., McLennan, J., Rutter, M., Bregman, J., Folstein, S., et al. (1997). Diagnosing autism: Analyses of data from the Autism Diagnostic Interview. Journal of Autism and Developmental Disorders, 27, 501–517.
Lord, C., Risi, S., Dilavore, P., Shulman, C., Thurm, A., & Pickles, A. (2006). Autism from 2 to 9 years of age. Archives of General Psychiatry, 63, 694–701.
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., Dilavore, P. C., et al. (2000). The autism diagnostic observation schedule-generic; a standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–223.
Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule—second edition (ADOS-2). Western Psychological Services.
Lugnegård, T., Hallerbäck, M. U., & Gillberg, C. (2012). Personality disorders and autism spectrum disorders: What are the connections? Comprehensive Psychiatry, 53, 333–340.
National Collaborative Centre for Mental Health (NCCMH). (2012). Autism. The NICE guideline on recognition, referral, diagnosis and management of adults on the autism spectrum. British Psychological Society.
Pugliese, C. E., Kenworthy, L., Hus Bal, V., Wallace, G. L., Yerys, B. E., Maddox, B. B., et al. (2015). Replication and comparison of the newly proposed ADOS-2, module 4 algorithm in ASD without ID: A multi-site study. Journal of Autism and Developmental Disorders, 45, 3919–3931.
Rogers, C. L., Goddard, L., Hill, E. L., Henry, L., & Crane, L. (2015). Experiences of diagnosing autism spectrum disorder: a survey of professionals in the United Kingdom. Autism International Journal of Research and Practice, 20(7), 820–831.
Rutherford, M., McKenzie, K., Forsyth, K., McCartney, D., O’Hare, A., McClure, I., & Irvine, L. (2016). Why are they waiting? Exploring professional perspectives and develo** solutions to delayed diagnosis of autism spectrum disorder in adults and children. Research in Autism Spectrum Disorders, 31, 53–65.
Sim, J., & Wright, C. C. (2005). The kappa statistic in reliability studies: Use, interpretation, and sample size requirements. Physical Therapy, 85(3), 257–268.
Somma, A., Borroni, S., Maffei, C., Besson, E., Garbini, A., Granozio, S., et al. (2017). Inter-rater reliability of the Italian translation of the structured clinical interview for DSM-5 personality disorders (SCID-5-PD): A study on consecutively admitted clinical adult participants. Journal of Psychopathology, 23, 105–111.
van Krugten, F. C. W. van, Goorden, M., Balkom, A. J. L. M. van, Oppen, P. van, Ruhé, H., Schaik, D. J. F. van, Brouwer, W., & Hakkaart-van Roijen, L. (2019). The decision tool unipolar depression (DTUD): A new measure to facilitate the early identification of patients with major depressive disorder in need of highly specialized care. BMC Psychiatry, 19, 179.
van Schalkwyk, G. I., Peluso, F., Qayyum, Z., McPartland, J. C., & Volkmar, F. (2015). Varieties of misdiagnosis in ASD: An illustrative case series. Journal of Autism and Developmental Disorders, 45, 911–918.
Vuijk, R. (2016). Nederlands Interview ten behoeve van Diagnostiek Autismespectrumstoornis bij volwassenen (NIDA) (Dutch Interview for Diagnostic assessment Autism spectrum disorder in adults), second edition. Rotterdam: Sarr Expertisecentrum Autisme/Dare to Design. http://www.autismespectrumnederland.nl/wp-content/uploads/2016-Vuijk-NIDA.pdf
Vuijk, R., Deen, M., Sizoo, B., & Arntz, A. (2018). Temperament, character and personality disorders in adults with autism spectrum disorder: A systematic literature review and meta-analysis. Review Journal of Autism and Developmental Disorders, 5, 176–197.
Weertman, A., Arntz, A., & Kerkhofs, M. L. M. (2000). Gestructureerd diagnostisch interview voor DSM-IV persoonlijkheidsstoornissen (SCID II). [Structural and Clinical Interview for DSM-IV personality disorders (SCID II)]. Lisse: Swets Test Publisher.
Wiggins, L. D., Reynolds, A., Rice, C. E., Moody, E. J., Bernal, P., Blaskey, L., et al. (2015). Using standardized diagnostic instruments to classify children with autism in the study to explore early development. Journal of Autism and Developmental Disorders, 45(5), 1271–1280.
Wigham, S., Rodgers, J., Berney, T., Le Couteur, A., Ingham, B., & Parr, J. R. (2019). Psychometric properties of questionnaires and diagnostic measures for autism spectrum disorders in adults: A systematic review. Autism, 23(2), 207–305.
Wilson, C. E., Murphy, C. M., McAlonan, G., Robertson, D. M., Spain, D., Hayward, H., et al. (2016). Does sex influence the diagnostic evaluation of autism spectrum disorder in adults? Autism, 20(7), 808–819.
Zander, E., Willfors, C., Berggren, S., Choque-Olsson, N., Coco, C., Elmund, A., et al. (2016). The objectivity of the autism diagnostic observation schedule (ADOS) in naturalistic clinical settings. European Child and Adolescent Psychiatry, 25(7), 769–780.
Acknowledgments
We greatly appreciate the time and effort devoted by the ninety participants to this study. The authors gratefully acknowledge the study psychologists Anne van der Aar, Nesrin Tatar, Kirsten Zwinkels and Ester van der Sluis. We thank Rosa Meijer, data analyst, for assisting the statistical analyses, and Pieter de Nijs, child and adolescent psychiatrist, Jolinda Volk and Levi Post, master students psychology for checking the data. We also thank Niall Jassim for reviewing the English text of this article. We also thank him and Katy Klugkist for translating the NIDA into English.
Funding
The authors did not receive support from any organization for the submitted work.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, and data collection was performed by RV. Data analyses were performed by RV and MD and checked by the rest of the authors. The first draft of the manuscript was written by RV and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
Vuijk, first author, developed NIDA. The NIDA is available for free. Arntz, is one of the translators of SCID-5-PD.
Ethical Approval
The study was carried out in accordance with the Code of Ethics of the World Medical Association (Declaration of Helsinki, 2000). Approval was granted by the Ethics Committee of the University of Amsterdam (Date: 04 April 2017/No.: 2017-CP-7839).
Consent to Participate
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The Netherlands National Trial Register NTR6391. Registered 04 May 2017.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Vuijk, R., Deen, M., Arntz, A. et al. First Psychometric Properties of the Dutch Interview for Diagnostic Assessment of Autism Spectrum Disorder in Adult Males Without Intellectual Disability. J Autism Dev Disord 52, 3523–3535 (2022). https://doi.org/10.1007/s10803-021-05225-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-021-05225-z