SpringerLink
Log in

Test-Retest Reliability and Construct Validity of the Dutch Injustice Experience Questionnaire in Patients with Chronic Pain

  • Published:
Psychological Injury and Law Aims and scope Submit manuscript

Abstract

Perceived injustice is defined as an appraisal of the severity of loss, blame, a sense of unfairness, and irreparability of loss related to pain. It has a negative impact on health and is associated with poor recovery outcomes in pain rehabilitation programs. In order to measure, the Injustice Experience Questionnaire (IEQ) was developed, but the reliability and validity of the Dutch version of the IEQ had not been studied. This study aimed to investigate construct validity and test-retest reliability of the Dutch IEQ. Included patients were 281 adults with multi-factorial chronic pain (> 3 months) from two health care settings. All patients filled out questionnaires that measured perceived injustice, pain characteristics, central sensitization, disability, pain catastrophizing, pain acceptance, depression, anxiety, PTSD symptoms, anger, and perceived illness threat. Thirteen hypotheses on the strength of the correlations between the IEQ and the other measurements were formulated a priori. Correlations were calculated using Pearson correlation coefficients. To evaluate test-retest reliability, the IEQ was assessed 2 weeks later and intra-class correlations were computed. All measurements, apart from pain duration and number of pain sites, were significantly correlated with the IEQ. Eleven out of 13 hypotheses were confirmed. Intra-class correlation between the first and second assessments of the IEQ was 0.87. The results support the construct validity of the Dutch IEQ and suggest that test-retest reliability is good.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 1(8476), 307–310.

    Article  Google Scholar 

  • Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire-II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42(4), 676–688. https://doi.org/10.1016/j.beth.2011.03.007.

    Article  PubMed  Google Scholar 

  • Boonstra, A. M., Stewart, R. E., Köke, A. J. A., Oosterwijk, R. F. A., Swaan, J. L., Schreurs, K. M. G., & Schiphorst Preuper, H. R. (2016). Cut-off points for mild, moderate, and severe pain on the numeric rating scale for pain in patients with chronic musculoskeletal pain: Variability and influence of sex and catastrophizing. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.01466.

  • Breivik, H., Collett, B., Ventafridda, V., Cohen, R., & Gallacher, D. (2006). Survey of chronic pain in Europe: Prevalence, impact on daily life, and treatment. European Journal of Pain, 10, 287–333.

    Article  Google Scholar 

  • Broadbent, E. (2002). The Brief Illness Perception Questionnaire scoring instructions. Retrieved from https://www.uib.no/ipq/

  • Caumo, W., Antunes, L. C., Elkfury, J. L., Herbstrith, E. G., Busanello Sipmann, R., Souza, A., . . . Neblett, R. (2017). The Central Sensitization Inventory validated and adapted for a Brazilian population: Psychometric properties and its relationship with brain-derived neurotrophic factor. In J Pain Res, 10, 2109–2122.

  • Cuesta-Vargas, A. I., Neblett, R., Chiarotto, A., Kregel, J., Nijs, J., van Wilgen, C. P., Pitance, L., Knezevic, A., Gatchel, R. J., Mayer, T. G., Viti, C., Roldan-Jiménez, C., Testa, M., Caumo, W., Jeremic-Knezevic, M., & Luciano, J. V. (2018). Dimensionality and reliability of the central sensitization inventory in a pooled multicountry sample. The Journal of Pain, 19(3), 317–329. https://doi.org/10.1016/j.jpain.2017.11.006.

    Article  PubMed  Google Scholar 

  • Demyttenaere, K., Bruffaerts, R., Lee, S., Posada-Villa, J., Kovess, V., Angermeyer, M. C., et al. (2007). Mental disorders among persons with chronic back or neck pain: Results from the world mental health surveys. Pain, 129(3), 332–342. https://doi.org/10.1016/j.pain.2007.01.022.

    Article  PubMed  Google Scholar 

  • Derogatis, L. R. (1992). The symptom checklist-90-revised. Minneapolis: NCS Assessments.

    Google Scholar 

  • Downie, W. W., Leatham, P. A., Rhind, V. M., Wright, V., Branco, J. A., & Anderson, J. A. (1978). Studies with pain rating scales. Annals of the Rheumatic Diseases, 37(4), 378–381.

    Article  Google Scholar 

  • Evans, J. D. (1996). Straightforward statistics for the behavioral sciences. Pacific Grove: Brooks/Cole Publishing.

    Google Scholar 

  • Grotle, M., Garratt, A. M., Krogstad Jenssen, H., & Stuge, B. (2012). Reliability and construct validity of self-report questionnaires for patients with pelvic girdle pain. Physical Therapy, 92(1), 111–123. https://doi.org/10.2522/ptj.20110076.

    Article  PubMed  Google Scholar 

  • Harris, S., Morley, S., & Barton, S. B. (2003). Role loss and emotional adjustment in chronic pain. Pain, 105(1–2), 363–370.

    Article  Google Scholar 

  • Hayes, S. C., Masuda, A., Bissett, R., Luoma, J., & Guerrero, L. F. (2004). DBT, FAP, and ACT: How empirically oriented are the new behavior therapy technologies? Behavior Therapy, 35(1), 35–54. https://doi.org/10.1016/S0005-7894(04)80003-0.

    Article  Google Scholar 

  • Jackson, B., Kubzansky, L. D., & Wright, R. J. (2006). Linking perceived unfairness to physical health: The perceived unfairness model. Review of General Psychology, 10(1), 21–40. https://doi.org/10.1037/1089-2680.10.1.21.

    Article  Google Scholar 

  • Kennedy, L., & Dunstan, D. A. (2014). Confirmatory factor analysis of the Injustice Experience Questionnaire in an Australian compensable population. Journal of Occupational Rehabilitation, 24(3), 385–392. https://doi.org/10.1007/s10926-013-9462-9.

    Article  PubMed  Google Scholar 

  • Kerns, R. D., Sellinger, J., & Goodin, B. R. (2011). Psychological treatment of chronic pain. Annual Review of Clinical Psychology, 7, 411–434. https://doi.org/10.1146/annurev-clinpsy-090310-120430.

    Article  PubMed  Google Scholar 

  • Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kregel, J., Vuijk, P. J., Descheemaeker, F., Keizer, D., van der Noord, R., Nijs, J., et al. (2015). The Dutch Central Sensitization Inventory (CSI): Factor analysis, discriminative power and test-retest reliability. The Clinical Journal of Pain, 32, 624. https://doi.org/10.1097/ajp.0000000000000306.

    Article  Google Scholar 

  • la Cour, P., Smith, A. A., & Schultz, R. (2017). Validation of the Danish language Injustice Experience Questionnaire. Journal of Health Psychology, 22(7), 825–833. https://doi.org/10.1177/1359105315616178.

    Article  PubMed  Google Scholar 

  • Lyons, R., & Sullivan, M. (1998). Curbing loss in illness and disability. In J. Harvey (Ed.), Perspectives on personal and interpersonal loss. New York: Taylor & Francis.

    Google Scholar 

  • Mayer, T. G., Neblett, R., Cohen, H., Howard, K. J., Choi, Y. H., Williams, M. J., Perez, Y., & Gatchel, R. J. (2012). The development and psychometric validation of the central sensitization inventory. Pain Practice, 12(4), 276–285. https://doi.org/10.1111/j.1533-2500.2011.00493.x.

    Article  PubMed  Google Scholar 

  • McCracken, L. M. (1998). Learning to live with the pain: Acceptance of pain predicts adjustment in persons with chronic pain. Pain, 74(1), 21–27.

    Article  Google Scholar 

  • McParland, J. L., Hezseltine, L., Serpell, M., Eccleston, C., & Stenner, P. (2011). An investigation of constructions of justice and injustice in chronic pain: A Q-methodology approach. Journal of Health Psychology, 16(6), 873–883. https://doi.org/10.1177/1359105310392417.

    Article  PubMed  Google Scholar 

  • Meeus, M., & Nijs, J. (2007). Central sensitization: A biopsychosocial explanation for chronic widespread pain in patients with fibromyalgia and chronic fatigue syndrome. Clinical Rheumatology, 26(4), 465–473. https://doi.org/10.1007/s10067-006-0433-9.

    Article  PubMed  Google Scholar 

  • Neblett, R., Cohen, H., Choi, Y., Hartzell, M., Williams, M., Mayer, T. G., & Gatchel, R. J. (2013). The Central Sensitization Inventory (CSI): Establishing clinically-significant values for identifying central sensitivity syndromes in an outpatient chronic pain sample. The Journal of Pain, 14(5), 438–445. https://doi.org/10.1016/j.jpain.2012.11.012.

    Article  PubMed  PubMed Central  Google Scholar 

  • Nijs, J., Goubert, D., & Ickmans, K. (2016). Recognition and treatment of central sensitization in chronic pain patients. Not limited to specialized care. The Journal of Orthopaedic and Sports Physical Therapy, 46(12), 1024–1028.

  • Parsons, H., Bruce, J., Achten, J., Costa, M. L., & Parsons, N. R. (2015). Measurement properties of the Disability Rating Index in patients undergoing hip replacement. In Rheumatology (Oxford) 54, 64–71.

  • Pollard, C. A. (1984). Preliminary validity study of the pain disability index. Perceptual and Motor Skills, 59(3), 974. https://doi.org/10.2466/pms.1984.59.3.974.

    Article  PubMed  Google Scholar 

  • Rahbari, A., Dehestani, M., & Baharlouei, H. (2019). Psychometric characteristics of the Persian version of the injustice experience questionnaire. Psychological Injury and Law, 12, 1–9. https://doi.org/10.1007/s12207-019-09344-y.

    Article  Google Scholar 

  • Rodero, B., Luciano, J. V., Montero-Marin, J., Casanueva, B., Palacin, J. C., Gili, M., et al. (2012). Perceived injustice in fibromyalgia: Psychometric characteristics of the Injustice Experience Questionnaire and relationship with pain catastrophising and pain acceptance. Journal of Psychosomatic Research, 73(2), 86–91. https://doi.org/10.1016/j.jpsychores.2012.05.011.

    Article  PubMed  Google Scholar 

  • Salen, B. A., Spangfort, E. V., Nygren, A. L., & Nordemar, R. (1994). The Disability Rating Index: An instrument for the assessment of disability in clinical settings. Journal of Clinical Epidemiology, 47(12), 1423–1435.

    Article  Google Scholar 

  • Scott, W., McCracken, L. M., & Trost, Z. (2014). A psychological flexibility conceptualisation of the experience of injustice among individuals with chronic pain. British Journal of Pain, 8(2), 62–71. https://doi.org/10.1177/2049463713514736.

    Article  PubMed  PubMed Central  Google Scholar 

  • Scott, W., Milioto, M., Trost, Z., & Sullivan, M. J. (2016). The relationship between perceived injustice and the working alliance: A cross-sectional study of patients with persistent pain attending multidisciplinary rehabilitation. Disability and Rehabilitation, 38(24), 2365–2373. https://doi.org/10.3109/09638288.2015.1129444.

    Article  PubMed  Google Scholar 

  • Scott, W., Trost, Z., Milioto, M., & Sullivan, M. J. (2013). Further validation of a measure of injury-related injustice perceptions to identify risk for occupational disability: A prospective study of individuals with whiplash injury. Journal of Occupational Rehabilitation, 23(4), 557–565. https://doi.org/10.1007/s10926-013-9417-1.

    Article  PubMed  Google Scholar 

  • Scott, W., Trost, Z., Milioto, M., & Sullivan, M. J. (2015). Barriers to change in depressive symptoms after multidisciplinary rehabilitation for whiplash: The role of perceived injustice. The Clinical Journal of Pain, 31(2), 145–151. https://doi.org/10.1097/ajp.0000000000000095.

    Article  PubMed  Google Scholar 

  • Steiger, B., Welsch, K., Niederstrasser, N., Hartmann, S., Nilges, P., Ljutow, A., & Ettlin, D. (2019). Validation of the German-language version of the Injustice Experience Questionnaire (IEQ) in five outpatient clinics. Schmerz, 33(2), 106–115. https://doi.org/10.1007/s00482-018-0345-z.

    Article  PubMed  Google Scholar 

  • Sullivan, M. J. L. (2003). Pain Catastrophizing scale. In N. v. d. G. C. J. Vlayen. (Ed.).

  • Sullivan, M. J. L., Adams, H., Horan, S., Maher, D., Boland, D., & Gross, R. (2008). The role of perceived injustice in the experience of chronic pain and disability: Scale development and validation. Journal of Occupational Rehabilitation, 18(3), 249–261. https://doi.org/10.1007/s10926-008-9140-5.

    Article  PubMed  Google Scholar 

  • Sullivan, M. J. L., Bishop, S. R., & Pivik, J. (1995). The Pain Catastrophizing Scale: Development and validation. Psychological Assessment, 7(4), 524–532.

    Article  Google Scholar 

  • Sullivan, M. J. L., Davidson, N., Garfinkel, B. S. N., & Scott, W. (2009). Perceived injustice is associated with heightened pain behavior and disability in individuals with whiplash injuries | SpringerLink. Psychological Injury and Law, 2(3–4), 238–247. https://doi.org/10.1007/s12207-009-9055-2.

    Article  Google Scholar 

  • Sullivan, M. J. L., Scott, W., & Trost, Z. (2012). Perceived injustice: A risk factor for problematic pain outcomes. Clinical Journal of Pain, 28(6), 484–488. https://doi.org/10.1097/AJP.0b013e3182527d13.

    Article  PubMed  Google Scholar 

  • Sullivan, M. J. L., Sullivan, M. E., & Adams, H. M. (2010). Stage of chronicity and cognitive correlates of pain-related disability. Cognitive Behaviour Therapy, 31(3), 111–118.

    Article  Google Scholar 

  • Sullivan, M. J. L., Thibault, P., Simmonds, M. J., Milioto, M., Cantin, A. P., & Velly, A. M. (2009). Pain, perceived injustice and the persistence of post-traumatic stress symptoms during the course of rehabilitation for whiplash injuries. Pain, 145(3), 325–331. https://doi.org/10.1016/j.pain.2009.06.031.

    Article  PubMed  Google Scholar 

  • Tait, R. C., Pollard, C. A., Margolis, R. B., Duckro, P. N., & Krause, S. J. (1987). The Pain Disability Index: Psychometric and validity data. Archives of Physical Medicine and Rehabilitation, 68(7), 438–441.

    PubMed  Google Scholar 

  • Terwee, C. B., Bot, S. D., de Boer, M. R., van der Windt, D. A., Knol, D. L., Dekker, J., et al. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(1), 34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012.

    Article  PubMed  Google Scholar 

  • Trost, Z., Agtarap, S., Scott, W., Driver, S., Guck, A., Roden-Foreman, K., Reynolds, M., Foreman, M. L., & Warren, A. M. (2015). Perceived injustice after traumatic injury: Associations with pain, psychological distress, and quality of life outcomes 12 months after injury. Rehabilitation Psychology, 60(3), 213–221. https://doi.org/10.1037/rep0000043.

    Article  PubMed  Google Scholar 

  • Trost, Z., Monden, K. R., Buelow, M., Boals, A., & Scott, W. (2016). Perceived injustice predicts intention to litigate: Findings from a spinal cord injury sample. Psychological Injry and Law, 9(1), 33–40. https://doi.org/10.1007/s12207-015-9245-z.

    Article  Google Scholar 

  • Trost, Z., Scott, W., Lange, J. M., Manganelli, L., Bernier, E., & Sullivan, M. J. (2014). An experimental investigation of the effect of a justice violation on pain experience and expression among individuals with high and low just world beliefs. European Journal of Pain, 18(3), 415–423. https://doi.org/10.1002/j.1532-2149.2013.00375.x.

    Article  PubMed  Google Scholar 

  • Turner, J. A., Jensen, M. P., & Romano, J. M. (2000). Do beliefs, co**, and catastrophizing independently predict functioning in patients with chronic pain? Pain, 85(1–2), 115–125.

    Article  Google Scholar 

  • Veehof, M. M., Oskam, M. J., Schreurs, K. M., & Bohlmeijer, E. T. (2011). Acceptance-based interventions for the treatment of chronic pain: A systematic review and meta-analysis. Pain, 152(3), 533–542. https://doi.org/10.1016/j.pain.2010.11.002.

    Article  PubMed  Google Scholar 

  • Vlaeyen, J. W., & Crombez, G. (1999). Fear of movement/(re)injury, avoidance and pain disability in chronic low back pain patients. Manual Therapy, 4(4), 187–195. https://doi.org/10.1054/math.1999.0199.

    Article  PubMed  Google Scholar 

  • Vlaeyen, J. W., & Linton, S. J. (2000). Fear-avoidance and its consequences in chronic musculoskeletal pain: A state of the art. Pain, 85(3), 317–332.

    Article  Google Scholar 

  • Vowles, K. E., McCracken, L. M., & Eccleston, C. (2007). Processes of change in treatment for chronic pain: The contributions of pain, acceptance, and catastrophizing. European Journal of Pain, 11(7), 779–787. https://doi.org/10.1016/j.ejpain.2006.12.007.

    Article  PubMed  Google Scholar 

  • Vowles, K. E., McCracken, L. M., & Eccleston, C. (2008). Patient functioning and catastrophizing in chronic pain: The mediating effects of acceptance. Health Psychology, 27(2s), S136–S143. https://doi.org/10.1037/0278-6133.27.2(Suppl.).S136.

    Article  PubMed  Google Scholar 

  • Waddell, G., Newton, M., Henderson, I., Somerville, D., & Main, C. J. (1993). A fear-avoidance beliefs questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability. Pain, 52(2), 157–168.

    Article  Google Scholar 

  • Weinman, J., Petrie, K. J., Moss-morris, R., & Horne, R. (1996). The illness perception questionnaire: A new method for assessing the cognitive representation of illness. Psychology & Health, 11(3), 431–445.

    Article  Google Scholar 

  • Wolfe, F., Clauw, D. J., Fitzcharles, M. A., Goldenberg, D. L., Katz, R. S., Mease, P., Russell, A. S., Russell, I. J., Winfield, J. B., & Yunus, M. B. (2017). The American College of Rheumatology Preliminary Diagnostic Criteria for fibromyalgia and measurement of symptom severity. Arthritis Care & Research, 62(5), 600–610. https://doi.org/10.1002/acr.20140.

    Article  Google Scholar 

  • Yakobov, E., Scott, W., Stanish, W., Dunbar, M., Richardson, G., & Sullivan, M. (2014). The role of perceived injustice in the prediction of pain and function after total knee arthroplasty. Pain, 155(10), 2040–2046. https://doi.org/10.1016/j.pain.2014.07.007.

    Article  PubMed  Google Scholar 

  • Yakobov, E., Scott, W., Tanzer, M., Stanish, W., Dunbar, M., Richardson, G., & Sullivan, M. J. L. (2014). Validation of the injustice experiences questionnaire adapted for use with patients with severe osteoarthritis of the knee. Journal of Arthritis, 3(2), 1.

    Article  Google Scholar 

  • Yamada, K., Adachi, T., Mibu, A., Nishigami, T., Motoyama, Y., Uematsu, H., . . . Iso, H. (2016). Injustice Experience Questionnaire, Japanese version: Cross-cultural factor-structure comparison and demographics associated with perceived injustice. In PLoS One 11.

Download references

Author information

Authors and Affiliations

  1. Department of Rehabilitation Sciences and Physiotherapy, Faculty of Physical Education and Physiotherapy, Vrije Universiteit, Brussels, Belgium

    R. M. Bults

  2. Transcare, Transdisciplinary Pain Management Center, Canadalaan 10B, 9728 EE, Groningen, the Netherlands

    R. M. Bults & C. P. van Wilgen

  3. Pain in Motion International Research Group, Brussels, Belgium

    R. M. Bults & C. P. van Wilgen

  4. Department of Rehabilitation Medicine, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands

    M. F. Reneman & H. R. Schiphorst Preuper

  5. Department of Physiotherapy, Human Physiology and Anatomy, Faculty of Physical Education and Physiotherapy, Vrije Universiteit Brussel, Brussels, Belgium

    C. P. van Wilgen

Authors
  1. R. M. Bults
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. F. Reneman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. C. P. van Wilgen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. H. R. Schiphorst Preuper
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. The first draft of the manuscript was written by Rinske Marije Bults and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to R. M. Bults.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Significance

The results of the current study support the validity of the Dutch version of the Injustice Experience Questionnaire and suggest that test-retest reliability is good.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bults, R.M., Reneman, M.F., van Wilgen, C.P. et al. Test-Retest Reliability and Construct Validity of the Dutch Injustice Experience Questionnaire in Patients with Chronic Pain. Psychol. Inj. and Law 13, 316–325 (2020). https://doi.org/10.1007/s12207-020-09380-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12207-020-09380-z

Keywords

Search

Navigation