Identifying Relevant Factors of Requirements Quality: An Industrial Case Study

  • Conference paper
  • First Online:
Requirements Engineering: Foundation for Software Quality (REFSQ 2024)

Abstract

[Context and Motivation]: The quality of requirements specifications impacts subsequent, dependent software engineering activities. Requirements quality defects like ambiguous statements can result in incomplete or wrong features and even lead to budget overrun or project failure. [Problem]: Attempts at measuring the impact of requirements quality have been held back by the vast amount of interacting factors. Requirements quality research lacks an understanding of which factors are relevant in practice. [Principal Ideas and Results]: We conduct a case study considering data from both interview transcripts and issue reports to identify relevant factors of requirements quality. The results include 17 factors and 11 interaction effects relevant to the case company. [Contribution]: The results contribute empirical evidence that (1) strengthens existing requirements engineering theories and (2) advances industry-relevant requirements quality research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 56.49
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 70.61
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Available at https://zenodo.org/doi/10.5281/zenodo.10149474.

  2. 2.

    In the remainder of the paper, a requirements quality factor is referred to as a quality factor as the scope of this article remains focused on requirements specifications.

  3. 3.

    https://www.descript.com/.

  4. 4.

    Available at https://github.com/JulianFrattini/rqi-relf/blob/main/src/analytics/results.md.

References

  1. Bennett, E.M., Alpert, R., Goldstein, A.: Communications through limited-response questioning. Public Opin. Q. 18(3), 303–308 (1954)

    Article  Google Scholar 

  2. Board, I., Committee, I., et al.: IEEE recommended practice for software requirements specifications. In: Institute of Electrical and Electronics Engineers (1998)

    Google Scholar 

  3. Boehm, B.W., Papaccio, P.N.: Understanding and controlling software costs. IEEE Trans. Software Eng. 14(10), 1462–1477 (1988)

    Article  Google Scholar 

  4. Briand, L., Bianculli, D., Nejati, S., Pastore, F., Sabetzadeh, M.: The case for context-driven software engineering research: generalizability is overrated. IEEE Softw. 34(5), 72–75 (2017)

    Article  Google Scholar 

  5. de Bruijn, F., Dekkers, H.L.: Ambiguity in natural language software requirements: a case study. In: Wieringa, R., Persson, A. (eds.) REFSQ 2010. LNCS, vol. 6182, pp. 233–247. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14192-8_21

    Chapter  Google Scholar 

  6. Cruzes, D.S., Dyba, T.: Recommended steps for thematic synthesis in software engineering. In: 2011 International Symposium on Empirical Software Engineering and Measurement. pp. 275–284. IEEE (2011)

    Google Scholar 

  7. Femmer, H.: Requirements quality defect detection with the Qualicen requirements scout. In: REFSQ Workshops (2018)

    Google Scholar 

  8. Femmer, H., Fernández, D.M., Wagner, S., Eder, S.: Rapid quality assurance with requirements smells. J. Syst. Softw. 123, 190–213 (2017)

    Article  Google Scholar 

  9. Femmer, H., Mund, J., Fernández, D.M.: It’s the activities, stupid! A new perspective on re quality. In: 2015 IEEE/ACM 2nd International Workshop on Requirements Engineering and Testing, pp. 13–19. IEEE (2015)

    Google Scholar 

  10. Feng, G.C.: Mistakes and how to avoid mistakes in using intercoder reliability indices. Methodol. Eur. J. Res. Methods Behav. Soc. Sci. 11(1), 13 (2015)

    Google Scholar 

  11. Fernandez, D.M., Wagner, S., Lochmann, K., Baumann, A., de Carne, H.: Field study on requirements engineering: investigation of artefacts, project parameters, and execution strategies. Inf. Softw. Technol. 54(2), 162–178 (2012)

    Article  Google Scholar 

  12. Franch, X., et al.: How do practitioners perceive the relevance of requirements engineering research? IEEE Trans. Softw. Eng. (2020)

    Google Scholar 

  13. Franch, X., Palomares, C., Quer, C., Chatzipetrou, P., Gorschek, T.: The state-of-practice in requirements specification: an extended interview study at 12 companies. Requirements Eng., 1–33 (2023)

    Google Scholar 

  14. Frattini, J., Fucci, D., Torkar, R., Mendez, D.: A second look at the impact of passive voice requirements on domain modeling: Bayesian reanalysis of an experiment. In: 1st International Workshop on Methodological Issues with Empirical Studies in Software Engineering (WSESE2024). ACM (2024)

    Google Scholar 

  15. Frattini, J., Montgomery, L., Fischbach, J., Mendez, D., Fucci, D., Unterkalmsteiner, M.: Requirements quality research: a harmonized theory, evaluation, and roadmap. Requirements Eng. (2023)

    Google Scholar 

  16. Frattini, J., Montgomery, L., Fischbach, J., Unterkalmsteiner, M., Mendez, D., Fucci, D.: A live extensible ontology of quality factors for textual requirements. In: 2022 IEEE 30th International Requirements Engineering Conference (RE), pp. 274–280. IEEE (2022)

    Google Scholar 

  17. Host, M., Runeson, P.: Checklists for software engineering case study research. In: First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007), pp. 479–481. IEEE (2007)

    Google Scholar 

  18. Méndez, D., et al.: Naming the pain in requirements engineering: contemporary problems, causes, and effects in practice. Empir. Softw. Eng. 22, 2298–2338 (2017)

    Article  Google Scholar 

  19. Miles, M.B., Huberman, A.M.: Qualitative Data Analysis: An Expanded Sourcebook. Sage (1994)

    Google Scholar 

  20. Montgomery, L., Fucci, D., Bouraffa, A., Scholz, L., Maalej, W.: Empirical research on requirements quality: a systematic map** study. Requirements Eng. 27(2), 183–209 (2022)

    Article  Google Scholar 

  21. Petersen, K., Wohlin, C.: Context in industrial software engineering research. In: 2009 3rd International Symposium on Empirical Software Engineering and Measurement, pp. 401–404. IEEE (2009)

    Google Scholar 

  22. Philippo, E.J., Heijstek, W., Kruiswijk, B., Chaudron, M.R.V., Berry, D.M.: Requirement ambiguity not as important as expected—results of an empirical evaluation. In: Doerr, J., Opdahl, A.L. (eds.) REFSQ 2013. LNCS, vol. 7830, pp. 65–79. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-37422-7_5

    Chapter  Google Scholar 

  23. Rosadini, B., et al.: Using NLP to detect requirements defects: an industrial experience in the railway domain. In: Grünbacher, P., Perini, A. (eds.) REFSQ 2017. LNCS, vol. 10153, pp. 344–360. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54045-0_24

    Chapter  Google Scholar 

  24. Runeson, P., Host, M., Rainer, A., Regnell, B.: Case Study Research in Software Engineering: Guidelines and Examples. Wiley (2012)

    Google Scholar 

  25. Sjøberg, D.I., Dybå, T., Anda, B.C., Hannay, J.E.: Building theories in software engineering. In: Shull, F., Singer, J., Sjøberg, D.I.K. (eds.) Guide to Advanced Empirical Software Engineering, pp. 312–336. Springer, London (2008). https://doi.org/10.1007/978-1-84800-044-5_12

  26. Strauss, A., Corbin, J.: Basics of Qualitative Research. Sage Publications (1990)

    Google Scholar 

  27. Wagner, S., et al.: Status quo in requirements engineering: a theory and a global family of surveys. ACM Trans. Softw. Eng. Methodol. (TOSEM) 28(2), 1–48 (2019)

    Article  Google Scholar 

  28. Wohlin, C.: Case study research in software engineering-it is a case, and it is a study, but is it a case study? Inf. Softw. Technol. 133, 106514 (2021)

    Article  Google Scholar 

  29. Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-29044-2

Download references

Acknowledgements

This work was supported by the KKS foundation through the S.E.R.T. Research Profile project at Blekinge Institute of Technology. I thank Michael Unterkalmsteiner for independently performing the coding task. Furthermore, I owe great thanks to Parisa Yousefi, Charlotte Ljungman, and Fabiano Sato from Ericsson for their continuous support that made this work possible in the first place.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Julian Frattini .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Frattini, J. (2024). Identifying Relevant Factors of Requirements Quality: An Industrial Case Study. In: Mendez, D., Moreira, A. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2024. Lecture Notes in Computer Science, vol 14588. Springer, Cham. https://doi.org/10.1007/978-3-031-57327-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-57327-9_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-57326-2

  • Online ISBN: 978-3-031-57327-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation