SpringerLink
Log in

Usability assessment of scholarly publishers’ online journal interfaces

  • Original Article
  • Published:
Journal of Data, Information and Management Aims and scope Submit manuscript

Abstract

A well-designed and user-friendly online journal interface not only enhances researchers’ satisfaction but also bolsters the reputation of academic publishers within the scholarly community. Consequently, the present study undertakes an examination of the usability aspects pertaining to online journal interfaces offered by five prominent academic publishers: Wiley, Sage, Elsevier, Springer, and Taylor & Francis. This investigation encompasses a combination of user testing and post-questionnaire methodologies, aiming to accrue both quantitative and qualitative data concerning user task execution and satisfaction. The research findings spotlight the varying degrees of usability across major academic publishers and emphasize the critical role of design in enhancing researchers’ experiences. By identifying both usability strengths and weaknesses, along with offering actionable areas for improvement, this study adds a valuable perspective to the enhancement of academic journal interfaces.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  • Abras C, Maloney-Krichmar D, Preece J (2004) User-centered design. Bainbridge, W Encycl Human-Computer Interact. Thousand Oaks Sage Publ 37:445–456

    Google Scholar 

  • Alasem AN (2013) Evaluating the usability of Saudi Digital Library’s Interface (SDL). In: Lecture Notes in Engineering and Computer Science, pp 178–181

  • Barnum CM, Dragga S (2001) Usability testing and research. Allyn and Bacon Inc

  • Bhosale U (2021) STM Report: global research trends and transformation in Open Access Publishing. In: Enago Acad

  • Bond RR, Finlay DD, Nugent CD et al (2014) A usability evaluation of medical software at an expert conference setting. Comput Methods Programs Biomed 113:383–395. https://doi.org/10.1016/j.cmpb.2013.10.006

    Article  Google Scholar 

  • Bornmann L, Haunschild R, Mutz R (2021) Growth rates of modern science: a latent piecewise growth curve approach to model publication numbers from established and new literature databases. Humanit Soc Sci Commun 8(1):1–15. https://doi.org/10.1057/s41599-021-00903-w

    Article  Google Scholar 

  • Dumas J, Redish J (1999) A practical guide to usability testing. Intellect Books

  • Forgues B, Liarte S (2013) Academic publishing: past and future. Manag 16:739–756. https://doi.org/10.3917/mana.165.0739

    Article  Google Scholar 

  • Hariri N, Norouzi Y (2011) Determining evaluation criteria for digital libraries’ user interface: a review. Electron Libr 29:698–722. https://doi.org/10.1108/02640471111177116/FULL/HTML

    Article  Google Scholar 

  • Hasan L, Morris A, Probets S (2012) A comparison of usability evaluation methods for evaluating e-commerce websites. Behav Inf Technol 31:707–737. https://doi.org/10.1080/0144929X.2011.596996

    Article  Google Scholar 

  • Hass C (2019) A practical guide to usability testing. In: Consumer Informatics and Digital Health. Springer Nature, Cham pp 107–124

  • Holzinger A (2005) Usability engineering methods for software developers. Commun ACM 48:71–74

    Article  Google Scholar 

  • Huang Z (2020) Usability of tourism websites: a case study of heuristic evaluation. New Rev Hypermedia Multimed 26:55–91. https://doi.org/10.1080/13614568.2020.1771436

    Article  Google Scholar 

  • Hurd JM, Blecic DD, Robinson AE (2014) Performance measures for electronic journals: a user-centered approach. Electronic resources and services in Sci-Tech libraries. Routledge, pp 57–71

  • ISO/TC 159/SC 4 (1998) Ergonomics of human-system interaction

  • Jeng J (2005) Usability assessment of academic digital libraries: effectiveness, efficiency, satisfaction, and learnability. Libri 55:96–121. https://doi.org/10.1515/LIBR.2005.96/HTML

    Article  Google Scholar 

  • Joo S, Lin S, Lu K (2011) A usability evaluation model for academic Library websites: Efficiency, Effectiveness and Learnability. J Libr Inf Stud 2:11–26

    Google Scholar 

  • Kani-Zabihi E, Ghinea G, Chen SY (2006) Digital libraries: what do users want? Online Inf Rev 30:395–412. https://doi.org/10.1108/14684520610686292/FULL/HTML

    Article  Google Scholar 

  • Kengeri R, Seals CD, Harley HD et al (1998) Usability study of digital libraries: ACM, IEEE-CS, NCSTRL, NDLTD. Int J Digit Libr 2:157–169. https://doi.org/10.1007/s007990050044

    Article  Google Scholar 

  • Kling R, Callahan E (2003) Electronic journals, the internet, and scholarly communication. Annu Rev Inf Sci Technol 37:127–177. https://doi.org/10.1002/aris.1440370105

    Article  Google Scholar 

  • Lamb C (2004) Open access publishing models: opportunity or threat to scholarly and academic publishers? Learn Publ 17:143–150

    Article  Google Scholar 

  • Larivière V, Haustein S, Mongeon P (2015) The oligopoly of academic publishers in the digital era. PLoS ONE 10:e0127502. https://doi.org/10.1371/journal.pone.0127502

    Article  Google Scholar 

  • Lewis C (1982) Using the thinking aloud method in cognitive interface design. IBM Research Report RC 9265. IBM Thomas J. Watson Research Center, P.O. Box 218, Yorktown Heights, New York

  • Macakoğlu ŞS, Peker S, Medeni İT (2023) Accessibility, usability, and security evaluation of universities’ prospective student web pages: a comparative study of Europe, North America, and Oceania. Univers Access Inf Soc 22:671–683. https://doi.org/10.1007/s10209-022-00869-9

    Article  Google Scholar 

  • Menekse Dalveren GG, Peker S (2021) Accessibility and usability evaluation of digital library article pages. In: App and Website Accessib. ility Developments and Compliance Strategies. IGI Global, 2022. pp 58–76. https://doi.org/10.4018/978-1-7998-7848-3.ch003

  • Nielsen J (1993) Usability Engineering. Morgan Kaufmann

  • Nielsen J (2006) Quantitative studies: how many users to test? In: Nielsen Norman Gr. Available at: https://www.nngroup.com/articles/quantitative-studies-how-many-users/

  • Noh Y (2010) A study on develo** evaluation criteria for electronic resources in evaluation indicators of libraries. J Acad Librariansh 36:41–52. https://doi.org/10.1016/j.acalib.2009.11.005

    Article  Google Scholar 

  • Okhovati M, Karami F, Khajouei R (2017) Exploring the usability of the central library websites of medical sciences universities. J Librariansh Inf Sci 49:246–255. https://doi.org/10.1177/0961000616650932

    Article  Google Scholar 

  • Rubin J, Chisnell D (2008) Handbook of usability testing: how to plan, design and conduct effective tests. John Wiley and Sons

  • Van Den Haak MJ, De Jong MDT, Schellens PJ (2003) Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behav Inf Technol 22:339–351. https://doi.org/10.1080/0044929031000

    Article  Google Scholar 

  • Verkijika SF, De Wet L (2018) A usability assessment of e-government websites in Sub-saharan Africa. Int J Inf Manage 39:20–29. https://doi.org/10.1016/j.i**fomgt.2017.11.003

    Article  Google Scholar 

  • Walia PK, Gupta M (2013) Usability analysis of homepage of websites of national libraries in Asia. Libr Philos Pract 2013:1–21

    Google Scholar 

  • Ware M, Mabe M, Consulting MW (2015) The STM Report: An overview of scientific and scholarly journal publishing

  • Zhang X, Liu J, Li Y, Zhang Y (2009) How usable are operational digital libraries: a usability evaluation of system interactions. In: EICS’09 - Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems. pp 177–186

Download references

Acknowledgements

The authors would like to thank to Dr. Yavuz İnal for his valuable support and contribution throughout the research.

Author information

Authors and Affiliations

  1. Department of Management Information Systems, Izmir Bakirçay University, İzmir, 35665, Turkey

    Serhat Peker

  2. Department of Software Engineering, Atilim University, Ankara, 06830, Turkey

    Gonca Gokce Menekse Dalveren

Authors
  1. Serhat Peker
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gonca Gokce Menekse Dalveren
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Serhat Peker.

Ethics declarations

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Peker, S., Dalveren, G.G.M. Usability assessment of scholarly publishers’ online journal interfaces. J. of Data, Inf. and Manag. 5, 363–374 (2023). https://doi.org/10.1007/s42488-023-00110-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42488-023-00110-z

Keywords

Search

Navigation