Abstract
For many years, universities have aspired to develop in students so-called ‘soft skills’ or graduate qualities (GQs), such as critical thinking and teamwork, that enhance both students’ employability and citizen scholarship. GQs are often said to be ‘embedded’ in courses, but saying this does not of itself provide evidence that students have developed the qualities. Our University has recently proposed using common rubrics in all courses to measure and provide evidence of students’ achievement of GQs. However, a solution to the problem of how to implement the University’s rubric-based strategy has not been fully formulated. Many staff use assessment tasks that focus on measurement of discipline-specific content and procedures, rather than GQs, and the use of task rubrics and their design is variable. In this conceptual article, we advance a solution to the problem of how to implement the University’s rubric-based strategy in our Health Sciences context. To formulate a solution, we adopted a design thinking approach, which is focussed on people’s needs and taking iterative steps to create a design solution to meet these needs. We encountered three key design issues in our approach that led us to propose new ‘bridging’ concepts for assessing GQs: consistency in learning, rubric standardisation, and the audience for assessment tasks. These concepts link existing theory and research around course ‘constructive alignment’, rubrics, and assessment task design. Possible tests of our solution are suggested, and potential advances in course design and research are discussed. For universities planning assessment of GQs, we recommend a holistic approach, in which academics, educational and work-integrated learning professionals, students and community partners unite and are supported in the ongoing course design process.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs43545-021-00071-3/MediaObjects/43545_2021_71_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs43545-021-00071-3/MediaObjects/43545_2021_71_Fig2_HTML.png)
Similar content being viewed by others
Data availability
Data sharing is not applicable to this article as no datasets were generated or analysed during the current study.
Notes
Initially these rubrics will be trialled in undergraduate degree courses only.
References
Aitchison C, Harper R, Mirriahi N, Guerin C (2019) Tensions for educational developers in the digital university: Develo** the person, develo** the product. High Educ Res Dev. https://doi.org/10.1080/07294360.2019.1663155
Alonzo D, Mirriahi N, Davison C (2019) The standards for academics’ standards-based assessment practices. Assess Eval High Educ 44(4):636–652. https://doi.org/10.1080/02602938.2018.1521373
Anderson J, Calahan CF, Gooding H (2017) Applying design thinking to curriculum reform. Acad Med 92(4):427
Andersson P, Köpsén S (2018) Maintaining competence in the initial occupation: activities among vocational teachers. Vocations Learn 11:317–344. https://doi.org/10.1007/s12186-017-9192-9
Arvanitakis J, Judd M-M, Kinash S, de St J, Jorre T, McCluskey T (2019) Research into the diversification of university careers in learning and teaching and intentionally closing-the-loop on graduate employability. J Teach Learn Grad Employab 10(1):195–212
Assessment for learning (2020, January) Retrieved from https://www.assessmentforlearning.edu.au/professionallearning/successcriteriaandrubrics/successdesignrubrics.html
Baker J (2018, September 3) Sydney Uni’s world-first plan to mark graduates on inventiveness. The Sydney Morning Herald, Retrieved from https://www.smh.com.au/education/sydney-uni-s-world-first-plan-to-mark-graduates-on-inventiveness-20180830-p500no.html
Bennett S, Agostinho S, Lockyer L (2017) The process of designing for learning: understanding university teachers’ design work. Educ Tech Res Dev 65:125–145. https://doi.org/10.1007/s11423-016-9469-y
Biggs JB, Tang C (2011) Teaching for quality learning at university. Open University Press, Milton Keynes
Bloxham S, Boyd P (2007) Develo** effective assessment in higher education: a practical guide. Open University Press, Maidenhead
Bone EK, Ross PM (2019) Rational curriculum processes: revising learning outcomes is essential yet insufficient for a twenty-first century science curriculum. Stud High Educ. https://doi.org/10.1080/03075079.2019.1637845
Bosco AM, Ferns S (2014) Embedding of authentic assessment in work-integrated learning curriculum. Asia Pac J Cooper Educ 15(4):281–290
Bovill C, Cook-Sather A, Felten P (2011) Students as co-creators of teaching approaches, course design, and curricula: implications for academic developers. Int J Acad Dev 16(2):133–145. https://doi.org/10.1080/1360144X.2011.568690
Bowyer K (2012) A model of student workload. J High Educ Policy Manag 34(3):239–258. https://doi.org/10.1080/1360080X.2012.678729
Brown T (2008) Design thinking. Harvard Business Review 86:84
Burdett J (2003) Making groups work: university students’ perceptions. IntEduc J 4(3):177–191
Cain A, Grundy J, Woodward CJ (2018) Focusing on learning through constructive alignment with task-oriented portfolio assessment. Eur J EngEduc 43(4):569–584. https://doi.org/10.1080/03043797.2017.1299693
Chan Z, Ho S (2019) Good and bad practices in rubrics: the perspectives of students and educators. Assess Eval High Educ 44(4):533–545. https://doi.org/10.1080/02602938.2018.1522528
Collins S (2015) Elements of storytelling in medical journalism. Med Writing 24(4):222–224
Cronbach LJ (1990) Essentials of psychological testing, 5th edn. Harper Collins, New York
Feast V (2001) Student perceptions of the importance and value of a graduate quality framework in a tertiary environment. IntEduc J 2(4):144–158
Gibbs G, Simpson C (2004) Conditions under which assessment supports students’ learning. Learn Teach High Educ 1:3–31
Gillaspy E (2019) Develo** the congruent academic through an integrated coaching approach. Int J Acad Dev. https://doi.org/10.1080/1360144X.2019.1593175
Gilson LL, Goldberg CB (2015) Editors’ comment: so, what is a conceptual paper? Group Org Manag 40(2):127–130. https://doi.org/10.1177/1059601115576425
Goodyear P (2015) Teaching as design. HERDSA Rev High Educ 2:27–50
Graduate qualities (2020, January) Retrieved from https://sydney.edu.au/students/graduate-qualities.html
Guide to grades (2020, January) Retrieved from https://sydney.edu.au/students/guide-to-grades.html
Gulikers JTM, Runhaar P, Mulder M (2018) An assessment innovation as flywheel for changing teaching and learning. J Vocational Educ Train 70(2):212–231. https://doi.org/10.1080/13636820.2017.1394353
Hattie J, Timperley H (2007) The power of feedback. Rev Educ Res 77:81–112
Hendry GD (1996) Constructivism and educational practice. Aust J Educ 40(1):19–45
Hendry GD, Frommer M, Walker RA (1999) Constructivism and problem-based learning. J Furth High Educ 23(3):359–371
Hendry GD, Bromberger N, Armstrong S (2011) Constructive guidance and feedback for learning: the usefulness of exemplars, marking sheets and different types of feedback in a first year law subject. Assess Eval High Educ 36(1):1–11
Hendry GD, White P, Herbert C (2016) Providing exemplar-based ‘feedforward’ before an assessment: the role of teacher explanation. Act Learn High Educ 17(2):99–109
Hounsell D (2003) Student feedback, learning and development. In: Slowey M, Watson D (eds) Higher education and the lifecourse. SHRE & Open University Press, Buckingham, pp 67–78
Jones L, Allen B, Dunn P, Brooker L (2016) Demystifying the rubric: a five-step pedagogy to improve student understanding and utilisation of marking criteria. High Educ Res Dev 6(1):129–142. https://doi.org/10.1080/07294360.2016.1177000
Jonsson A, Svingby G (2007) The use of scoring rubrics: reliability, validity and educational consequences. Educ Res Rev 2:130–144
Jordan ME (2016) Teaching as designing: preparing pre-service teachers for adaptive teaching. Theory Practice 55(3):197–206. https://doi.org/10.1080/00405841.2016.1176812
Jorm C, Roberts C, Gordon C, Nisbet G, Roper L (2019) Time for university educators to embrace student videography. Camb J Educ. https://doi.org/10.1080/0305764X.2019.1590528
Larkin H, Richardson B (2013) Creating high challenge/high support academic environments through constructive alignment: student outcomes. Teach High Educ 18(2):192–204. https://doi.org/10.1080/13562517.2012.696541
Lee SH, Smith D, Sergueeva K (2016) What do students think about group work in business education? An investigation into the benefits, challenges, and student-suggested solutions. J Educ Business 91(7):380–386. https://doi.org/10.1080/08832323.2016.1237933
Leonard SN, Fitzgerald RN, Riordan G (2016) Using developmental evaluation as a design thinking tool for curriculum innovation in professional higher education. High Educ Res Dev 35(2):309–321. https://doi.org/10.1080/07294360.2015.1087386
Lizzio A, Wilson K (2013) First-year students’ appraisal of assessment tasks: Implications for efficacy, engagement and performance. Assess Eval High Educ 38(4):389–406. https://doi.org/10.1080/02602938.2011.637156
McInerney DM (2014) Educational psychology: constructing learning, 6th edn. Pearson Australia, Frenchs Forest
Meyers NM, Nulty DD (2009) How to use (five) curriculum design principles to align authentic learning environments, assessment, students’ approaches to thinking and learning outcomes. Assess Eval High Educ 34(5):565–577
Oliver B, de St J, Jorre T (2018) Graduate attributes for 2020 and beyond: recommendations for Australian higher education providers. High Educ Res Dev 37(4):821–836. https://doi.org/10.1080/07294360.2018.1446415
Oxford English Dictionary (2020, January) Retrieved from https://www.oed.com/view/Entry/60835?redirectedFrom=embed#eid
Page S, Trudgett M, Bodkin-Andrews G (2019) Creating a degree-focused pedagogical framework to guide Indigenous graduate attribute curriculum development. High Educ 78:1–15. https://doi.org/10.1007/s10734-018-0324-4
Panadero E, Jonsson A (2013) The use of scoring rubrics for formative assessment purposes revisited: a review. Educ Res Rev 9:129–144
Pillay JD, Ally F, Govender N (2019) Exploring opportunities for embedding graduate attributes in a first-year undergraduate anatomy course for allied health students. BMC Med Educ. https://doi.org/10.1186/s12909-019-1777-6
Reddy MY (2011) Design and development of rubrics to improve assessment outcomes: a pilot study in a Master’s level business program in India. QualAssurEduc 19(1):84–104
Sadler DR (2014) The futility of attempting to codify academic achievement standards. High Educ 67:273–288. https://doi.org/10.1007/s10734-013-9649-1
Salita JT (2015) Writing for lay audiences: a challenge for scientists. Med Writing 24(4):183–189
Sarkar M, Overton T, Thompson CD, Rayner G (2019) Academics’ perspectives of the teaching and development of generic employability skills in science curricula. High Educ Res Dev. https://doi.org/10.1080/07294360.2019.1664998
Savin-Baden M (2004) Understanding the impact of assessment on students in problem-based learning. InnovEduc Teach Int 41(2):221–233. https://doi.org/10.1080/1470329042000208729
Schneider M, Preckel F (2017) Variables associated with achievement in higher education: a systematic review of meta-analyses. Psychol Bull 143(6):565–600
Sharp J, Theiler S (2018) A review of psychological distress among university students: pervasiveness, implications and potential points of intervention. Int J Adv Counsel 40(3):193–212
StamovRoßnagel C, Fitzallen N, Lo Baido K (2020) Constructive alignment and the learning experience: relationships with student motivation and perceived learning demands. High Educ Res Dev. https://doi.org/10.1080/07294360.2020.1787956
Tognolini J, Davidson M (2013) Assessment, standards-referencing and standard setting. In: Mok M (ed) Self-directed learning oriented assessments in the Asia-Pacific. Springer, Dordrecht, pp 23–41
UniLearning, essay writing (2020) Retrieved from https://unilearning.uow.edu.au/essay/1a.html
Ward A, Mandrusiak A, Levett-Jones T (2018) Cultural empathy in physiotherapy students: a pre-test post-test study utilising virtual simulation. Physiotherapy 104(4):453–461. https://doi.org/10.1016/j.physio.2018.07.011
Wiewiora A, Kowalkiewicz A (2019) The role of authentic assessment in develo** authentic leadership identity and competencies. Assess Eval High Educ 44(3):415–430. https://doi.org/10.1080/02602938.2018.1516730
Williams JB (2006) Assertion-reason multiple-choice testing as a tool for deep learning: a qualitative analysis. Assess Eval High Educ 31(3):287–301
Willness C, Bruni-Bossio V (2017) The curriculum innovation canvas: a design thinking framework for the engaged educational entrepreneur. J High Educ Outreach Engagem 21(1):134–164
Wolf K, Stevens E (2007) The role of rubrics in advancing and assessing student learning. J Effect Teach 7(1):3–14
Acknowledgements
The authors would like to extend their appreciation to all staff and students who have participated in our graduate qualities project.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors did not receive support from any organisation for the submitted work. The authors have no conflicts of interest to declare that are relevant to the content of this article.
Rights and permissions
About this article
Cite this article
Hendry, G.D., Garlan, K., Abrate, L. et al. Implementing a university-wide strategy for assessing graduate qualities in the health sciences: three key design issues. SN Soc Sci 1, 66 (2021). https://doi.org/10.1007/s43545-021-00071-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s43545-021-00071-3