Abstract
It is important to cultivate dispositions of 21st-century skills (D21S: critical thinking, complex problem solving, creativity, communication, and collaboration) in project-based science, technology, engineering, and mathematics learning (STEM-PjBL). Previous research has seldom adopted the person-oriented approach to examine STEM-PjBL program effectiveness, and knowledge regarding group differences is still lacking. To fill this gap, a person-oriented analysis was used to form grou**s of students based on D21S. Three latent profiles (high-, medium-, and low-D21S) of students were identified in 6 elementary schools, and the transition probabilities were estimated for 2 class types (treatment vs. comparison) across 1 semester. Most of the students (63.4%) showed stable D21S profiles over 1 semester; however, some students (17.6%) exhibited improvement, and some (18.9%) showed declination. Additionally, the STEM-PjBL programs presented positive effects on the growth of D21S. This study further found that the D21S transitional types (i.e. declined, stable, and improved) could predict students’ motivation (perceived STEM domain content mastery, self-efficacy, and task value), showing that a declined D21S also decreased academic motivation. The findings suggest that students who decline in D21S should receive attention from teachers because their perceived academic performance, competence beliefs, and values in STEM also decrease simultaneously.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs10763-022-10288-0/MediaObjects/10763_2022_10288_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs10763-022-10288-0/MediaObjects/10763_2022_10288_Fig2_HTML.png)
Similar content being viewed by others
References
Aizikovitsh-Udi, E., & Cheng, D. (2015). Develo** critical thinking skills from dispositions to abilities: Mathematics education from early childhood to high school. Creative Education, 6(4), 455–462. https://doi.org/10.4236/ce.2015.64045
Arens, A. K., Schmidt, I., & Preckel, F. (2019). Longitudinal relations among self-concept, intrinsic value, and attainment value across secondary school years in three academic domains. Journal of Educational Psychology, 111(4), 663–684. https://doi.org/10.1037/edu0000313
Bandura, A. (1977). Social learning theory. Prentice Hall.
Bartholomew, K. J., Ntoumanis, N., Ryan, R. M., & Thøgersen-Ntoumani, C. (2011). Psychological need thwarting in the sport context: Assessing the darker side of athletic experience. Journal of Sport and Exercise Psychology, 33(1), 75–102. https://doi.org/10.1123/jsep.33.1.75
Beier, M. E., Kim, M. H., Saterbak, A., Leautaud, V., Bishnoi, S., & Gilberto, J. M. (2019). The effect of authentic project-based learning on attitudes and career aspirations in STEM. Journal of Research in Science Teaching, 56(1), 3–23. https://doi.org/10.1002/tea.21465
Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012). Defining twenty-first century skills. In P. Griffin, B. McGaw, & E. Care (Eds.), Assessment and teaching of 21st century skills (pp. 17–66). Springer. https://doi.org/10.1007/978-94-007-2324-5_2
Birgili, B. (2015). Creative and critical thinking skills in problem-based learning environments. Journal of Gifted Education and Creativity, 2(2), 71–80.
Borda, E. J. (2007). Applying Gadamer’s concept of disposition to science and science education. Science & Education, 16(9–10), 1027–1041. https://doi.org/10.1007/s11191-007-9079-5
Bransford, J. D., & Stein, B. S. (1993). The ideal problem solver: A guide for improving thinking, learning, and creativity (2nd ed.). Freeman.
Britner, S. L., & Pajares, F. (2006). Sources of science self-efficacy beliefs of middle school students. Journal of Research in Science Teaching, 43(5), 485–499. https://doi.org/10.1002/tea.20131
Cansoy, R., & Türkoglu, M. E. (2017). Examining the relationship between pre-service teachers’ critical thinking disposition, problem solving skills and teacher self-efficacy. International Education Studies, 10(6), 23–35. https://doi.org/10.5539/ies.v10n6p23
Capraro, M. M., & Morgan, J. R. (2013). Interdisciplinary STEM project-based learning. In R. M. Capraro, M. M. Capraro, & J. R. Morgan (Eds). STEM project-pased learning (pp. 51–58). Sense. https://doi.org/10.1007/978-94-6209-143-6_6
Chai, C. S., Deng, F., Tsai, P. S., Koh, J. H. L., & Tsai, C. C. (2015). Assessing multidimensional students’ perceptions of twenty-first-century learning practices. Asia Pacific Education Review, 16(3), 389–398. https://doi.org/10.1007/s12564-015-9379-4
Clark, S., & Muthén, B. (2009). Relating latent class analysis results to variables not included in the analysis. Retrieved September 05, 2021 from https://www.statmodel.com/download/relatinglca.pdf
Cojocaru, D., Friesel, A., & Spikol, D. (2016). Supporting STEM knowledge and skills in engineering education: PELARS project. Paper presented at the 2016 ASEE 123rd Annual Conference & Exposition – Making Value for Society, New Orleans, LA, USA.
Dare, E. A., Ellis, J. A., & Roehrig, G. H. (2018). Understanding science teachers’ implementations of integrated STEM curricular units through a phenomenological multiple case study. International Journal of STEM Education, 5(1), 1–19. https://doi.org/10.1186/s40594-018-0101-z
Dilley, A., Kaufman, J. C., Kennedy, C., & Plucker, J. A. (2015). What we know about critical thinking. Partnership for 21st Century Learning.
Eccles, J. S., & Wigfield, A. (2002). Motivational beliefs, values, and goals. Annual Review of Psychology, 53, 109–132. https://doi.org/10.1146/annurev.psych.53.100901.135153
Eccles, J. S., Wigfield, A., & Schiefele, U. (1998). Motivation to succeed. In W. Damon & N. Eisenberg (Eds.), Handbook of child psychology: Social, emotional, and personality development (pp. 1017–1095). John Wiley & Sons.
El Sayary, A. M. A., Forawi, S. A., & Mansour, N. (2015). STEM education and problem-based learning. In R. Wegerif, L. Li, & J. C. Kaufman (Eds.), The Routledge international handbook of research on teaching thinking (pp. 357–369). Routledge.
Espey, M. (2018). Enhancing critical thinking using team-based learning. Higher Education Research & Development, 37(1), 15–29. https://doi.org/10.1080/07294360.2017.1344196
Friesel, A., Cojocaru, D., & Avramides, K. (2015, June 2–4). Identifying how PELARS-project can support the development of new curriculum structures in engineering education. Paper presented at the 2015 3rd Experiment International Conference (exp.at'15), Ponta Delgada, Portugal.
Halpern, D. F. (1999). Teaching for critical thinking: Hel** college students develop the skills and dispositions of a critical thinker. New Directions for Teaching and Learning, 1999(80), 69–74. https://doi.org/10.1002/tl.8005
Hulleman, C. S., Barron, K. E., Kosovich, J. J., & Lazowski, R. A. (2016). Student motivation: Current theories, constructs, and interventions within an expectancy-value framework. In A. A. Lipnevich, F. Preckel, & R. D. Roberts (Eds.), Psychosocial skills and school systems in the 21st century: Theory, research, and practice (pp. 241–278). Springer. https://doi.org/10.1007/978-3-319-28606-8_10
Hulleman, C. S., Durik, A. M., Schweigert, S. A., & Harackiewicz, J. M. (2008). Task values, achievement goals, and interest: An integrative analysis. Journal of Educational Psychology, 100(2), 398–416. https://doi.org/10.1037/0022-0663.100.2.398
Hwang, G. J., Lai, C. L., Liang, J. C., Chu, H. C., & Tsai, C. C. (2018). A long-term experiment to investigate the relationships between high school students’ perceptions of mobile learning and peer interaction and higher-order thinking tendencies. Educational Technology Research and Development, 66(1), 75–93. https://doi.org/10.1007/s11423-017-9540-3
Jacobs, J. E., Lanza, S., Osgood, D. W., Eccles, J. S., & Wigfield, A. (2002). Changes in children’s self-competence and values: Gender and domain differences across grades one through twelve. Child Development, 73(2), 509–527. https://doi.org/10.1111/1467-8624.00421
Jansen, M., Scherer, R., & Schroeders, U. (2015). Students’ self-concept and self-efficacy in the sciences: Differential relations to antecedents and educational outcomes. Contemporary Educational Psychology, 41, 13–24. https://doi.org/10.1016/j.cedpsych.2014.11.002
Jiang, D., Santos, R., Mayer, T., & Boyd, L. (2016). Latent transition analysis for program evaluation with multivariate longitudinal outcomes. In L. A. van der Ark, D. M. Bolt, W.-C. Wang, J. A. Douglas, & M. Wiberg (Eds.), Quantitative psychology research (pp. 377–388). Springer. https://doi.org/10.1007/978-3-319-38759-8_28
Juhji, J., & Nuangchalerm, P. (2020). Interaction between science process skills and scientific attitudes of students towards technological pedagogical content knowledge. Journal for the Education of Gifted Young Scientists, 8(1), 1–16. https://doi.org/10.17478/jegys.600979
Kalelioğlu, F., & Gülbahar, Y. (2014). The effect of instructional techniques on critical thinking and critical thinking dispositions in online discussion. Journal of Educational Technology & Society, 17(1), 248–258.
Krathwohl, D. R. (2002). A revision of Bloom’s taxonomy: An overview. Theory into Practice, 41(4), 212–218. https://doi.org/10.1207/s15430421tip4104_2
Lanza, S. T., Patrick, M. E., & Maggs, J. L. (2010). Latent transition analysis: Benefits of a latent variable approach to modeling transitions in substance use. Journal of Drug Issues, 40(1), 93–120. https://doi.org/10.1177/002204261004000106
Lin, Q., Yin, Y., Tang, X., Hadad, R., & Zhai, X. (2020). Assessing learning in technology-rich maker activities: A systematic review of empirical research. Computers & Education, 157, 103944. https://doi.org/10.1016/j.compedu.2020.103944
Lo, Y., Mendell, N., & Rubin, D. (2001). Testing the number of components in a normal mixture. Biometrika, 88(3), 767–778. https://doi.org/10.1093/biomet/88.3.767
Magidson, J., & Vermunt, J. K. (2004). Latent class models. In D. Kaplan (Ed.), The Sage handbook of quantitative methodology for the social sciences (pp. 175–198). Sage.
Makarova, E., Aeschlimann, B., & Herzog, W. (2019). The gender gap in STEM fields: The impact of the gender stereotype of math and science on secondary students' career aspirations. Frontiers in Education, 4, 60. https://doi.org/10.3389/feduc.2019.00060
Martín‐Páez, T., Aguilera, D., Perales‐Palacios, F. J., & Vílchez‐González, J. M. (2019). What are we talking about when we talk about STEM education? A review of literature. Science Education, 103(4), 799–822. https://doi.org/10.1002/sce.21522
Megayanti, T., Busono, T., & Maknun, J. (2020). Project-based learning efficacy in vocational education: Literature review. The Institute of Physics (IOP) Conference Series: Materials Science and Engineering, 830(4), 042075. https://doi.org/10.1088/1757-899X/830/4/042075
Molinsky, A., Davenport, T. H., Iyer, B., & Davidson, C. (2012). Three skills every 21st-century manager needs. Harvard Business Review, 90(1–2), 139–143.
Muthén, B., & Muthén, L. (2019). Mplus 8.4 [Computer software]. Muthén & Muthén.
Nylund, K. L., Muthén, B., Nishina, A., Bellmore, A., & Graham, S. (2006). Stability and instability of peer victimization during middle school: Using latent transition analysis with covariates, distal outcomes, and modeling extensions [Unpublished manuscript].
Organisation for Economic Cooperation and Development [OECD]. (2019a). Learning Compass 2030 in brief. Retrieved February 5, 2022 from https://www.oecd.org/education/2030-project/teaching-and-learning/learning/learning-compass-2030/
Organisation for Economic Cooperation and Development [OECD]. (2019b). Future of education and skills 2030: Attitudes and values for 2030. Retrieved January 5, 2021 from https://www.oecd.org/education/2030-project/teaching-and-learning/learning/attitudes-and-values/
Oie, M., & Fujii, T. (2017). Development of mathematics motivation across the transition from elementary to junior high school in Japan. Psychology, 8(2), 287–301. https://doi.org/10.4236/psych.2017.82017
Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of Educational Research, 66(4), 543–578. https://doi.org/10.3102/00346543066004543
Ritchhart, R. (2001). From IQ to IC: A dispositional view of intelligence. Roeper Review, 23(3), 143–150. https://doi.org/10.1080/02783190109554086
Robinson, K. A., Lee, Y.-K., Bovee, E. A., Perez, T., Walton, S. P., Briedis, D., & Linnenbrink-Garcia, L. (2019). Motivation in transition: Development and roles of expectancy, task values, and costs in early college engineering. Journal of Educational Psychology, 111(6), 1081–1102. https://doi.org/10.1037/edu0000331
Ryan, R. M., & Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development and wellness. Guilford Press.
Sahin, A. (2013). STEM project-based learning: Specialized form of inquiry-based learning. In R. M. Capraro, M. M. Capraro, & J. R. Morgan (Eds.), STEM project-pased learning (pp. 59–64). Sense. https://doi.org/10.1007/978-94-6209-143-6_7
Schussler, D. L. (2006). Defining dispositions: Wading through murky waters. The Teacher Educator, 41(4), 251–268. https://doi.org/10.1080/08878730609555387
Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461–464. https://doi.org/10.1214/aos/1176344136
Sclove, S. L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52(3), 333–343. https://doi.org/10.1007/BF02294360
Srisawad, K., Ratana-Olarn, T., & Kiddee, K. (2017). The development of structural equation model of critical thinking among nursing students. Walailak Journal of Science and Technology, 14(1), 65–73.
Talsma, K., Schüz, B., Schwarzer, R., & Norris, K. (2018). I believe, therefore I achieve (and vice versa): A meta-analytic cross-lagged panel analysis of self-efficacy and academic performance. Learning and Individual Differences, 61, 136–150. https://doi.org/10.1016/j.lindif.2017.11.015
Taura, A. A., Abdullah, M. C., Roslan, S., & Omar, Z. (2015). Relationship between self-efficacy, task value, self-regulation strategies and active procrastination among pre-service teachers in colleges of education. International Journal of Psychology and Counselling, 7(2), 11–17. https://doi.org/10.5897/IJPC2014.0297
Thompson, A. M., Macy, R. J., & Fraser, M. W. (2011). Assessing person-centered outcomes in practice research: A latent transition profile framework. Journal of Community Psychology, 39(8), 987–1002. https://doi.org/10.1002/jcop.20485
Usher, E. L., & Pajares, F. (2009). Sources of self-efficacy in mathematics: A validation study. Contemporary Educational Psychology, 34(1), 89–101. https://doi.org/10.1016/j.cedpsych.2008.09.002
Valtonen, T., Hoang, N., Sointu, E., Näykki, P., Virtanen, A., Pöysä-Tarhonen, J., Häkkinen, P., Järvelä, S., Mäkitalo, K., & Kukkonen, J. (2021). How pre-service teachers perceive their 21st-century skills and dispositions: A longitudinal perspective. Computers in Human Behavior, 116, 106643. https://doi.org/10.1016/j.chb.2020.106643
van Laar, E., van Deursen, A. J.A.M., van Dijk, J. A.G.M., & de Haan, J. (2017). The relation between 21st-century skills and digital skills: A systematic literature review. Computers in Human Behavior, 72, 577–588. https://doi.org/10.1016/j.chb.2017.03.010
Varandi, S. B., & Mehrali, S. (2013). Investigating the effect of levels of proficiency on Iranian male and female EFL learners’ critical thinking and self-efficacy. Theory and Practice in Language Studies, 3(12), 2355–2361.
Wang, H. Y., Huang, I., & Hwang, G. J. (2016). Effects of a question prompt-based concept map** approach on students’ learning achievements, attitudes and 5C competences in project-based computer course activities. Journal of Educational Technology & Society, 19(3), 351–364.
Wigfield, A., & Eccles, J. S. (2002). The development of competence beliefs, expectancies for success, and achievement values from childhood through adolescence. In A. Wigfield & J. S. Eccles (Eds.), Development of achievement motivation (pp. 91–120). Academic Press. https://doi.org/10.1016/B978-012750053-9/50006-1
Wu, F., Fan, W., Arbona, C., & de la Rosa-Pohl, D. (2020). Self-efficacy and subjective task values in relation to choice, effort, persistence, and continuation in engineering: An expectancy-value theory perspective. European Journal of Engineering Education, 45(1), 151–163. https://doi.org/10.1080/03043797.2019.1659231
Yang, Y. T. C. (2012). Cultivating critical thinkers: Exploring transfer of learning from pre-service teacher training to classroom practice. Teaching and Teacher Education, 28(8), 1116–1130. https://doi.org/10.1016/j.tate.2012.06.007
Yang, Y. T. C., & Chou, H. A. (2008). Beyond critical thinking skills: Investigating the relationship between critical thinking skills and dispositions through different online instructional strategies. British Journal of Educational Technology, 39(4), 666–684. https://doi.org/10.1111/j.1467-8535.2007.00767.x
Yang, Y. T. C., Lin, C. P., Lin, C. S., & Chiu, C. H. (2019). Advanced Interdisciplinary (STEAM) Project (Final Report). Taipei, Taiwan: Ministry of Education.
Yang, Y. T. C., Lin, C. P., Lin, C. S., & Lin, S. S. J. (2020). Advanced Interdisciplinary (STEAM) Project (Final Report). Taipei, Taiwan: Ministry of Education.
Funding
This work was supported by a 4-year grant from the Ministry of Education, Taiwan ROC, through the project entitled “The Advanced Interdisciplinary Project for K-12 Schools.”
Author information
Authors and Affiliations
Corresponding author
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Chen, SK., Yang, YT.C., Lin, C. et al. Dispositions of 21st-Century Skills in STEM Programs and Their Changes over Time. Int J of Sci and Math Educ 21, 1363–1380 (2023). https://doi.org/10.1007/s10763-022-10288-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10763-022-10288-0