Abstract
Collaborative Problem Solving (CPS) is a socio-cognitive process that is interactive, interdependent, and temporal. As individuals interact with each other, information is added to the common ground, or the current state of a group’s shared understanding, which in turn influences individuals’ subsequent responses to the common ground. Therefore, to model CPS processes, especially in a context where the order of events is hypothesized to be meaningful, it is important to account for the ordered aspect. In this study, we present Ordered Network Analysis (ONA), a method that can not only model the ordered aspect of CPS, but also supports visual and statistical comparison of ONA networks. To demonstrate the analytical affordances and interpretable visualizations of ONA, we analyzed the collaborative discourse data of air defense warfare teams. We found that ONA was able to capture the qualitative differences between the control and experimental condition that cannot be captured using unordered models, and also tested that such differences were statistically different.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
MR is a dimensional reduction that can be applied when the units are divided into two discrete groups. The resulting space highlights the differences between groups (if any) by constructing a dimensional reduction that places the means of the groups as close as possible to the x-axis of the space. MR is frequently used in ENA analyses [1].
- 2.
Because each unit is represented by a single, high-dimensional adjacency vector, ONA can use any dimensional reduction technique that can be used with ENA.
- 3.
The mathematical proof that including vectors and their transpose cause degenerate solutions under SVD and other rotations is beyond the scope of this paper; however, we are happy to provide it upon request.
- 4.
The mathematical details of co-registration are beyond the scope of this paper and can be found in the work of Bowman et al. [1].
- 5.
hENA, or Hierarchical Epistemic Network Analysis, is an extension to ENA that enables researchers to model nested effects of multiple grou** variables rather than one grou** variable using means rotation. Detailed description of hENA can be found in [13].
References
Bowman, D., et al.: The mathematical foundations of epistemic network analysis. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 91–105. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_7
C. Graesser, A., Foltz, P.W., Rosen, Y., Shaffer, D.W., Forsyth, C., Germany, M.-L.: Challenges of assessing collaborative problem solving. In: Care, E., Griffin, P., Wilson, M. (eds.) Assessment and Teaching of 21st Century Skills. EAIA, pp. 75–91. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-65368-6_5
Clark, H.H.: Using Language. Cambridge University Press, Cambridge (1996)
Csanadi, A., Eagan, B., Kollar, I., Shaffer, D.W., Fischer, F.: When coding-and-counting is not enough: using epistemic network analysis (ENA) to analyze verbal data in CSCL research. Int. J. Comput.-Support. Collab. Learn. 13(4), 419–438 (2018). https://doi.org/10.1007/s11412-018-9292-z
Fogel, A., et al.: Directed epistemic network analysis. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 122–136. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_9
Graesser, A.C., et al.: Advancing the science of collaborative problem solving. Psychol. Sci. Public Interest 19(2), 59–92 (2018)
Marquart, C.L., et al.: ncodeR: Techniques for Automated Classifiers (2018)
Miyake, N., Kirschner, P.A.: The social and interactive dimensions of collaborative learning. In: Sawyer, R.K. (ed.) The Cambridge Handbook of the Learning Sciences, pp. 418–438. Cambridge University Press, Cambridge (2014)
Roschelle, J., Teasley, S.D.: The construction of shared knowledge in collaborative problem solving. In: O’Malley, C. (ed.) Computer Supported Collaborative Learning, pp. 69–97. Springer, Heidelberg (1995). https://doi.org/10.1007/978-3-642-85098-1_5
Rosen, Y.: Computer-based assessment of collaborative problem solving: exploring the feasibility of human-to-agent approach. Int. J. Artif. Intell. Educ. 25(3), 380–406 (2015). https://doi.org/10.1007/s40593-015-0042-3
Ruis, A., et al.: Finding Common Ground: A Method for Measuring Recent Temporal Context in Analyses of Complex, Collaborative Thinking (2019)
San Martín-Rodríguez, L., et al.: The determinants of successful collaboration: a review of theoretical and empirical studies. J. Interprof. Care 19, 132–147 (2005)
Shaffer, D.: Hierarchical Epistemic Network Analysis (2021)
Shaffer, D.W., et al.: A tutorial on epistemic network analysis: analyzing the structure of connections in cognitive, social, and interaction data. J. Learn. Anal. 3(3), 9–45 (2016). https://doi.org/10.18608/jla.2016.33.3
Shaffer, D.W., et al.: Epistemic Network analysis: a worked example of theory-based learning analytics. In: Columbia University, USA et al. (eds.) Handbook of Learning Analytics, pp. 175–187. Society for Learning Analytics Research (SoLAR) (2017). https://doi.org/10.18608/hla17.015
Siebert-Evenstone, A.L., et al.: In search of conversational grain size: modeling semantic structure using moving stanza windows. J. Learn. Anal. 4(3), 123–139 (2017)
Smith, C.A.P., et al.: Decision support for air warfare: setection of deceptive threats. Group Decis. Negot. 13(2), 129–148 (2004)
Swiecki, Z., et al.: Assessing individual contributions to collaborative problem solving: a network analysis approach. Comput. Hum. Behav. 104, 105876 (2020)
Swiecki, Z., et al.: Does Order Matter? Investigating Sequential and Cotemporal Models of Collaboration, vol. 8 (2019)
Tan, Y., et al.: Epistemic network analysis visualization. In: Wasson, B., Zörgő, S. (eds.) Advances in Quantitative Ethnography, pp. 129–143 Springer International Publishing, Cham (2022). https://doi.org/10.1007/978-3-030-93859-8_9
Acknowledgement
This work was funded in part by the National Science Foundation (DRL-1661036, DRL-1713110), the Wisconsin Alumni Research Foundation, and the Office of the Vice Chancellor for Research and Graduate Education at the University of Wisconsin-Madison. The opinions, findings, and conclusions do not reflect the views of the funding agencies, cooperating institutions, or other individuals.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Tan, Y., Ruis, A.R., Marquart, C., Cai, Z., Knowles, M.A., Shaffer, D.W. (2023). Ordered Network Analysis. In: Damşa, C., Barany, A. (eds) Advances in Quantitative Ethnography. ICQE 2022. Communications in Computer and Information Science, vol 1785. Springer, Cham. https://doi.org/10.1007/978-3-031-31726-2_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-31726-2_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-31725-5
Online ISBN: 978-3-031-31726-2
eBook Packages: Computer ScienceComputer Science (R0)