A momentary view of engagement in collaborative learning: Triangulation through multimodal data
Main Article Content
Abstract
Despite recognising momentary challenges while learning, collaborative groups do not necessarily regulate and adapt their learning process according to the demands. Various online measures have recently been explored to unobtrusively study engagement and adaptation in collaborative learning (CL), as it occurs in the classroom. For example, physiological synchrony derived from electrodermal activity (EDA) has been a prominent reflector of momentary engagement in CL. However, how physiological synchrony relates to students’ views about CL, regulation of learning, and performance remains unclear. This study investigates how momentary measures of physiological synchrony, students’ perceived value of CL, and regulation of learning, align and further relate to group performance. The participants were 94 students attending a physics course consisting of four 90-minute lessons and a collaborative exam. Each lesson included a CL task. At the beginning and end of each session, students reported their perceived value of CL. Students’ EDA was recorded to derive physiological synchrony. Co-regulation (CoRL) and socially shared regulation (SSRL) were coded from the video. Results suggest that when groups show higher physiological synchrony, they perceive their CL as less valuable and tend to perform worse in collaborative exams. It seems that self-reports on the value of CL, rather than physiological synchrony, may better reflect the regulation of CL. Interestingly, the association patterns for CoRL and SSRL differed, as frequent CoRL was linked to the less valued CL, while SSRL tended towards a positive relation. The study demonstrates the complex and multidimensional role of momentary engagement in CL.
Article Details
FLR adopts the Attribution-NonCommercial-NoDerivs Creative Common License (BY-NC-ND). That is, Copyright for articles published in this journal is retained by the authors with, however, first publication rights granted to the journal. By virtue of their appearance in this open access journal, articles are free to use, with proper attribution, in educational and other non-commercial settings.
References
Ahola, S., Malmberg, J., & Järvenoja, H. (2023). Investigating the relation of higher education students’ situational self-efficacy beliefs to participation in group level regulation of learning during a collaborative task. Cogent Education, 10(1), 2164241. https://doi.org/10.1080/2331186X.2022.2164241
Azevedo, R. (2015). Defining and measuring engagement and learning in science: Conceptual, theoretical, methodological, and analytical issues. Educational Psychologist, 50(1), 84–94. https://doi.org/10.1080/00461520.2015.1004069
Ba, S., & Hu, X. (2023). Measuring emotions in education using wearable devices: A systematic review. Computers & Education, 200, 104797. https://doi.org/10.1016/j.compedu.2023.104797
Bakdash, J. Z., & Marusich, L. R. (2017). Repeated measures correlation. Frontiers in Psychology, 8(MAR), 1–13. https://doi.org/10.3389/fpsyg.2017.00456
Bakhtiar, A., Webster, E. A., & Hadwin, A. F. (2017). Regulation and socio-emotional interactions in a positive and a negative group climate. Metacognition and Learning. https://doi.org/10.1007/s11409-017-9178-x
Cen, L., Ruta, D., Powell, L., Hirsch, B., & Ng, J. (2016). Quantitative approach to collaborative learning: Performance prediction, individual assessment, and group composition. International Journal of Computer-Supported Collaborative Learning, 11(2), 187–225. https://doi.org/10.1007/s11412-016-9234-6
Coco, M. I., Mønster, D., Leonardi, G., Dale, R., & Wallot, S. (2020). Unidimensional and Multidimensional Methods for Recurrence Quantification Analysis with crqa. http://arxiv.org/abs/2006.01954
Cohen, E. G. (1994). Restructuring the Classroom: Conditions for Productive Small Groups. Review of Educational Research, 64(1), 1–35. https://doi.org/10.3102/00346543064001001
Dawson, M. E., Schell, A. M., & Filion, D. L. (2017). The Electrodermal System. In J. T. Cacioppo, L. G. Tassinary, & G. G. Berntson (Eds.), Handbook of Psychophysiology (pp. 217–243). Cambridge University Press. https://doi.org/10.1017/9781107415782.010
De Backer, L., Van Keer, H., & Valcke, M. (2020). Variations in socially shared metacognitive regulation and their relation with university students’ performance. Metacognition and Learning, 15(2), 233–259. https://doi.org/10.1007/s11409-020-09229-5
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109.
Haataja, E., Dindar, M., Malmberg, J., & Järvelä, S. (2022). Individuals in a group: Metacognitive and regulatory predictors of learning achievement in collaborative learning. Learning and Individual Differences, 96(March), 102146. https://doi.org/10.1016/j.lindif.2022.102146
Haataja, E., Malmberg, J., Dindar, M., & Järvelä, S. (2022). The pivotal role of monitoring for collaborative problem solving seen in interaction, performance, and interpersonal physiology. Metacognition and Learning, 17(1), 241–268. https://doi.org/10.1007/s11409-021-09279-3
Hadwin, A. F., Järvelä, S., & Miller, M. (2018). Self-regulation, co-regulation and shared regulation in collaborative learning environments. In D. H. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (pp. 83–106). Routledge/Taylor & Francis Group.
Isohätälä, J., Järvenoja, H., & Järvelä, S. (2017). Socially shared regulation of learning and participation in social interaction in collaborative learning. International Journal of Educational Research, 81, 11–24. https://doi.org/10.1016/j.ijer.2016.10.006
Isohätälä, J., Näykki, P., & Järvelä, S. (2020). Cognitive and Socio-Emotional Interaction in Collaborative Learning: Exploring Fluctuations in Students’ Participation. Scandinavian Journal of Educational Research, 64(6), 831–851. https://doi.org/10.1080/00313831.2019.1623310
Järvelä, S., & Hadwin, A. F. (2013). New frontiers: Regulating learning in CSCL. Educational Psychologist, 48(1), 25–39. https://doi.org/10.1080/00461520.2012.748006
Järvelä, S., Järvenoja, H., Malmberg, J., Isohätälä, J., & Sobocinski, M. (2016). How do types of interaction and phases of self-regulated learning set a stage for collaborative engagement? Learning and Instruction, 43, 39–51. https://doi.org/10.1016/j.learninstruc.2016.01.005
Järvelä, S., Malmberg, J., Sobocinski, M., & Kirschner, P. A. (2021). Metacognition in Collaborative Learning. In U. Cress (Ed.), International Handbook of Computer-Supported Collaborative Learning (pp. 281–294). Springer International Publishing. https://doi.org/10.1007/978-3-030-65291-3_15
Järvenoja, H., & Järvelä, S. (2013). Regulating emotions together for motivated collaboration. In M. Baker, J. Andriessen, & S. Järvelä (Eds.), Affective Learning Together: Social and Emotional Dimensions of Collaborative Learning (pp. 162–181). Routledge. https://doi.org/10.4324/9780203069684
Kreijns, K., Kirschner, P. a., & Jochems, W. (2003). Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: A review of the research. Computers in Human Behavior, 19(3), 335–353. https://doi.org/10.1016/S0747-5632(02)00057-2
Lai, H.-M. (2021). Understanding what determines university students’ behavioral engagement in a group-based flipped learning context. Computers & Education, 173, 104290. https://doi.org/10.1016/j.compedu.2021.104290
Lee, V. R., Fischback, L., & Cain, R. (2019). A wearables-based approach to detect and identify momentary engagement in afterschool Makerspace programs. Contemporary Educational Psychology, 59(July), 101789. https://doi.org/10.1016/j.cedpsych.2019.101789
Malmberg, J., Haataja, E., Törmänen, T., Järvenoja, H., Zabolotna, K., & Järvelä, S. (2023). Multimodal Measures Characterising Collaborative Groups’ Interaction and Engagement in Learning. In V. Kovanovic, R. Azevedo, D. C. Gibson, & D. lfenthaler (Eds.), Unobtrusive Observations of Learning in Digital Environments: Examining Behavior, Cognition, Emotion, Metacognition and Social Processes Using Learning Analytics (pp. 197–216). Springer International Publishing. https://doi.org/10.1007/978-3-031-30992-2_12
Mänty, K., Järvenoja, H., & Törmänen, T. (2020). Socio-emotional interaction in collaborative learning: Combining individual emotional experiences and group-level emotion regulation. International Journal of Educational Research, 102(April), 101589. https://doi.org/10.1016/j.ijer.2020.101589
Martin, A. J., Malmberg, L.-E., Pakarinen, E., Mason, L., & Mainhard, T. (2023). The potential of biophysiology for understanding motivation, engagement and learning experiences. British Journal of Educational Psychology, 93(S1), 1–9. https://doi.org/10.1111/bjep.12584
Mendes, W. B. (2009). Assessing autonomic nervous system activity. In E. Harmon-Jones & J. S. Beer (Eds.), Methods in social neuroscience (pp. 118–147). Guilford Press.
Mønster, D., Håkonsson, D. D., Eskildsen, J. K., & Wallot, S. (2016). Physiological evidence of interpersonal dynamics in a cooperative production task. Physiology & Behavior, 156, 24–34. https://doi.org/10.1016/j.physbeh.2016.01.004
Rogat, T. K., Hmelo-Silver, C. E., Cheng, B. H., Traynor, A., Adeoye, T. F., Gomoll, A., & Downing, B. K. (2022). A Multidimensional Framework of Collaborative Groups’ Disciplinary Engagement. Frontline Learning Research, 10(2), 1–21. https://doi.org/10.14786/flr.v10i2.863
Roschelle, J., & Teasley, StephanieD. D. (1995). The Construction of Shared Knowledge in Collaborative Problem Solving. In C. O’Malley (Ed.), Computer Supported Collaborative Learning (Vol. 128, pp. 69–97). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-85098-1_5
Salmela-Aro, K., Upadyaya, K., Cumsille, P., Lavonen, J., Avalos, B., & Eccles, J. (2021). Momentary task-values and expectations predict engagement in science among Finnish and Chilean secondary school students. International Journal of Psychology, 56(3), 415–424. https://doi.org/10.1002/ijop.12719
Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015). The Challenges of Defining and Measuring Student Engagement in Science. Educational Psychologist, 50(1), 1–13. https://doi.org/10.1080/00461520.2014.1002924
Sinha, S., Rogat, T. K., Adams-Wiggins, K. R., & Hmelo-Silver, C. E. (2015). Collaborative group engagement in a computer-supported inquiry learning environment. International Journal of Computer-Supported Collaborative Learning, 10(3), 273–307. https://doi.org/10.1007/s11412-015-9218-y
Slovák, P., Tennent, P., Reeves, S., & Fitzpatrick, G. (2014). Exploring skin conductance synchronisation in everyday interactions. Proceedings of the 8th Nordic Conference on Human-Computer Interaction Fun, Fast, Foundational - NordiCHI ’14, September 2015, 511–520. https://doi.org/10.1145/2639189.2639206
Sobocinski, M., Järvelä, S., Malmberg, J., Dindar, M., Isosalo, A., & Noponen, K. (2020). How does monitoring set the stage for adaptive regulation or maladaptive behavior in collaborative learning? Metacognition and Learning, 15(2), 99–127. https://doi.org/10.1007/s11409-020-09224-w
Sung, G., Bhinder, H., Feng, T., & Schneider, B. (2023). Stressed or engaged? Addressing the mixed significance of physiological activity during constructivist learning. Computers & Education, 104784. https://doi.org/10.1016/j.compedu.2023.104784
Symonds, J. E., Schreiber, J. B., & Torsney, B. M. (2021). Silver linings and storm clouds: Divergent profiles of student momentary engagement emerge in response to the same task. Journal of Educational Psychology, 113(6), 1192–1207. https://doi.org/10.1037/edu0000605
Törmänen, T., Järvenoja, H., & Mänty, K. (2021). All for one and one for all – How are students’ affective states and group-level emotion regulation interconnected in collaborative learning? International Journal of Educational Research, 109(September), 101861. https://doi.org/10.1016/j.ijer.2021.101861
Upadyaya, K., Cumsille, P., Avalos, B., Araneda, S., Lavonen, J., & Salmela-Aro, K. (2021). Patterns of situational engagement and task values in science lessons. The Journal of Educational Research, 114(4), 394–403. https://doi.org/10.1080/00220671.2021.1955651
Vuopala, E., Näykki, P., Isohätälä, J., & Järvelä, S. (2019). Knowledge co-construction activities and task-related monitoring in scripted collaborative learning. Learning, Culture and Social Interaction, 21(March), 234–249. https://doi.org/10.1016/j.lcsi.2019.03.011
Vuorenmaa, E., Järvelä, S., Dindar, M., & Järvenoja, H. (2023). Sequential Patterns in Social Interaction States for Regulation in Collaborative Learning. Small Group Research, 54(4), 512–550. https://doi.org/10.1177/10464964221137524
Wallot, S., & Leonardi, G. (2018). Analysing Multivariate Dynamics Using Cross-Recurrence Quantification Analysis (CRQA), Diagonal-Cross-Recurrence Profiles (DCRP), and Multidimensional Recurrence Quantification Analysis (MdRQA) – A Tutorial in R. Frontiers in Psychology, 9(December), 1–21. https://doi.org/10.3389/fpsyg.2018.02232
Wallot, S., Mitkidis, P., McGraw, J. J., & Roepstorff, A. (2016). Beyond Synchrony: Joint Action in a Complex Production Task Reveals Beneficial Effects of Decreased Interpersonal Synchrony. PLOS ONE, 11(12), e0168306. https://doi.org/10.1371/journal.pone.0168306
Wallot, S., Roepstorff, A., & Mønster, D. (2016). Multidimensional Recurrence Quantification Analysis (MdRQA) for the Analysis of Multidimensional Time-Series: A Software Implementation in MATLAB and Its Application to Group-Level Data in Joint Action. Frontiers in Psychology, 7, 1–13. https://doi.org/10.3389/fpsyg.2016.01835
Zabolotna, K., Malmberg, J., & Järvenoja, H. (2023). Examining the interplay of knowledge construction and group-level regulation in a computer-supported collaborative learning physics task. Computers in Human Behavior, 138, 107494. https://doi.org/10.1016/j.chb.2022.107494
Zhang, Y., Qin, F., Liu, B., Qi, X., Zhao, Y., & Zhang, D. (2018). Wearable neurophysiological recordings in middle-school classroom correlate with students’ academic performance. Frontiers in Human Neuroscience, 12(November), 1–8. https://doi.org/10.3389/fnhum.2018.00457
Zheng, L., & Huang, R. (2016). The effects of sentiments and co-regulation on group performance in computer supported collaborative learning. Internet and Higher Education, 28, 59–67. https://doi.org/10.1016/j.iheduc.2015.10.001
Zheng, L., Li, X., & Huang, R. (2017). The Effect of Socially Shared Regulation Approach on Learning Performance in Computer-Supported Collaborative Learning. Educational Technology & Society, 20, 35–46.
Zschocke, K., Wosnitza, M., & Bürger, K. (2016). Emotions in group work: Insights from an appraisal-oriented perspective. European Journal of Psychology of Education, 31(3), 359–384. https://doi.org/10.1007/s10212-015-0278-1