Asee peer logo

Developing an Observation Protocol for Cooperative Learning

Download Paper |

Conference

2022 ASEE Annual Conference & Exposition

Location

Minneapolis, MN

Publication Date

August 23, 2022

Start Date

June 26, 2022

End Date

June 29, 2022

Conference Session

ERM: Teamwork makes the dream work!

Page Count

8

DOI

10.18260/1-2--40991

Permanent URL

https://strategy.asee.org/40991

Download Count

272

Request a correction

Paper Authors

biography

Morgan Fong

visit author page

Morgan M. Fong is a Ph.D. student in the Department of Computer Science at the University of Illinois, Urbana-Champaign and an NSF Graduate Research Fellow. Prior to starting her Ph.D. Morgan completed her B.A. in Computer Science at the University of California, Berkeley. Her current research focuses on developing methods for observing and analyzing cooperative learning in undergraduate computing courses.

visit author page

biography

Hongxuan Chen University of Illinois at Urbana - Champaign

visit author page

Hongxuan Chen is a Ph.D. student in the Department of Computer Science at the University of Illinois, Urbana-Champaign, where he also completed his B.S. in Computer Science. He is broadly interested in how students learn computer science and broadening participation in computer science.

visit author page

biography

Geoffrey Herman University of Illinois at Urbana - Champaign

visit author page

Dr. Geoffrey L. Herman is the Severns Teaching Associate Professor with the Department of Computer Science at the University of Illinois at Urbana-Champaign. He earned his Ph.D. in Electrical and Computer Engineering from the University of Illinois at Urbana-Champaign as a Mavis Future Faculty Fellow and conducted postdoctoral research with Ruth Streveler in the School of Engineering Education at Purdue University. His research interests include creating systems for sustainable improvement in engineering education, conceptual change and development in engineering students, and change in faculty beliefs about teaching and learning. He is an associate editor with the Journal of Engineering Education and a board member of the Computing Research Association Education committee.

visit author page

author page

Liia Butler University of Illinois at Urbana - Champaign

Download Paper |

Abstract

This work-in-progress aims to develop methods for studying cooperative learning. Use of structured roles to facilitate cooperative learning is an evidence-based practice that has been shown to be beneficial. In computer science (CS), Process Oriented Guided Inquiry Learning (POGIL) and pair programming are common implementations of structured roles. The combination of structured roles and activities also helps build students’ process skills including communication and metacognition. The benefits of implementing structured role-based cooperation include scalability to large classroom sizes, decreased attrition and failure rates, and positive student perception. While these benefits have been shown in a variety of disciplines, most prior work has focused on in-person, synchronous settings, and few studies have looked at online, synchronous settings. With the ongoing COVID-19 pandemic, instructors around the world have had to shift their teaching strategies online, thus we need a better understanding of how cooperative learning takes place online. This work-in-progress serves to document our development of a mixed-methods approach to capture how students work together during online, POGIL-inspired activities. We used a concurrent mixed-methods approach to create an observation protocol that bridges the strengths between purely qualitative and purely quantitative methods. Purely quantitative data sources, such as student survey data, can quickly give general trends and themes of how students perceive cooperative learning and how cooperative learning may have impacted student achievement. However, these insights come at the cost of detail and specificity. On the other hand, purely qualitative data sources, such as video recordings of groups and ethnographic observations, give incredible depth and insight into how a group works together and how that process evolves over time. However, this comes at the cost of extensive time to analyze data and loss of generality. To develop our observation protocol, a team of three graduate student researchers visited three different CS courses during the Spring 2021 semester. These courses were technical, core courses with large enrollments (~400 students each), and all three were offered at the same large, public research university. Each course used a flipped classroom design: students would watch pre-class videos, then attend online, synchronous class sessions via Zoom to work with their groups on a POGIL-inspired activity. Groups worked separately in their own Zoom breakout rooms with access to instructor help via an online queue. 77 audio and screen recordings were collected across the three courses. The team is currently in the process of validating the coding scheme by performing interrater reliability checks using a subset of the videos. In this work-in-progress, we present preliminary findings related to the kinds of contributions students make, general participation trends, moments of team bonding, and help-seeking patterns. Finally, we discuss future directions for use of our coding scheme as well as implications on implementing structured role-based cooperative learning online in the future.

Fong, M., & Chen, H., & Herman, G., & Butler, L. (2022, August), Developing an Observation Protocol for Cooperative Learning Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--40991

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2022 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015